Jul 13 07:09:57.488353 ip-10-0-141-197 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 13 07:09:57.488363 ip-10-0-141-197 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 13 07:09:57.488370 ip-10-0-141-197 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 13 07:09:57.488605 ip-10-0-141-197 systemd[1]: Failed to start Kubernetes Kubelet. Jul 13 07:10:07.692058 ip-10-0-141-197 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 13 07:10:07.692078 ip-10-0-141-197 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 169e70d6929a4afd9baa39dbc4245d4a -- Jul 13 07:12:02.939741 ip-10-0-141-197 systemd[1]: Starting Kubernetes Kubelet... Jul 13 07:12:03.432177 ip-10-0-141-197 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 07:12:03.432177 ip-10-0-141-197 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 13 07:12:03.432177 ip-10-0-141-197 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 07:12:03.432177 ip-10-0-141-197 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 13 07:12:03.432177 ip-10-0-141-197 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 13 07:12:03.432177 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.362708 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 13 07:12:03.432177 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366248 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 07:12:03.432177 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366261 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 07:12:03.432177 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366265 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 07:12:03.432177 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366270 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 07:12:03.432177 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366274 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 07:12:03.432177 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366278 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 07:12:03.432177 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366281 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 07:12:03.433060 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366284 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 07:12:03.433060 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366286 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 07:12:03.433060 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366289 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 07:12:03.433060 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366292 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 07:12:03.433060 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366295 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 07:12:03.433060 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366297 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 07:12:03.433060 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366300 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 07:12:03.433060 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366303 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 07:12:03.433060 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366306 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 07:12:03.433060 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366309 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 07:12:03.433060 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366311 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 07:12:03.433060 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366327 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 07:12:03.433060 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366330 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 07:12:03.433060 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366340 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 07:12:03.433060 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366342 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 07:12:03.433060 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366346 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 07:12:03.433060 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366349 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 07:12:03.433060 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366352 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 07:12:03.433060 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366354 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 07:12:03.433060 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366357 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 07:12:03.433770 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366360 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 07:12:03.433770 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366363 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 07:12:03.433770 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366365 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 07:12:03.433770 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366368 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 07:12:03.433770 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366372 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 07:12:03.433770 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366376 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 07:12:03.433770 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366380 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 07:12:03.433770 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366383 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 07:12:03.433770 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366385 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 07:12:03.433770 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366388 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 07:12:03.433770 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366391 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 07:12:03.433770 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366394 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 07:12:03.433770 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366397 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 07:12:03.433770 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366401 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 07:12:03.433770 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366403 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 07:12:03.433770 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366406 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 07:12:03.433770 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366408 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 07:12:03.433770 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366412 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 07:12:03.433770 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366414 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 07:12:03.434281 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366417 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 13 07:12:03.434281 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366419 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 07:12:03.434281 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366422 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 07:12:03.434281 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366426 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 07:12:03.434281 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366429 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 07:12:03.434281 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366432 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 07:12:03.434281 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366435 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 07:12:03.434281 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366438 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 07:12:03.434281 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366441 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 07:12:03.434281 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366444 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 07:12:03.434281 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366447 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 07:12:03.434281 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366450 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 07:12:03.434281 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366452 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 07:12:03.434281 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366455 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 07:12:03.434281 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366457 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 07:12:03.434281 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366461 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 07:12:03.434281 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366465 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 07:12:03.434281 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366468 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 07:12:03.434281 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366471 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 07:12:03.435197 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366474 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 07:12:03.435197 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366476 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 07:12:03.435197 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366481 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 07:12:03.435197 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366483 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 07:12:03.435197 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366486 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 07:12:03.435197 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366488 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 07:12:03.435197 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366491 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 07:12:03.435197 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366494 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 07:12:03.435197 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366496 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 07:12:03.435197 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366499 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 07:12:03.435197 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366502 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 07:12:03.435197 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366504 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 07:12:03.435197 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366507 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 07:12:03.435197 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366509 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 07:12:03.435197 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366512 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 07:12:03.435197 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366514 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 07:12:03.435197 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366517 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 07:12:03.435197 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366519 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 07:12:03.435197 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366522 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 07:12:03.435197 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366524 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 07:12:03.435852 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366527 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 07:12:03.435852 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366530 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 07:12:03.435852 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366532 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 07:12:03.435852 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366535 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 07:12:03.435852 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366537 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 07:12:03.435852 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366540 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 07:12:03.435852 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366543 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 07:12:03.435852 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366545 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 07:12:03.435852 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366548 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 07:12:03.435852 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366551 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 07:12:03.435852 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366553 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 07:12:03.435852 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366556 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 07:12:03.435852 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366559 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 07:12:03.435852 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.366561 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 07:12:03.435852 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367259 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 07:12:03.435852 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367267 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 07:12:03.435852 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367270 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 07:12:03.435852 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367272 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 07:12:03.435852 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367275 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 07:12:03.435852 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367278 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 07:12:03.436518 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367281 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 07:12:03.436518 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367284 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 07:12:03.436518 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367287 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 07:12:03.436518 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367289 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 07:12:03.436518 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367292 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 07:12:03.436518 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367294 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 07:12:03.436518 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367297 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 07:12:03.436518 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367300 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 07:12:03.436518 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367303 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 07:12:03.436518 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367305 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 07:12:03.436518 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367308 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 07:12:03.436518 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367311 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 07:12:03.436518 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367334 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 07:12:03.436518 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367337 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 07:12:03.436518 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367339 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 07:12:03.436518 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367342 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 07:12:03.436518 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367347 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 07:12:03.436518 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367352 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 07:12:03.436518 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367355 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 07:12:03.436518 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367358 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 07:12:03.437128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367361 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 07:12:03.437128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367364 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 07:12:03.437128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367367 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 07:12:03.437128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367371 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 13 07:12:03.437128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367375 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 07:12:03.437128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367379 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 07:12:03.437128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367382 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 07:12:03.437128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367385 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 07:12:03.437128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367388 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 07:12:03.437128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367390 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 07:12:03.437128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367393 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 07:12:03.437128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367396 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 07:12:03.437128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367400 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 07:12:03.437128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367403 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 07:12:03.437128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367406 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 07:12:03.437128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367409 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 07:12:03.437128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367412 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 07:12:03.437128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367414 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 07:12:03.437128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367417 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 07:12:03.437128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367419 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 07:12:03.437801 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367422 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 07:12:03.437801 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367425 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 07:12:03.437801 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367427 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 07:12:03.437801 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367431 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 07:12:03.437801 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367433 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 07:12:03.437801 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367436 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 07:12:03.437801 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367438 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 07:12:03.437801 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367441 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 07:12:03.437801 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367444 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 07:12:03.437801 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367448 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 07:12:03.437801 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367450 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 07:12:03.437801 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367453 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 07:12:03.437801 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367456 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 07:12:03.437801 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367459 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 07:12:03.437801 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367461 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 07:12:03.437801 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367464 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 07:12:03.437801 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367466 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 07:12:03.437801 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367469 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 07:12:03.437801 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367472 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 07:12:03.437801 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367474 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 07:12:03.438418 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367477 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 07:12:03.438418 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367479 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 07:12:03.438418 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367482 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 07:12:03.438418 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367484 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 07:12:03.438418 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367487 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 07:12:03.438418 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367489 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 07:12:03.438418 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367492 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 07:12:03.438418 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367495 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 07:12:03.438418 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367498 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 07:12:03.438418 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367502 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 07:12:03.438418 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367505 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 07:12:03.438418 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367507 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 07:12:03.438418 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367510 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 07:12:03.438418 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367513 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 07:12:03.438418 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367516 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 07:12:03.438418 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367518 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 07:12:03.438418 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367521 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 07:12:03.438418 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367523 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 07:12:03.438418 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367526 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 07:12:03.438418 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367529 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 07:12:03.439094 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367531 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 07:12:03.439094 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367534 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 07:12:03.439094 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367540 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 07:12:03.439094 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367542 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 07:12:03.439094 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367545 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 07:12:03.439094 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367547 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 07:12:03.439094 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367550 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 07:12:03.439094 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367552 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 07:12:03.439094 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367555 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 07:12:03.439094 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367557 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 07:12:03.439094 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367560 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 07:12:03.439094 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367563 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 07:12:03.439094 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.367565 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 07:12:03.439094 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368000 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 07:12:03.439094 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368006 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 07:12:03.439094 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368010 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 07:12:03.439094 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368013 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 07:12:03.439094 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368017 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 07:12:03.439094 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368020 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 07:12:03.439734 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368024 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 07:12:03.439734 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368027 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 07:12:03.439734 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368029 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 07:12:03.439734 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368032 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 07:12:03.439734 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368035 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 07:12:03.439734 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368037 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 07:12:03.439734 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368040 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 07:12:03.439734 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368042 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 07:12:03.439734 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368045 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 07:12:03.439734 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368047 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 07:12:03.439734 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368050 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 07:12:03.439734 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368053 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 07:12:03.439734 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368055 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 07:12:03.439734 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368058 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 07:12:03.439734 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368061 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 07:12:03.439734 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368065 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 07:12:03.439734 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368068 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 07:12:03.439734 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368070 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 07:12:03.439734 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368073 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 07:12:03.439734 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368075 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 07:12:03.440349 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368078 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 07:12:03.440349 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368082 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 07:12:03.440349 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368085 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 07:12:03.440349 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368088 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 07:12:03.440349 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368091 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 07:12:03.440349 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368094 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 07:12:03.440349 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368097 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 07:12:03.440349 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368099 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 07:12:03.440349 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368102 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 07:12:03.440349 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368105 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 07:12:03.440349 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368108 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 07:12:03.440349 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368111 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 07:12:03.440349 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368114 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 07:12:03.440349 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368116 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 07:12:03.440349 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368119 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 07:12:03.440349 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368121 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 07:12:03.440349 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368124 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 07:12:03.440349 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368127 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 07:12:03.440349 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368129 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 07:12:03.440976 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368132 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 07:12:03.440976 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368134 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 07:12:03.440976 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368136 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 07:12:03.440976 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368139 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 07:12:03.440976 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368142 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 07:12:03.440976 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368144 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 13 07:12:03.440976 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368147 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 07:12:03.440976 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368149 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 07:12:03.440976 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368153 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 07:12:03.440976 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368156 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 07:12:03.440976 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368158 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 07:12:03.440976 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368161 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 07:12:03.440976 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368163 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 07:12:03.440976 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368166 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 07:12:03.440976 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368169 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 07:12:03.440976 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368171 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 07:12:03.440976 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368175 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 07:12:03.440976 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368179 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 07:12:03.440976 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368182 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 07:12:03.440976 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368185 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 07:12:03.442009 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368187 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 07:12:03.442009 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368191 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 07:12:03.442009 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368194 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 07:12:03.442009 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368197 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 07:12:03.442009 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368200 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 07:12:03.442009 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368203 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 07:12:03.442009 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368205 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 07:12:03.442009 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368208 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 07:12:03.442009 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368211 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 07:12:03.442009 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368213 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 07:12:03.442009 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368216 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 07:12:03.442009 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368218 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 07:12:03.442009 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368221 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 07:12:03.442009 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368223 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 07:12:03.442009 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368226 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 07:12:03.442009 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368228 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 07:12:03.442009 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368231 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 07:12:03.442009 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368233 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 07:12:03.442009 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368236 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 07:12:03.442009 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368238 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 07:12:03.441994 ip-10-0-141-197 systemd[1]: Started Kubernetes Kubelet. Jul 13 07:12:03.443053 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368243 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 07:12:03.443053 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368245 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 07:12:03.443053 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368248 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 07:12:03.443053 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368250 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 07:12:03.443053 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368253 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 07:12:03.443053 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368256 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 07:12:03.443053 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368260 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 07:12:03.443053 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368263 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 07:12:03.443053 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368266 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 07:12:03.443053 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368268 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 07:12:03.443053 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368271 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 07:12:03.443053 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368273 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 07:12:03.443053 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368276 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 07:12:03.443053 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368280 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 07:12:03.443053 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368357 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 13 07:12:03.443053 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368364 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 13 07:12:03.443053 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368370 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 13 07:12:03.443053 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368375 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 13 07:12:03.443053 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368380 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 13 07:12:03.443053 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368383 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368387 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368392 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368395 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368398 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368401 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368405 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368408 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368411 2565 flags.go:64] FLAG: --cgroup-root="" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368414 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368417 2565 flags.go:64] FLAG: --client-ca-file="" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368420 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368423 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368430 2565 flags.go:64] FLAG: --cluster-domain="" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368433 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368436 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368439 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368442 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368446 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368449 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368452 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368455 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368458 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368461 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 13 07:12:03.445862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368464 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368468 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368472 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368476 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368479 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368482 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368485 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368488 2565 flags.go:64] FLAG: --enable-server="true" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368492 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368496 2565 flags.go:64] FLAG: --event-burst="100" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368499 2565 flags.go:64] FLAG: --event-qps="50" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368502 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368505 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368508 2565 flags.go:64] FLAG: --eviction-hard="" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368511 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368515 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368518 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368521 2565 flags.go:64] FLAG: --eviction-soft="" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368524 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368526 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368529 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368533 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368537 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368540 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368543 2565 flags.go:64] FLAG: --feature-gates="" Jul 13 07:12:03.449334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368547 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368550 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368553 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368556 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368559 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368562 2565 flags.go:64] FLAG: --help="false" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368564 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-141-197.ec2.internal" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368567 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368570 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368575 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368578 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368582 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368584 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368587 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368590 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368593 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368605 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368608 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368611 2565 flags.go:64] FLAG: --kube-reserved="" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368614 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368617 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368620 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368623 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368626 2565 flags.go:64] FLAG: --lock-file="" Jul 13 07:12:03.451033 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368629 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368632 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368635 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368644 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368648 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368651 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368654 2565 flags.go:64] FLAG: --logging-format="text" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368657 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368660 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368663 2565 flags.go:64] FLAG: --manifest-url="" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368666 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368678 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368681 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368685 2565 flags.go:64] FLAG: --max-pods="110" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368688 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368691 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368694 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368698 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368701 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368704 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368707 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368714 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368717 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368720 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 13 07:12:03.617285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368723 2565 flags.go:64] FLAG: --pod-cidr="" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368726 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368732 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368735 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368739 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368742 2565 flags.go:64] FLAG: --port="10250" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368745 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368748 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a3a9dbb7fc8c8ded" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368751 2565 flags.go:64] FLAG: --qos-reserved="" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368754 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368757 2565 flags.go:64] FLAG: --register-node="true" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368759 2565 flags.go:64] FLAG: --register-with-taints="" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368765 2565 flags.go:64] FLAG: --registry-burst="10" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368768 2565 flags.go:64] FLAG: --registry-qps="5" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368771 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368774 2565 flags.go:64] FLAG: --reserved-memory="" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368777 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368781 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368784 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368786 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368789 2565 flags.go:64] FLAG: --runonce="false" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368792 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368795 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368798 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368801 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 13 07:12:03.640078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368804 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368808 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368811 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368814 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368817 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368820 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368823 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368826 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368829 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368833 2565 flags.go:64] FLAG: --system-cgroups="" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368836 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368841 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368844 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368847 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368851 2565 flags.go:64] FLAG: --tls-min-version="" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368854 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368856 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368859 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368862 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368866 2565 flags.go:64] FLAG: --v="2" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368870 2565 flags.go:64] FLAG: --version="false" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368874 2565 flags.go:64] FLAG: --vmodule="" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368878 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.368881 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368994 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 07:12:03.641834 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.368997 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 07:12:03.643150 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369000 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 07:12:03.643150 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369003 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 13 07:12:03.643150 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369006 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 07:12:03.643150 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369008 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 07:12:03.643150 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369011 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 07:12:03.643150 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369014 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 07:12:03.643150 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369016 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 07:12:03.643150 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369022 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 07:12:03.643150 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369024 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 07:12:03.643150 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369027 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 07:12:03.643150 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369030 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 07:12:03.643150 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369032 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 07:12:03.643150 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369035 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 07:12:03.643150 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369038 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 07:12:03.643150 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369040 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 07:12:03.643150 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369043 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 07:12:03.643150 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369046 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 07:12:03.643150 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369048 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 07:12:03.643150 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369051 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 07:12:03.643150 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369053 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 07:12:03.643846 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369056 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 07:12:03.643846 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369058 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 07:12:03.643846 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369061 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 07:12:03.643846 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369063 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 07:12:03.643846 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369066 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 07:12:03.643846 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369069 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 07:12:03.643846 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369072 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 07:12:03.643846 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369075 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 07:12:03.643846 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369077 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 07:12:03.643846 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369080 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 07:12:03.643846 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369082 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 07:12:03.643846 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369085 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 07:12:03.643846 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369088 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 07:12:03.643846 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369090 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 07:12:03.643846 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369093 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 07:12:03.643846 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369095 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 07:12:03.643846 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369098 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 07:12:03.643846 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369100 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 07:12:03.643846 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369104 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 07:12:03.644572 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369111 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 07:12:03.644572 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369114 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 07:12:03.644572 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369118 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 07:12:03.644572 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369122 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 07:12:03.644572 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369125 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 07:12:03.644572 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369128 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 07:12:03.644572 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369130 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 07:12:03.644572 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369133 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 07:12:03.644572 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369136 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 07:12:03.644572 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369140 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 07:12:03.644572 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369143 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 07:12:03.644572 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369146 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 07:12:03.644572 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369149 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 07:12:03.644572 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369152 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 07:12:03.644572 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369155 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 07:12:03.644572 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369158 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 07:12:03.644572 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369160 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 07:12:03.644572 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369163 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 07:12:03.644572 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369167 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 07:12:03.645208 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369170 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 07:12:03.645208 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369172 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 07:12:03.645208 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369175 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 07:12:03.645208 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369177 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 07:12:03.645208 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369180 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 07:12:03.645208 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369182 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 07:12:03.645208 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369185 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 07:12:03.645208 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369188 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 07:12:03.645208 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369190 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 07:12:03.645208 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369193 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 07:12:03.645208 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369196 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 07:12:03.645208 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369198 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 07:12:03.645208 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369200 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 07:12:03.645208 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369204 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 07:12:03.645208 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369207 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 07:12:03.645208 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369209 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 07:12:03.645208 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369212 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 07:12:03.645208 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369215 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 07:12:03.645208 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369217 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 07:12:03.645208 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369220 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 07:12:03.645921 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369223 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 07:12:03.645921 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369225 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 07:12:03.645921 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369228 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 07:12:03.645921 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369230 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 07:12:03.645921 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369233 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 07:12:03.645921 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369236 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 07:12:03.645921 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369239 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 07:12:03.645921 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369241 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 07:12:03.645921 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369244 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 07:12:03.645921 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369246 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 07:12:03.645921 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369248 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 07:12:03.645921 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369252 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 07:12:03.645921 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369255 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 07:12:03.645921 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369257 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 07:12:03.645921 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369260 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 07:12:03.645921 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369262 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 07:12:03.645921 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369265 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 07:12:03.645921 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369268 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 07:12:03.645921 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.369270 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 07:12:03.646490 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.369775 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 07:12:03.646490 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.378476 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 13 07:12:03.646490 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.378495 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 13 07:12:03.646490 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.378516 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 13 07:12:03.646490 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.378525 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 13 07:12:03.646490 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378583 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 07:12:03.646490 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378589 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 07:12:03.646490 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378592 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 07:12:03.646490 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378595 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 07:12:03.646490 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378598 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 07:12:03.646490 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378601 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 07:12:03.646490 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378604 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 07:12:03.646490 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378607 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 07:12:03.646490 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378610 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 07:12:03.646490 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378613 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 07:12:03.646994 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378615 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 07:12:03.646994 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378618 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 07:12:03.646994 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378621 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 07:12:03.646994 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378624 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 07:12:03.646994 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378627 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 07:12:03.646994 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378629 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 07:12:03.646994 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378632 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 07:12:03.646994 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378635 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 07:12:03.646994 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378638 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 07:12:03.646994 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378640 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 07:12:03.646994 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378643 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 07:12:03.646994 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378646 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 07:12:03.646994 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378648 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 07:12:03.646994 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378651 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 07:12:03.646994 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378653 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 07:12:03.646994 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378656 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 07:12:03.646994 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378658 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 07:12:03.646994 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378661 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 07:12:03.646994 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378670 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 07:12:03.646994 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378673 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 07:12:03.647636 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378678 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 07:12:03.647636 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378681 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 07:12:03.647636 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378684 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 07:12:03.647636 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378687 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 07:12:03.647636 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378690 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 07:12:03.647636 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378693 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 07:12:03.647636 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378696 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 07:12:03.647636 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378699 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 07:12:03.647636 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378702 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 07:12:03.647636 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378704 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 07:12:03.647636 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378707 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 07:12:03.647636 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378710 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 07:12:03.647636 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378712 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 07:12:03.647636 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378715 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 07:12:03.647636 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378729 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 07:12:03.647636 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378732 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 07:12:03.647636 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378736 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 07:12:03.647636 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378738 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 07:12:03.647636 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378742 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 13 07:12:03.647636 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378746 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 07:12:03.648266 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378749 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 07:12:03.648266 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378751 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 07:12:03.648266 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378754 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 07:12:03.648266 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378757 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 07:12:03.648266 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378759 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 07:12:03.648266 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378763 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 07:12:03.648266 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378767 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 07:12:03.648266 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378771 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 07:12:03.648266 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378774 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 07:12:03.648266 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378777 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 07:12:03.648266 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378781 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 07:12:03.648266 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378785 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 07:12:03.648266 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378789 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 07:12:03.648266 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378793 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 07:12:03.648266 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378797 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 07:12:03.648266 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378801 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 07:12:03.648266 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378805 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 07:12:03.648266 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378809 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 07:12:03.648266 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378813 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 07:12:03.648885 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378818 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 07:12:03.648885 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378822 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 07:12:03.648885 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378826 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 07:12:03.648885 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378830 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 07:12:03.648885 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378837 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 07:12:03.648885 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378840 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 07:12:03.648885 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378844 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 07:12:03.648885 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378848 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 07:12:03.648885 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378852 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 07:12:03.648885 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378858 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 07:12:03.648885 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378863 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 07:12:03.648885 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378868 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 07:12:03.648885 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378873 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 07:12:03.648885 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378880 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 07:12:03.648885 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378884 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 07:12:03.648885 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378889 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 07:12:03.648885 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378893 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 07:12:03.648885 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378898 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 07:12:03.648885 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378902 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 07:12:03.649510 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378906 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 07:12:03.649510 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378910 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 07:12:03.649510 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378914 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 07:12:03.649510 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378917 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 07:12:03.649510 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378922 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 07:12:03.649510 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378926 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 07:12:03.649510 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378930 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 07:12:03.649510 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378934 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 07:12:03.649510 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378938 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 07:12:03.649510 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378942 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 07:12:03.649510 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.378945 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 07:12:03.649510 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.378952 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 07:12:03.649510 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379117 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 13 07:12:03.649510 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379125 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 13 07:12:03.649944 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379129 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 13 07:12:03.649944 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379134 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 13 07:12:03.649944 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379138 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 13 07:12:03.649944 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379144 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 13 07:12:03.649944 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379148 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 13 07:12:03.649944 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379152 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 13 07:12:03.649944 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379156 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 13 07:12:03.649944 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379160 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 13 07:12:03.649944 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379164 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 13 07:12:03.649944 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379168 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 13 07:12:03.649944 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379172 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 13 07:12:03.649944 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379176 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 13 07:12:03.649944 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379183 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 13 07:12:03.649944 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379188 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 13 07:12:03.649944 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379191 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 13 07:12:03.649944 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379196 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 13 07:12:03.649944 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379199 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 13 07:12:03.649944 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379203 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 13 07:12:03.649944 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379207 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 13 07:12:03.649944 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379211 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 13 07:12:03.650586 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379215 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 13 07:12:03.650586 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379219 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 13 07:12:03.650586 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379223 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 13 07:12:03.650586 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379226 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 13 07:12:03.650586 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379230 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 13 07:12:03.650586 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379234 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 13 07:12:03.650586 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379238 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 13 07:12:03.650586 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379242 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 13 07:12:03.650586 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379245 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 13 07:12:03.650586 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379249 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 13 07:12:03.650586 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379253 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 13 07:12:03.650586 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379257 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 13 07:12:03.650586 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379262 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 13 07:12:03.650586 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379268 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 13 07:12:03.650586 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379272 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 13 07:12:03.650586 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379278 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 13 07:12:03.650586 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379282 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 13 07:12:03.650586 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379286 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 13 07:12:03.650586 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379290 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 13 07:12:03.650586 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379294 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 13 07:12:03.651160 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379298 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 13 07:12:03.651160 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379302 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 13 07:12:03.651160 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379306 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 13 07:12:03.651160 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379310 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 13 07:12:03.651160 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379335 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 13 07:12:03.651160 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379339 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 13 07:12:03.651160 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379343 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 13 07:12:03.651160 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379347 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 13 07:12:03.651160 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379351 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 13 07:12:03.651160 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379355 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 13 07:12:03.651160 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379361 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 13 07:12:03.651160 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379365 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 13 07:12:03.651160 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379369 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 13 07:12:03.651160 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379373 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 13 07:12:03.651160 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379378 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 13 07:12:03.651160 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379382 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 13 07:12:03.651160 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379386 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 13 07:12:03.651160 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379390 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 13 07:12:03.651160 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379394 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 13 07:12:03.651772 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379398 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 13 07:12:03.651772 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379402 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 13 07:12:03.651772 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379406 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 13 07:12:03.651772 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379410 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 13 07:12:03.651772 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379414 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 13 07:12:03.651772 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379418 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 13 07:12:03.651772 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379421 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 13 07:12:03.651772 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379425 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 13 07:12:03.651772 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379430 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 13 07:12:03.651772 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379434 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 13 07:12:03.651772 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379438 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 13 07:12:03.651772 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379442 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 13 07:12:03.651772 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379446 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 13 07:12:03.651772 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379450 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 13 07:12:03.651772 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379455 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 13 07:12:03.651772 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379460 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 13 07:12:03.651772 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379465 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 13 07:12:03.651772 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379472 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 13 07:12:03.651772 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379477 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 13 07:12:03.652339 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379481 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 13 07:12:03.652339 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379484 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 13 07:12:03.652339 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379488 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 13 07:12:03.652339 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379492 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 13 07:12:03.652339 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379496 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 13 07:12:03.652339 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379500 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 13 07:12:03.652339 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379503 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 13 07:12:03.652339 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379507 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 13 07:12:03.652339 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379511 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 13 07:12:03.652339 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379514 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 13 07:12:03.652339 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379519 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 13 07:12:03.652339 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379522 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 13 07:12:03.652339 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379526 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 13 07:12:03.652339 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379530 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 13 07:12:03.652339 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379533 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 13 07:12:03.652339 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379537 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 13 07:12:03.652339 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379541 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 13 07:12:03.652339 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379545 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 13 07:12:03.652339 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:03.379548 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 13 07:12:03.652938 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.379556 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 13 07:12:03.652938 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.379703 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 13 07:12:03.652938 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.384238 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 13 07:12:03.652938 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.385652 2565 server.go:1019] "Starting client certificate rotation" Jul 13 07:12:03.652938 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.385752 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 07:12:03.652938 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.385785 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 13 07:12:03.652938 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.388131 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 07:12:03.652938 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.390605 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 13 07:12:03.652938 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.404393 2565 log.go:25] "Validated CRI v1 runtime API" Jul 13 07:12:03.652938 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.406378 2565 log.go:25] "Validated CRI v1 image API" Jul 13 07:12:03.652938 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.407176 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 13 07:12:03.652938 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.409427 2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 883101c3-620b-4260-a606-b27897bd7922:/dev/nvme0n1p3 fa323b70-c603-4804-8e69-ad4ed3068e8b:/dev/nvme0n1p4] Jul 13 07:12:03.653672 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.409450 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 13 07:12:03.653792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.420502 2565 manager.go:216] Machine: {Timestamp:2026-07-13 07:12:03.419270404 +0000 UTC m=+0.341522568 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105089 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21af73ffa2a1f497593bf841f5ee20 SystemUUID:ec21af73-ffa2-a1f4-9759-3bf841f5ee20 BootID:169e70d6-929a-4afd-9baa-39dbc4245d4a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:10:ea:45:e7:f5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:10:ea:45:e7:f5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:86:2f:5e:b3:e7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 13 07:12:03.653792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.420639 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 13 07:12:03.653792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.420734 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 13 07:12:03.653792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.423910 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 13 07:12:03.653792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.423940 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-197.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 13 07:12:03.653792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.424251 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 07:12:03.653792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.425121 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.425133 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.425141 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.425809 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.427129 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.429882 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.430036 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.430064 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.430073 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.430088 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.430098 2565 kubelet.go:398] "Adding apiserver pod source" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.430107 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.430458 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.430477 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.432636 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.434476 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.434505 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.435507 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.435523 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.435530 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.435537 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.435546 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.435553 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.435562 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.435568 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.435574 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.435580 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.435589 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.435598 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.437275 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.437282 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.440829 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-197.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:03.440983 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-197.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.441036 2565 server.go:1268] "Started kubelet" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:03.441135 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.441140 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.441187 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.441216 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.442606 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 13 07:12:03.881045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.443943 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:03.445707 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:03.446300 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-197.ec2.internal.18c1c7e740071bc1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-197.ec2.internal,UID:ip-10-0-141-197.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-197.ec2.internal,},FirstTimestamp:2026-07-13 07:12:03.441007553 +0000 UTC m=+0.363259722,LastTimestamp:2026-07-13 07:12:03.441007553 +0000 UTC m=+0.363259722,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-197.ec2.internal,}" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.449342 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.449527 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:03.449679 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-197.ec2.internal\" not found" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.449834 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7vzkq" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.450149 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.450162 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.450302 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.450330 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.450352 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.451059 2565 factory.go:153] Registering CRI-O factory Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.451076 2565 factory.go:223] Registration of the crio container factory successfully Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.451130 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.451148 2565 factory.go:55] Registering systemd factory Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.451156 2565 factory.go:223] Registration of the systemd container factory successfully Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.451179 2565 factory.go:103] Registering Raw factory Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.451195 2565 manager.go:1196] Started watching for new ooms in manager Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.451904 2565 manager.go:349] Starting recovery of all containers Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:03.452563 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.457635 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7vzkq" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.464129 2565 manager.go:354] Recovery completed Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.468750 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.470786 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientMemory" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.470819 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.470833 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientPID" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.471482 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.471489 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.471494 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.471515 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.472243 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientMemory" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.472267 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.472280 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientPID" Jul 13 07:12:03.882787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.472937 2565 policy_none.go:49] "None policy: Start" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.472950 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:03.472957 2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-197.ec2.internal\" not found" node="ip-10-0-141-197.ec2.internal" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.472960 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.474124 2565 policy_none.go:47] "Start" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.514180 2565 manager.go:337] "Starting Device Plugin manager" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:03.514362 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.514376 2565 server.go:87] "Starting device plugin registration server" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.514691 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.514709 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.514795 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.514869 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.514878 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:03.515473 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:03.515517 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-197.ec2.internal\" not found" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.616803 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.618058 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientMemory" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.618088 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.618100 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientPID" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.618128 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-197.ec2.internal" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.626471 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-197.ec2.internal" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:03.626494 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-197.ec2.internal\": node \"ip-10-0-141-197.ec2.internal\" not found" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.631749 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.633165 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.633201 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.633223 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:03.633256 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.636829 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:03.649369 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-197.ec2.internal\" not found" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.739000 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal"] Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.739106 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.740885 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientMemory" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.740920 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.740936 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientPID" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.742589 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.742699 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.742751 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 07:12:03.883873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.743336 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientMemory" Jul 13 07:12:03.884991 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.743358 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 07:12:03.884991 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.743371 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientPID" Jul 13 07:12:03.884991 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.743377 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientMemory" Jul 13 07:12:03.884991 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.743406 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 07:12:03.884991 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.743419 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientPID" Jul 13 07:12:03.884991 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.744785 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal" Jul 13 07:12:03.884991 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.744809 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 13 07:12:03.884991 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.745553 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientMemory" Jul 13 07:12:03.884991 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.745579 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasNoDiskPressure" Jul 13 07:12:03.884991 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.745597 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeHasSufficientPID" Jul 13 07:12:03.884991 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:03.749574 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-197.ec2.internal\" not found" Jul 13 07:12:03.884991 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.751762 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2bb34bbdde37be762e22d213be20c7bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal\" (UID: \"2bb34bbdde37be762e22d213be20c7bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" Jul 13 07:12:03.884991 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.751782 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bb34bbdde37be762e22d213be20c7bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal\" (UID: \"2bb34bbdde37be762e22d213be20c7bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" Jul 13 07:12:03.884991 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.751807 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c6527244e4faae6846389be1f06153b7-config\") pod \"kube-apiserver-proxy-ip-10-0-141-197.ec2.internal\" (UID: \"c6527244e4faae6846389be1f06153b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal" Jul 13 07:12:03.884991 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:03.777324 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-197.ec2.internal\" not found" node="ip-10-0-141-197.ec2.internal" Jul 13 07:12:03.884991 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:03.782208 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-197.ec2.internal\" not found" node="ip-10-0-141-197.ec2.internal" Jul 13 07:12:03.884991 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:03.850120 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-197.ec2.internal\" not found" Jul 13 07:12:03.884991 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.851892 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2bb34bbdde37be762e22d213be20c7bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal\" (UID: \"2bb34bbdde37be762e22d213be20c7bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" Jul 13 07:12:03.884991 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.851918 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bb34bbdde37be762e22d213be20c7bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal\" (UID: \"2bb34bbdde37be762e22d213be20c7bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" Jul 13 07:12:03.884991 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.851939 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c6527244e4faae6846389be1f06153b7-config\") pod \"kube-apiserver-proxy-ip-10-0-141-197.ec2.internal\" (UID: \"c6527244e4faae6846389be1f06153b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal" Jul 13 07:12:03.884991 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.851965 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2bb34bbdde37be762e22d213be20c7bb-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal\" (UID: \"2bb34bbdde37be762e22d213be20c7bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" Jul 13 07:12:03.885661 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.851979 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c6527244e4faae6846389be1f06153b7-config\") pod \"kube-apiserver-proxy-ip-10-0-141-197.ec2.internal\" (UID: \"c6527244e4faae6846389be1f06153b7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal" Jul 13 07:12:03.885661 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:03.852039 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2bb34bbdde37be762e22d213be20c7bb-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal\" (UID: \"2bb34bbdde37be762e22d213be20c7bb\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" Jul 13 07:12:04.131253 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:03.950461 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-197.ec2.internal\" not found" Jul 13 07:12:04.131253 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:04.053936 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-197.ec2.internal\" not found" Jul 13 07:12:04.131253 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:04.081169 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" Jul 13 07:12:04.131253 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:04.085454 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal" Jul 13 07:12:04.336670 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:04.154585 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-197.ec2.internal\" not found" Jul 13 07:12:04.336670 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:04.257252 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-197.ec2.internal\" not found" Jul 13 07:12:04.589906 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:04.357580 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-197.ec2.internal\" not found" Jul 13 07:12:04.589906 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:04.384855 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 13 07:12:04.589906 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:04.385032 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 13 07:12:04.589906 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:04.457724 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-197.ec2.internal\" not found" Jul 13 07:12:04.589906 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:04.461911 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-12 07:07:04 +0000 UTC" deadline="2028-03-02 00:43:52.985929185 +0000 UTC" Jul 13 07:12:04.589906 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:04.461935 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14345h31m48.523996757s" Jul 13 07:12:04.589906 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:04.515292 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 07:12:04.589906 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:04.550681 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" Jul 13 07:12:04.589906 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:04.563408 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 07:12:04.589906 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:04.565428 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal" Jul 13 07:12:04.589906 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:04.577067 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 13 07:12:04.833128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:04.682806 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bb34bbdde37be762e22d213be20c7bb.slice/crio-ced0a273a2c29a1d3c8556953fcf6b09b4ac9da79d3f61422236fcd42cc70748 WatchSource:0}: Error finding container ced0a273a2c29a1d3c8556953fcf6b09b4ac9da79d3f61422236fcd42cc70748: Status 404 returned error can't find the container with id ced0a273a2c29a1d3c8556953fcf6b09b4ac9da79d3f61422236fcd42cc70748 Jul 13 07:12:04.833128 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:04.687893 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 07:12:04.833128 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:04.689027 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 07:12:04.833128 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:04.803478 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 07:12:04.833128 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:04.831412 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6527244e4faae6846389be1f06153b7.slice/crio-8436f8d03d2657d470b3bbb56a81d0285e1f23ddbc7eea0f30b17b540f2da7cb WatchSource:0}: Error finding container 8436f8d03d2657d470b3bbb56a81d0285e1f23ddbc7eea0f30b17b540f2da7cb: Status 404 returned error can't find the container with id 8436f8d03d2657d470b3bbb56a81d0285e1f23ddbc7eea0f30b17b540f2da7cb Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.432008 2565 apiserver.go:52] "Watching apiserver" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.460289 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.464578 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.465019 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal","openshift-cluster-node-tuning-operator/tuned-8wdtx","openshift-image-registry/node-ca-bqlnb","openshift-multus/multus-g8tq6","openshift-multus/network-metrics-daemon-nj87l","openshift-network-diagnostics/network-check-target-4t5nc","openshift-network-operator/iptables-alerter-sw8p8","openshift-ovn-kubernetes/ovnkube-node-fq6rx","kube-system/global-pull-secret-syncer-jhvbm","kube-system/konnectivity-agent-b5lgv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4","openshift-dns/node-resolver-q9787","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal","openshift-multus/multus-additional-cni-plugins-hhkjr"] Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.466859 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sw8p8" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.468654 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.469780 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wwjwx\"" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.470170 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.470495 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.470699 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bqlnb" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.470786 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.471141 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.471262 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.471314 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2dvmw\"" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.471572 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.472390 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.474085 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.474287 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.474458 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.474627 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6qh8s\"" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.474778 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:05.474827 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj87l" podUID="1bdf96df-7918-4178-a8d0-04488841c04c" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.482648 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:05.482729 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4t5nc" podUID="b71e8d09-c0ee-4f33-a269-9c70833e43d4" Jul 13 07:12:05.509576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.483480 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.483830 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.484265 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.484484 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-b77bd\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.484752 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.484797 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:05.484829 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhvbm" podUID="d3595a67-9572-42c0-a4f2-8ef34b5ab1e1" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.486549 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.488301 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.489681 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.490244 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b5lgv" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.491481 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.491505 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.491695 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wvzbt\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.492036 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.492210 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.492310 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.493527 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nhb79\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.493820 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q9787" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.495709 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.496747 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.496965 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.497111 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.497149 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.497436 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.498172 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8j845\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.498223 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.498248 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cvtq7\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.498251 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.498311 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zfml9\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.498171 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 13 07:12:05.512414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.498616 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 13 07:12:05.605075 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.543823 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-km8ns" Jul 13 07:12:05.605075 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.553825 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 13 07:12:05.605075 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.564461 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj9cc\" (UniqueName: \"kubernetes.io/projected/832cceee-0a43-4624-a02d-eeb70022d09c-kube-api-access-tj9cc\") pod \"aws-ebs-csi-driver-node-qn5f4\" (UID: \"832cceee-0a43-4624-a02d-eeb70022d09c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.605075 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.564490 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-host-run-netns\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.605075 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.564513 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-host-var-lib-cni-bin\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.605075 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.564538 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmbns\" (UniqueName: \"kubernetes.io/projected/b406c045-33a5-4746-813c-bd867ef08fd6-kube-api-access-lmbns\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.605075 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.564565 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-lib-modules\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.605075 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.564589 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-run-systemd\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.605075 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.564624 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c57f984-083f-4a77-ae2a-234f3d84bee2-ovn-node-metrics-cert\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.605075 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.564639 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs\") pod \"network-metrics-daemon-nj87l\" (UID: \"1bdf96df-7918-4178-a8d0-04488841c04c\") " pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:05.605075 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.564700 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdk9z\" (UniqueName: \"kubernetes.io/projected/1bdf96df-7918-4178-a8d0-04488841c04c-kube-api-access-mdk9z\") pod \"network-metrics-daemon-nj87l\" (UID: \"1bdf96df-7918-4178-a8d0-04488841c04c\") " pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:05.605075 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.564737 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-multus-conf-dir\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.605075 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.564764 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-sys\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.605075 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.564794 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-host-kubelet\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.605075 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.564820 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-kubelet-config\") pod \"global-pull-secret-syncer-jhvbm\" (UID: \"d3595a67-9572-42c0-a4f2-8ef34b5ab1e1\") " pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:05.606910 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.564845 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qmnt\" (UniqueName: \"kubernetes.io/projected/4900d593-e893-4320-8eaf-b3d326987b17-kube-api-access-4qmnt\") pod \"node-ca-bqlnb\" (UID: \"4900d593-e893-4320-8eaf-b3d326987b17\") " pod="openshift-image-registry/node-ca-bqlnb" Jul 13 07:12:05.606910 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.564871 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-run-openvswitch\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.606910 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.564907 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-dbus\") pod \"global-pull-secret-syncer-jhvbm\" (UID: \"d3595a67-9572-42c0-a4f2-8ef34b5ab1e1\") " pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:05.606910 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.564932 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24f469df-890b-4f58-a8ff-5c75cbfb1442-cni-binary-copy\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.606910 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.564968 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck26x\" (UniqueName: \"kubernetes.io/projected/fb41cbdc-4be4-4e54-9c8d-fad3734be1af-kube-api-access-ck26x\") pod \"node-resolver-q9787\" (UID: \"fb41cbdc-4be4-4e54-9c8d-fad3734be1af\") " pod="openshift-dns/node-resolver-q9787" Jul 13 07:12:05.606910 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.564991 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/832cceee-0a43-4624-a02d-eeb70022d09c-etc-selinux\") pod \"aws-ebs-csi-driver-node-qn5f4\" (UID: \"832cceee-0a43-4624-a02d-eeb70022d09c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.606910 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565017 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-system-cni-dir\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.606910 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565041 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-cnibin\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.606910 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565063 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-multus-socket-dir-parent\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.606910 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565068 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-km8ns" Jul 13 07:12:05.606910 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565093 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/24f469df-890b-4f58-a8ff-5c75cbfb1442-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.606910 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565130 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/832cceee-0a43-4624-a02d-eeb70022d09c-registration-dir\") pod \"aws-ebs-csi-driver-node-qn5f4\" (UID: \"832cceee-0a43-4624-a02d-eeb70022d09c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.606910 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565158 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b406c045-33a5-4746-813c-bd867ef08fd6-cni-binary-copy\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.606910 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565185 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-host-run-k8s-cni-cncf-io\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.610755 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565212 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-etc-systemd\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.610755 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565256 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f68c6447-7ee4-4fee-893f-d91af0fbac42-tmp\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.610755 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565298 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-host-cni-netd\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.610755 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565315 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-etc-sysctl-conf\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.610755 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565345 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44262e0d-e49f-4ba4-ab5a-616e586539a7-host-slash\") pod \"iptables-alerter-sw8p8\" (UID: \"44262e0d-e49f-4ba4-ab5a-616e586539a7\") " pod="openshift-network-operator/iptables-alerter-sw8p8" Jul 13 07:12:05.610755 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565369 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-252ng\" (UniqueName: \"kubernetes.io/projected/24f469df-890b-4f58-a8ff-5c75cbfb1442-kube-api-access-252ng\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.610755 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565393 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4900d593-e893-4320-8eaf-b3d326987b17-host\") pod \"node-ca-bqlnb\" (UID: \"4900d593-e893-4320-8eaf-b3d326987b17\") " pod="openshift-image-registry/node-ca-bqlnb" Jul 13 07:12:05.610755 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565414 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-etc-modprobe-d\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.610755 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565431 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-etc-kubernetes\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.610755 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565451 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-systemd-units\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.610755 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565474 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2c57f984-083f-4a77-ae2a-234f3d84bee2-ovnkube-script-lib\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.610755 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565503 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24f469df-890b-4f58-a8ff-5c75cbfb1442-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.610755 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565521 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4900d593-e893-4320-8eaf-b3d326987b17-serviceca\") pod \"node-ca-bqlnb\" (UID: \"4900d593-e893-4320-8eaf-b3d326987b17\") " pod="openshift-image-registry/node-ca-bqlnb" Jul 13 07:12:05.610755 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565535 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-etc-sysconfig\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.611695 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565554 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-var-lib-kubelet\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.611695 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565587 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3709e359-4669-4da2-b46d-3ccf1049dc47-agent-certs\") pod \"konnectivity-agent-b5lgv\" (UID: \"3709e359-4669-4da2-b46d-3ccf1049dc47\") " pod="kube-system/konnectivity-agent-b5lgv" Jul 13 07:12:05.611695 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565631 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.611695 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565659 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2c57f984-083f-4a77-ae2a-234f3d84bee2-env-overrides\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.611695 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565714 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret\") pod \"global-pull-secret-syncer-jhvbm\" (UID: \"d3595a67-9572-42c0-a4f2-8ef34b5ab1e1\") " pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:05.611695 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565752 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f68c6447-7ee4-4fee-893f-d91af0fbac42-etc-tuned\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.611695 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565779 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2c57f984-083f-4a77-ae2a-234f3d84bee2-ovnkube-config\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.611695 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565797 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb41cbdc-4be4-4e54-9c8d-fad3734be1af-tmp-dir\") pod \"node-resolver-q9787\" (UID: \"fb41cbdc-4be4-4e54-9c8d-fad3734be1af\") " pod="openshift-dns/node-resolver-q9787" Jul 13 07:12:05.611695 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565833 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/832cceee-0a43-4624-a02d-eeb70022d09c-sys-fs\") pod \"aws-ebs-csi-driver-node-qn5f4\" (UID: \"832cceee-0a43-4624-a02d-eeb70022d09c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.611695 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565861 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-host-run-multus-certs\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.611695 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565886 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-etc-openvswitch\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.611695 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565909 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-os-release\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.611695 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565933 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-hostroot\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.611695 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565960 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b406c045-33a5-4746-813c-bd867ef08fd6-multus-daemon-config\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.612549 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.565982 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22qj5\" (UniqueName: \"kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5\") pod \"network-check-target-4t5nc\" (UID: \"b71e8d09-c0ee-4f33-a269-9c70833e43d4\") " pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:05.612549 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.566031 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-846sb\" (UniqueName: \"kubernetes.io/projected/f68c6447-7ee4-4fee-893f-d91af0fbac42-kube-api-access-846sb\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.612549 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.566080 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3709e359-4669-4da2-b46d-3ccf1049dc47-konnectivity-ca\") pod \"konnectivity-agent-b5lgv\" (UID: \"3709e359-4669-4da2-b46d-3ccf1049dc47\") " pod="kube-system/konnectivity-agent-b5lgv" Jul 13 07:12:05.612549 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.566100 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-host-slash\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.612549 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.566115 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-var-lib-openvswitch\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.612549 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.566152 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-host-run-ovn-kubernetes\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.612549 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.566179 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh2dg\" (UniqueName: \"kubernetes.io/projected/44262e0d-e49f-4ba4-ab5a-616e586539a7-kube-api-access-gh2dg\") pod \"iptables-alerter-sw8p8\" (UID: \"44262e0d-e49f-4ba4-ab5a-616e586539a7\") " pod="openshift-network-operator/iptables-alerter-sw8p8" Jul 13 07:12:05.612549 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.566211 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-etc-sysctl-d\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.612549 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.566242 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-run\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.612549 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.566279 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-host\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.612549 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.566303 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-host-run-netns\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.612549 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.566366 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-log-socket\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.612549 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.566392 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/832cceee-0a43-4624-a02d-eeb70022d09c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qn5f4\" (UID: \"832cceee-0a43-4624-a02d-eeb70022d09c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.612549 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.566422 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-multus-cni-dir\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.615771 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.567260 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-host-var-lib-cni-multus\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.615771 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.567318 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-run-ovn\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.615771 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.567369 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-node-log\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.615771 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.567411 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-host-cni-bin\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.615771 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.567444 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24f469df-890b-4f58-a8ff-5c75cbfb1442-os-release\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.615771 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.567489 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/24f469df-890b-4f58-a8ff-5c75cbfb1442-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.615771 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.567522 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fb41cbdc-4be4-4e54-9c8d-fad3734be1af-hosts-file\") pod \"node-resolver-q9787\" (UID: \"fb41cbdc-4be4-4e54-9c8d-fad3734be1af\") " pod="openshift-dns/node-resolver-q9787" Jul 13 07:12:05.615771 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.567550 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/832cceee-0a43-4624-a02d-eeb70022d09c-socket-dir\") pod \"aws-ebs-csi-driver-node-qn5f4\" (UID: \"832cceee-0a43-4624-a02d-eeb70022d09c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.615771 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.567578 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-host-var-lib-kubelet\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.615771 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.567651 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv8vs\" (UniqueName: \"kubernetes.io/projected/2c57f984-083f-4a77-ae2a-234f3d84bee2-kube-api-access-kv8vs\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.615771 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.567682 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44262e0d-e49f-4ba4-ab5a-616e586539a7-iptables-alerter-script\") pod \"iptables-alerter-sw8p8\" (UID: \"44262e0d-e49f-4ba4-ab5a-616e586539a7\") " pod="openshift-network-operator/iptables-alerter-sw8p8" Jul 13 07:12:05.615771 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.567736 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-etc-kubernetes\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.615771 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.567765 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24f469df-890b-4f58-a8ff-5c75cbfb1442-system-cni-dir\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.616581 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.567793 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24f469df-890b-4f58-a8ff-5c75cbfb1442-cnibin\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.616581 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.567824 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/832cceee-0a43-4624-a02d-eeb70022d09c-device-dir\") pod \"aws-ebs-csi-driver-node-qn5f4\" (UID: \"832cceee-0a43-4624-a02d-eeb70022d09c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.616581 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.599013 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 13 07:12:05.725742 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.639978 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal" event={"ID":"c6527244e4faae6846389be1f06153b7","Type":"ContainerStarted","Data":"8436f8d03d2657d470b3bbb56a81d0285e1f23ddbc7eea0f30b17b540f2da7cb"} Jul 13 07:12:05.725742 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.649926 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" event={"ID":"2bb34bbdde37be762e22d213be20c7bb","Type":"ContainerStarted","Data":"ced0a273a2c29a1d3c8556953fcf6b09b4ac9da79d3f61422236fcd42cc70748"} Jul 13 07:12:05.725742 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668238 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b406c045-33a5-4746-813c-bd867ef08fd6-cni-binary-copy\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.725742 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668274 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-host-run-k8s-cni-cncf-io\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.725742 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668299 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-etc-systemd\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.725742 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668326 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f68c6447-7ee4-4fee-893f-d91af0fbac42-tmp\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.725742 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668399 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-host-run-k8s-cni-cncf-io\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.725742 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668441 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-etc-systemd\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.725742 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668449 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-host-cni-netd\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.725742 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668491 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-host-cni-netd\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.725742 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668503 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-etc-sysctl-conf\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.725742 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668533 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44262e0d-e49f-4ba4-ab5a-616e586539a7-host-slash\") pod \"iptables-alerter-sw8p8\" (UID: \"44262e0d-e49f-4ba4-ab5a-616e586539a7\") " pod="openshift-network-operator/iptables-alerter-sw8p8" Jul 13 07:12:05.725742 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668559 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-252ng\" (UniqueName: \"kubernetes.io/projected/24f469df-890b-4f58-a8ff-5c75cbfb1442-kube-api-access-252ng\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.725742 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668621 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/44262e0d-e49f-4ba4-ab5a-616e586539a7-host-slash\") pod \"iptables-alerter-sw8p8\" (UID: \"44262e0d-e49f-4ba4-ab5a-616e586539a7\") " pod="openshift-network-operator/iptables-alerter-sw8p8" Jul 13 07:12:05.725742 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668633 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-etc-sysctl-conf\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.835426 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668710 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 13 07:12:05.835426 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668736 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4900d593-e893-4320-8eaf-b3d326987b17-host\") pod \"node-ca-bqlnb\" (UID: \"4900d593-e893-4320-8eaf-b3d326987b17\") " pod="openshift-image-registry/node-ca-bqlnb" Jul 13 07:12:05.835426 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668766 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-etc-modprobe-d\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.835426 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668787 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-etc-kubernetes\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.835426 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668808 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-systemd-units\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.835426 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668829 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2c57f984-083f-4a77-ae2a-234f3d84bee2-ovnkube-script-lib\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.835426 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668840 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4900d593-e893-4320-8eaf-b3d326987b17-host\") pod \"node-ca-bqlnb\" (UID: \"4900d593-e893-4320-8eaf-b3d326987b17\") " pod="openshift-image-registry/node-ca-bqlnb" Jul 13 07:12:05.835426 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668865 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24f469df-890b-4f58-a8ff-5c75cbfb1442-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.835426 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668878 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-etc-kubernetes\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.835426 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668894 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-systemd-units\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.835426 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668901 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-etc-modprobe-d\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.835426 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668940 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4900d593-e893-4320-8eaf-b3d326987b17-serviceca\") pod \"node-ca-bqlnb\" (UID: \"4900d593-e893-4320-8eaf-b3d326987b17\") " pod="openshift-image-registry/node-ca-bqlnb" Jul 13 07:12:05.835426 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668968 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-etc-sysconfig\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.835426 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.668979 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b406c045-33a5-4746-813c-bd867ef08fd6-cni-binary-copy\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.835426 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669015 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-etc-sysconfig\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.838720 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669041 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/24f469df-890b-4f58-a8ff-5c75cbfb1442-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.838720 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669128 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-var-lib-kubelet\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.838720 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669167 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3709e359-4669-4da2-b46d-3ccf1049dc47-agent-certs\") pod \"konnectivity-agent-b5lgv\" (UID: \"3709e359-4669-4da2-b46d-3ccf1049dc47\") " pod="kube-system/konnectivity-agent-b5lgv" Jul 13 07:12:05.838720 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669195 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.838720 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669223 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2c57f984-083f-4a77-ae2a-234f3d84bee2-env-overrides\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.838720 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669232 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-var-lib-kubelet\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.838720 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669251 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret\") pod \"global-pull-secret-syncer-jhvbm\" (UID: \"d3595a67-9572-42c0-a4f2-8ef34b5ab1e1\") " pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:05.838720 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669271 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.838720 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669276 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f68c6447-7ee4-4fee-893f-d91af0fbac42-etc-tuned\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.838720 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669373 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2c57f984-083f-4a77-ae2a-234f3d84bee2-ovnkube-config\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.838720 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669401 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb41cbdc-4be4-4e54-9c8d-fad3734be1af-tmp-dir\") pod \"node-resolver-q9787\" (UID: \"fb41cbdc-4be4-4e54-9c8d-fad3734be1af\") " pod="openshift-dns/node-resolver-q9787" Jul 13 07:12:05.838720 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669426 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/832cceee-0a43-4624-a02d-eeb70022d09c-sys-fs\") pod \"aws-ebs-csi-driver-node-qn5f4\" (UID: \"832cceee-0a43-4624-a02d-eeb70022d09c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.838720 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669451 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-host-run-multus-certs\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.838720 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669481 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-etc-openvswitch\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.839692 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669506 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-os-release\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.839692 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669521 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2c57f984-083f-4a77-ae2a-234f3d84bee2-ovnkube-script-lib\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.839692 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669529 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-hostroot\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.839692 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669545 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4900d593-e893-4320-8eaf-b3d326987b17-serviceca\") pod \"node-ca-bqlnb\" (UID: \"4900d593-e893-4320-8eaf-b3d326987b17\") " pod="openshift-image-registry/node-ca-bqlnb" Jul 13 07:12:05.839692 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669554 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b406c045-33a5-4746-813c-bd867ef08fd6-multus-daemon-config\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.839692 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669579 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22qj5\" (UniqueName: \"kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5\") pod \"network-check-target-4t5nc\" (UID: \"b71e8d09-c0ee-4f33-a269-9c70833e43d4\") " pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:05.839692 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669607 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-846sb\" (UniqueName: \"kubernetes.io/projected/f68c6447-7ee4-4fee-893f-d91af0fbac42-kube-api-access-846sb\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.839692 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669633 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3709e359-4669-4da2-b46d-3ccf1049dc47-konnectivity-ca\") pod \"konnectivity-agent-b5lgv\" (UID: \"3709e359-4669-4da2-b46d-3ccf1049dc47\") " pod="kube-system/konnectivity-agent-b5lgv" Jul 13 07:12:05.839692 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:05.669655 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 07:12:05.839692 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669662 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-host-slash\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.839692 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669673 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-os-release\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.839692 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669691 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-var-lib-openvswitch\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.839692 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669719 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-host-run-ovn-kubernetes\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.839692 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669728 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/832cceee-0a43-4624-a02d-eeb70022d09c-sys-fs\") pod \"aws-ebs-csi-driver-node-qn5f4\" (UID: \"832cceee-0a43-4624-a02d-eeb70022d09c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.841350 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:05.669736 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret podName:d3595a67-9572-42c0-a4f2-8ef34b5ab1e1 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:06.169712636 +0000 UTC m=+3.091964813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret") pod "global-pull-secret-syncer-jhvbm" (UID: "d3595a67-9572-42c0-a4f2-8ef34b5ab1e1") : object "kube-system"/"original-pull-secret" not registered Jul 13 07:12:05.841350 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669766 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-etc-openvswitch\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.841350 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669770 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-host-run-ovn-kubernetes\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.841350 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669776 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fb41cbdc-4be4-4e54-9c8d-fad3734be1af-tmp-dir\") pod \"node-resolver-q9787\" (UID: \"fb41cbdc-4be4-4e54-9c8d-fad3734be1af\") " pod="openshift-dns/node-resolver-q9787" Jul 13 07:12:05.841350 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670123 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-var-lib-openvswitch\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.841350 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670164 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2c57f984-083f-4a77-ae2a-234f3d84bee2-env-overrides\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.841350 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670232 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-host-slash\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.841350 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.669772 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh2dg\" (UniqueName: \"kubernetes.io/projected/44262e0d-e49f-4ba4-ab5a-616e586539a7-kube-api-access-gh2dg\") pod \"iptables-alerter-sw8p8\" (UID: \"44262e0d-e49f-4ba4-ab5a-616e586539a7\") " pod="openshift-network-operator/iptables-alerter-sw8p8" Jul 13 07:12:05.841350 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670275 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-etc-sysctl-d\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.841350 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670285 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-host-run-multus-certs\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.841350 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670293 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2c57f984-083f-4a77-ae2a-234f3d84bee2-ovnkube-config\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.841350 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670301 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-run\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.841350 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670327 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-host\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.841350 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670353 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-host-run-netns\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.842335 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670379 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-log-socket\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.842335 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670429 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/832cceee-0a43-4624-a02d-eeb70022d09c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qn5f4\" (UID: \"832cceee-0a43-4624-a02d-eeb70022d09c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.842335 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670442 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-etc-sysctl-d\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.842335 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670452 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3709e359-4669-4da2-b46d-3ccf1049dc47-konnectivity-ca\") pod \"konnectivity-agent-b5lgv\" (UID: \"3709e359-4669-4da2-b46d-3ccf1049dc47\") " pod="kube-system/konnectivity-agent-b5lgv" Jul 13 07:12:05.842335 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670457 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-multus-cni-dir\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.842335 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670487 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-host-var-lib-cni-multus\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.842335 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670512 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-run-ovn\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.842335 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670536 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-node-log\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.842335 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670561 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-host-cni-bin\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.842335 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670583 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24f469df-890b-4f58-a8ff-5c75cbfb1442-os-release\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.842335 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670601 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/24f469df-890b-4f58-a8ff-5c75cbfb1442-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.842335 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fb41cbdc-4be4-4e54-9c8d-fad3734be1af-hosts-file\") pod \"node-resolver-q9787\" (UID: \"fb41cbdc-4be4-4e54-9c8d-fad3734be1af\") " pod="openshift-dns/node-resolver-q9787" Jul 13 07:12:05.842335 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670632 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-hostroot\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.842335 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670730 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-run\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.842335 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670753 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/832cceee-0a43-4624-a02d-eeb70022d09c-socket-dir\") pod \"aws-ebs-csi-driver-node-qn5f4\" (UID: \"832cceee-0a43-4624-a02d-eeb70022d09c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.843792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670637 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/832cceee-0a43-4624-a02d-eeb70022d09c-socket-dir\") pod \"aws-ebs-csi-driver-node-qn5f4\" (UID: \"832cceee-0a43-4624-a02d-eeb70022d09c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.843792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670768 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-run-ovn\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.843792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670805 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-log-socket\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.843792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670809 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-host-var-lib-kubelet\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.843792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670841 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-host-var-lib-kubelet\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.843792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670846 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv8vs\" (UniqueName: \"kubernetes.io/projected/2c57f984-083f-4a77-ae2a-234f3d84bee2-kube-api-access-kv8vs\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.843792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670759 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-host-var-lib-cni-multus\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.843792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670845 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-host-cni-bin\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.843792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670876 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44262e0d-e49f-4ba4-ab5a-616e586539a7-iptables-alerter-script\") pod \"iptables-alerter-sw8p8\" (UID: \"44262e0d-e49f-4ba4-ab5a-616e586539a7\") " pod="openshift-network-operator/iptables-alerter-sw8p8" Jul 13 07:12:05.843792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670906 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-etc-kubernetes\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.843792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670909 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-host\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.843792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670937 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/24f469df-890b-4f58-a8ff-5c75cbfb1442-os-release\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.843792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670987 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/832cceee-0a43-4624-a02d-eeb70022d09c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qn5f4\" (UID: \"832cceee-0a43-4624-a02d-eeb70022d09c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.843792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670994 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/fb41cbdc-4be4-4e54-9c8d-fad3734be1af-hosts-file\") pod \"node-resolver-q9787\" (UID: \"fb41cbdc-4be4-4e54-9c8d-fad3734be1af\") " pod="openshift-dns/node-resolver-q9787" Jul 13 07:12:05.843792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.670815 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-node-log\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.844879 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671027 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-etc-kubernetes\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.844879 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671140 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-multus-cni-dir\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.844879 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671202 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-host-run-netns\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.844879 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671503 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24f469df-890b-4f58-a8ff-5c75cbfb1442-system-cni-dir\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.844879 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671521 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b406c045-33a5-4746-813c-bd867ef08fd6-multus-daemon-config\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.844879 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671537 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24f469df-890b-4f58-a8ff-5c75cbfb1442-cnibin\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.844879 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671575 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/832cceee-0a43-4624-a02d-eeb70022d09c-device-dir\") pod \"aws-ebs-csi-driver-node-qn5f4\" (UID: \"832cceee-0a43-4624-a02d-eeb70022d09c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.844879 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671580 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/24f469df-890b-4f58-a8ff-5c75cbfb1442-cnibin\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.844879 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671603 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj9cc\" (UniqueName: \"kubernetes.io/projected/832cceee-0a43-4624-a02d-eeb70022d09c-kube-api-access-tj9cc\") pod \"aws-ebs-csi-driver-node-qn5f4\" (UID: \"832cceee-0a43-4624-a02d-eeb70022d09c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.844879 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671608 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/24f469df-890b-4f58-a8ff-5c75cbfb1442-system-cni-dir\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.844879 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671627 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-host-run-netns\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.844879 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671639 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/832cceee-0a43-4624-a02d-eeb70022d09c-device-dir\") pod \"aws-ebs-csi-driver-node-qn5f4\" (UID: \"832cceee-0a43-4624-a02d-eeb70022d09c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.844879 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671650 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-host-var-lib-cni-bin\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.844879 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671674 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmbns\" (UniqueName: \"kubernetes.io/projected/b406c045-33a5-4746-813c-bd867ef08fd6-kube-api-access-lmbns\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.844879 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671679 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-host-run-netns\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.846681 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671702 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-lib-modules\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.846681 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671725 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-run-systemd\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.846681 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671768 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c57f984-083f-4a77-ae2a-234f3d84bee2-ovn-node-metrics-cert\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.846681 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671767 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/44262e0d-e49f-4ba4-ab5a-616e586539a7-iptables-alerter-script\") pod \"iptables-alerter-sw8p8\" (UID: \"44262e0d-e49f-4ba4-ab5a-616e586539a7\") " pod="openshift-network-operator/iptables-alerter-sw8p8" Jul 13 07:12:05.846681 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671792 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs\") pod \"network-metrics-daemon-nj87l\" (UID: \"1bdf96df-7918-4178-a8d0-04488841c04c\") " pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:05.846681 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671820 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdk9z\" (UniqueName: \"kubernetes.io/projected/1bdf96df-7918-4178-a8d0-04488841c04c-kube-api-access-mdk9z\") pod \"network-metrics-daemon-nj87l\" (UID: \"1bdf96df-7918-4178-a8d0-04488841c04c\") " pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:05.846681 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671841 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-host-var-lib-cni-bin\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.846681 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671855 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-multus-conf-dir\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.846681 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671882 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-sys\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.846681 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671916 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-host-kubelet\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.846681 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:05.671930 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:12:05.846681 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671953 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-kubelet-config\") pod \"global-pull-secret-syncer-jhvbm\" (UID: \"d3595a67-9572-42c0-a4f2-8ef34b5ab1e1\") " pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:05.846681 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671931 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-multus-conf-dir\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.846681 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671985 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qmnt\" (UniqueName: \"kubernetes.io/projected/4900d593-e893-4320-8eaf-b3d326987b17-kube-api-access-4qmnt\") pod \"node-ca-bqlnb\" (UID: \"4900d593-e893-4320-8eaf-b3d326987b17\") " pod="openshift-image-registry/node-ca-bqlnb" Jul 13 07:12:05.846681 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671857 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-run-systemd\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.848793 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.672015 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-run-openvswitch\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.848793 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.672044 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-dbus\") pod \"global-pull-secret-syncer-jhvbm\" (UID: \"d3595a67-9572-42c0-a4f2-8ef34b5ab1e1\") " pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:05.848793 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.672055 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-sys\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.848793 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.672088 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24f469df-890b-4f58-a8ff-5c75cbfb1442-cni-binary-copy\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.848793 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.672119 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck26x\" (UniqueName: \"kubernetes.io/projected/fb41cbdc-4be4-4e54-9c8d-fad3734be1af-kube-api-access-ck26x\") pod \"node-resolver-q9787\" (UID: \"fb41cbdc-4be4-4e54-9c8d-fad3734be1af\") " pod="openshift-dns/node-resolver-q9787" Jul 13 07:12:05.848793 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.672133 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-dbus\") pod \"global-pull-secret-syncer-jhvbm\" (UID: \"d3595a67-9572-42c0-a4f2-8ef34b5ab1e1\") " pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:05.848793 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.672147 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/832cceee-0a43-4624-a02d-eeb70022d09c-etc-selinux\") pod \"aws-ebs-csi-driver-node-qn5f4\" (UID: \"832cceee-0a43-4624-a02d-eeb70022d09c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.848793 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:05.672176 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs podName:1bdf96df-7918-4178-a8d0-04488841c04c nodeName:}" failed. No retries permitted until 2026-07-13 07:12:06.172155633 +0000 UTC m=+3.094407797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs") pod "network-metrics-daemon-nj87l" (UID: "1bdf96df-7918-4178-a8d0-04488841c04c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:12:05.848793 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.672223 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/24f469df-890b-4f58-a8ff-5c75cbfb1442-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.848793 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.672235 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-system-cni-dir\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.848793 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.672260 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-cnibin\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.848793 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.672231 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/832cceee-0a43-4624-a02d-eeb70022d09c-etc-selinux\") pod \"aws-ebs-csi-driver-node-qn5f4\" (UID: \"832cceee-0a43-4624-a02d-eeb70022d09c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.848793 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.672274 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-host-kubelet\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.848793 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.672285 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-multus-socket-dir-parent\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.849570 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.671953 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f68c6447-7ee4-4fee-893f-d91af0fbac42-lib-modules\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.849570 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.672336 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-kubelet-config\") pod \"global-pull-secret-syncer-jhvbm\" (UID: \"d3595a67-9572-42c0-a4f2-8ef34b5ab1e1\") " pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:05.849570 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.672352 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-multus-socket-dir-parent\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.849570 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.672412 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-system-cni-dir\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.849570 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.672419 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b406c045-33a5-4746-813c-bd867ef08fd6-cnibin\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.849570 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.672415 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2c57f984-083f-4a77-ae2a-234f3d84bee2-run-openvswitch\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.849570 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.672452 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/24f469df-890b-4f58-a8ff-5c75cbfb1442-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.849570 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.672482 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/832cceee-0a43-4624-a02d-eeb70022d09c-registration-dir\") pod \"aws-ebs-csi-driver-node-qn5f4\" (UID: \"832cceee-0a43-4624-a02d-eeb70022d09c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.849570 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.672567 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/832cceee-0a43-4624-a02d-eeb70022d09c-registration-dir\") pod \"aws-ebs-csi-driver-node-qn5f4\" (UID: \"832cceee-0a43-4624-a02d-eeb70022d09c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.849570 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.673057 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/24f469df-890b-4f58-a8ff-5c75cbfb1442-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.849570 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.673123 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f68c6447-7ee4-4fee-893f-d91af0fbac42-tmp\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.849570 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.673376 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/24f469df-890b-4f58-a8ff-5c75cbfb1442-cni-binary-copy\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.849570 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.673927 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f68c6447-7ee4-4fee-893f-d91af0fbac42-etc-tuned\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.849570 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.674224 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3709e359-4669-4da2-b46d-3ccf1049dc47-agent-certs\") pod \"konnectivity-agent-b5lgv\" (UID: \"3709e359-4669-4da2-b46d-3ccf1049dc47\") " pod="kube-system/konnectivity-agent-b5lgv" Jul 13 07:12:05.849570 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.674668 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c57f984-083f-4a77-ae2a-234f3d84bee2-ovn-node-metrics-cert\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.850308 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:05.681741 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 07:12:05.850308 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:05.681769 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 07:12:05.850308 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:05.681784 2565 projected.go:196] Error preparing data for projected volume kube-api-access-22qj5 for pod openshift-network-diagnostics/network-check-target-4t5nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:12:05.850308 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:05.681862 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5 podName:b71e8d09-c0ee-4f33-a269-9c70833e43d4 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:06.181842718 +0000 UTC m=+3.104094872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-22qj5" (UniqueName: "kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5") pod "network-check-target-4t5nc" (UID: "b71e8d09-c0ee-4f33-a269-9c70833e43d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:12:05.850308 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.682684 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh2dg\" (UniqueName: \"kubernetes.io/projected/44262e0d-e49f-4ba4-ab5a-616e586539a7-kube-api-access-gh2dg\") pod \"iptables-alerter-sw8p8\" (UID: \"44262e0d-e49f-4ba4-ab5a-616e586539a7\") " pod="openshift-network-operator/iptables-alerter-sw8p8" Jul 13 07:12:05.850308 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.682817 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-252ng\" (UniqueName: \"kubernetes.io/projected/24f469df-890b-4f58-a8ff-5c75cbfb1442-kube-api-access-252ng\") pod \"multus-additional-cni-plugins-hhkjr\" (UID: \"24f469df-890b-4f58-a8ff-5c75cbfb1442\") " pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.850308 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.683466 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj9cc\" (UniqueName: \"kubernetes.io/projected/832cceee-0a43-4624-a02d-eeb70022d09c-kube-api-access-tj9cc\") pod \"aws-ebs-csi-driver-node-qn5f4\" (UID: \"832cceee-0a43-4624-a02d-eeb70022d09c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.850308 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.685614 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-846sb\" (UniqueName: \"kubernetes.io/projected/f68c6447-7ee4-4fee-893f-d91af0fbac42-kube-api-access-846sb\") pod \"tuned-8wdtx\" (UID: \"f68c6447-7ee4-4fee-893f-d91af0fbac42\") " pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.850308 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.685906 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv8vs\" (UniqueName: \"kubernetes.io/projected/2c57f984-083f-4a77-ae2a-234f3d84bee2-kube-api-access-kv8vs\") pod \"ovnkube-node-fq6rx\" (UID: \"2c57f984-083f-4a77-ae2a-234f3d84bee2\") " pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.850308 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.686070 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qmnt\" (UniqueName: \"kubernetes.io/projected/4900d593-e893-4320-8eaf-b3d326987b17-kube-api-access-4qmnt\") pod \"node-ca-bqlnb\" (UID: \"4900d593-e893-4320-8eaf-b3d326987b17\") " pod="openshift-image-registry/node-ca-bqlnb" Jul 13 07:12:05.850308 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.686522 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdk9z\" (UniqueName: \"kubernetes.io/projected/1bdf96df-7918-4178-a8d0-04488841c04c-kube-api-access-mdk9z\") pod \"network-metrics-daemon-nj87l\" (UID: \"1bdf96df-7918-4178-a8d0-04488841c04c\") " pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:05.850308 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.686717 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck26x\" (UniqueName: \"kubernetes.io/projected/fb41cbdc-4be4-4e54-9c8d-fad3734be1af-kube-api-access-ck26x\") pod \"node-resolver-q9787\" (UID: \"fb41cbdc-4be4-4e54-9c8d-fad3734be1af\") " pod="openshift-dns/node-resolver-q9787" Jul 13 07:12:05.850308 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.686867 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmbns\" (UniqueName: \"kubernetes.io/projected/b406c045-33a5-4746-813c-bd867ef08fd6-kube-api-access-lmbns\") pod \"multus-g8tq6\" (UID: \"b406c045-33a5-4746-813c-bd867ef08fd6\") " pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.850308 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.788397 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sw8p8" Jul 13 07:12:05.850308 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.798522 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" Jul 13 07:12:05.851168 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:05.800735 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44262e0d_e49f_4ba4_ab5a_616e586539a7.slice/crio-0462fcf60dbcd49b97e53215eb09e54a8cc69c53b6a8399d852e5d35716fbcc9 WatchSource:0}: Error finding container 0462fcf60dbcd49b97e53215eb09e54a8cc69c53b6a8399d852e5d35716fbcc9: Status 404 returned error can't find the container with id 0462fcf60dbcd49b97e53215eb09e54a8cc69c53b6a8399d852e5d35716fbcc9 Jul 13 07:12:05.851168 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.807548 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bqlnb" Jul 13 07:12:05.851168 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:05.808515 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod832cceee_0a43_4624_a02d_eeb70022d09c.slice/crio-7c41e4ac4df191ebe082459c1c6662febcf4048bab8c912bed007dcbbfacaeb0 WatchSource:0}: Error finding container 7c41e4ac4df191ebe082459c1c6662febcf4048bab8c912bed007dcbbfacaeb0: Status 404 returned error can't find the container with id 7c41e4ac4df191ebe082459c1c6662febcf4048bab8c912bed007dcbbfacaeb0 Jul 13 07:12:05.851168 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.814729 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g8tq6" Jul 13 07:12:05.851168 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:05.816362 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4900d593_e893_4320_8eaf_b3d326987b17.slice/crio-215e4c669a47316cddc37c41ac8d56eb1c546e0202a194dfd78661f31690fd80 WatchSource:0}: Error finding container 215e4c669a47316cddc37c41ac8d56eb1c546e0202a194dfd78661f31690fd80: Status 404 returned error can't find the container with id 215e4c669a47316cddc37c41ac8d56eb1c546e0202a194dfd78661f31690fd80 Jul 13 07:12:05.851168 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.822593 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hhkjr" Jul 13 07:12:05.851168 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:05.824347 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb406c045_33a5_4746_813c_bd867ef08fd6.slice/crio-19508fde08c8848c86c2ea70a4697f0a926b671e55b49c093f4ef60b3b5cf499 WatchSource:0}: Error finding container 19508fde08c8848c86c2ea70a4697f0a926b671e55b49c093f4ef60b3b5cf499: Status 404 returned error can't find the container with id 19508fde08c8848c86c2ea70a4697f0a926b671e55b49c093f4ef60b3b5cf499 Jul 13 07:12:05.851168 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.832102 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" Jul 13 07:12:05.851168 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:05.841550 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf68c6447_7ee4_4fee_893f_d91af0fbac42.slice/crio-1b1eae3a06df004afcbcec67831e31d66f1a53552f3270d52744967cef3e5ed1 WatchSource:0}: Error finding container 1b1eae3a06df004afcbcec67831e31d66f1a53552f3270d52744967cef3e5ed1: Status 404 returned error can't find the container with id 1b1eae3a06df004afcbcec67831e31d66f1a53552f3270d52744967cef3e5ed1 Jul 13 07:12:05.851168 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.847103 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b5lgv" Jul 13 07:12:05.858146 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.857521 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:05.864738 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:05.864711 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q9787" Jul 13 07:12:05.868303 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:05.868271 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c57f984_083f_4a77_ae2a_234f3d84bee2.slice/crio-8ec7a2f0b39ce87dacda2a11ae90285314218bf5cf1a14d420e158aadaa6049b WatchSource:0}: Error finding container 8ec7a2f0b39ce87dacda2a11ae90285314218bf5cf1a14d420e158aadaa6049b: Status 404 returned error can't find the container with id 8ec7a2f0b39ce87dacda2a11ae90285314218bf5cf1a14d420e158aadaa6049b Jul 13 07:12:05.876444 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:05.876410 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb41cbdc_4be4_4e54_9c8d_fad3734be1af.slice/crio-fd4092280b9d08fc3d1dc02d3dc8c86b10bce4cd89c130a77c7b69ddc8bbf2ce WatchSource:0}: Error finding container fd4092280b9d08fc3d1dc02d3dc8c86b10bce4cd89c130a77c7b69ddc8bbf2ce: Status 404 returned error can't find the container with id fd4092280b9d08fc3d1dc02d3dc8c86b10bce4cd89c130a77c7b69ddc8bbf2ce Jul 13 07:12:06.177799 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:06.177681 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs\") pod \"network-metrics-daemon-nj87l\" (UID: \"1bdf96df-7918-4178-a8d0-04488841c04c\") " pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:06.177799 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:06.177772 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret\") pod \"global-pull-secret-syncer-jhvbm\" (UID: \"d3595a67-9572-42c0-a4f2-8ef34b5ab1e1\") " pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:06.178045 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:06.177901 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 07:12:06.178045 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:06.177904 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:12:06.178045 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:06.177972 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret podName:d3595a67-9572-42c0-a4f2-8ef34b5ab1e1 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:07.177952332 +0000 UTC m=+4.100204510 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret") pod "global-pull-secret-syncer-jhvbm" (UID: "d3595a67-9572-42c0-a4f2-8ef34b5ab1e1") : object "kube-system"/"original-pull-secret" not registered Jul 13 07:12:06.178045 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:06.177995 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs podName:1bdf96df-7918-4178-a8d0-04488841c04c nodeName:}" failed. No retries permitted until 2026-07-13 07:12:07.177983855 +0000 UTC m=+4.100236025 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs") pod "network-metrics-daemon-nj87l" (UID: "1bdf96df-7918-4178-a8d0-04488841c04c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:12:06.278484 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:06.278445 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22qj5\" (UniqueName: \"kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5\") pod \"network-check-target-4t5nc\" (UID: \"b71e8d09-c0ee-4f33-a269-9c70833e43d4\") " pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:06.278693 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:06.278664 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 07:12:06.278762 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:06.278698 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 07:12:06.278762 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:06.278714 2565 projected.go:196] Error preparing data for projected volume kube-api-access-22qj5 for pod openshift-network-diagnostics/network-check-target-4t5nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:12:06.278864 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:06.278792 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5 podName:b71e8d09-c0ee-4f33-a269-9c70833e43d4 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:07.278767798 +0000 UTC m=+4.201019953 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-22qj5" (UniqueName: "kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5") pod "network-check-target-4t5nc" (UID: "b71e8d09-c0ee-4f33-a269-9c70833e43d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:12:06.568430 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:06.568306 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 07:07:06 +0000 UTC" deadline="2028-02-29 18:38:13.25790073 +0000 UTC" Jul 13 07:12:06.568430 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:06.568368 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14315h26m6.689537577s" Jul 13 07:12:06.634170 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:06.634139 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:06.634782 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:06.634314 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj87l" podUID="1bdf96df-7918-4178-a8d0-04488841c04c" Jul 13 07:12:06.653199 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:06.653160 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b5lgv" event={"ID":"3709e359-4669-4da2-b46d-3ccf1049dc47","Type":"ContainerStarted","Data":"7cc4ec428eae272c2f0ccd6ad91c653b597c097251ee057c21fe38ab4fa9bb9b"} Jul 13 07:12:06.654612 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:06.654576 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" event={"ID":"f68c6447-7ee4-4fee-893f-d91af0fbac42","Type":"ContainerStarted","Data":"1b1eae3a06df004afcbcec67831e31d66f1a53552f3270d52744967cef3e5ed1"} Jul 13 07:12:06.655847 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:06.655823 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g8tq6" event={"ID":"b406c045-33a5-4746-813c-bd867ef08fd6","Type":"ContainerStarted","Data":"19508fde08c8848c86c2ea70a4697f0a926b671e55b49c093f4ef60b3b5cf499"} Jul 13 07:12:06.657211 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:06.657178 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" event={"ID":"832cceee-0a43-4624-a02d-eeb70022d09c","Type":"ContainerStarted","Data":"7c41e4ac4df191ebe082459c1c6662febcf4048bab8c912bed007dcbbfacaeb0"} Jul 13 07:12:06.658475 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:06.658446 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q9787" event={"ID":"fb41cbdc-4be4-4e54-9c8d-fad3734be1af","Type":"ContainerStarted","Data":"fd4092280b9d08fc3d1dc02d3dc8c86b10bce4cd89c130a77c7b69ddc8bbf2ce"} Jul 13 07:12:06.659871 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:06.659846 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" event={"ID":"2c57f984-083f-4a77-ae2a-234f3d84bee2","Type":"ContainerStarted","Data":"8ec7a2f0b39ce87dacda2a11ae90285314218bf5cf1a14d420e158aadaa6049b"} Jul 13 07:12:06.661156 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:06.661129 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhkjr" event={"ID":"24f469df-890b-4f58-a8ff-5c75cbfb1442","Type":"ContainerStarted","Data":"1ffc313f059e1d83af014902a8b210d7cd47ae2b2547ef19eee6fd4514018aa9"} Jul 13 07:12:06.662508 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:06.662481 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bqlnb" event={"ID":"4900d593-e893-4320-8eaf-b3d326987b17","Type":"ContainerStarted","Data":"215e4c669a47316cddc37c41ac8d56eb1c546e0202a194dfd78661f31690fd80"} Jul 13 07:12:06.663954 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:06.663923 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sw8p8" event={"ID":"44262e0d-e49f-4ba4-ab5a-616e586539a7","Type":"ContainerStarted","Data":"0462fcf60dbcd49b97e53215eb09e54a8cc69c53b6a8399d852e5d35716fbcc9"} Jul 13 07:12:07.187897 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:07.187843 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs\") pod \"network-metrics-daemon-nj87l\" (UID: \"1bdf96df-7918-4178-a8d0-04488841c04c\") " pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:07.188097 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:07.187924 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret\") pod \"global-pull-secret-syncer-jhvbm\" (UID: \"d3595a67-9572-42c0-a4f2-8ef34b5ab1e1\") " pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:07.188097 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:07.188059 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 07:12:07.188294 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:07.188126 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret podName:d3595a67-9572-42c0-a4f2-8ef34b5ab1e1 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:09.188106242 +0000 UTC m=+6.110358409 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret") pod "global-pull-secret-syncer-jhvbm" (UID: "d3595a67-9572-42c0-a4f2-8ef34b5ab1e1") : object "kube-system"/"original-pull-secret" not registered Jul 13 07:12:07.188651 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:07.188624 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:12:07.188777 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:07.188693 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs podName:1bdf96df-7918-4178-a8d0-04488841c04c nodeName:}" failed. No retries permitted until 2026-07-13 07:12:09.188672931 +0000 UTC m=+6.110925084 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs") pod "network-metrics-daemon-nj87l" (UID: "1bdf96df-7918-4178-a8d0-04488841c04c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:12:07.289850 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:07.288749 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22qj5\" (UniqueName: \"kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5\") pod \"network-check-target-4t5nc\" (UID: \"b71e8d09-c0ee-4f33-a269-9c70833e43d4\") " pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:07.289850 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:07.288885 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 07:12:07.289850 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:07.288900 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 07:12:07.289850 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:07.288909 2565 projected.go:196] Error preparing data for projected volume kube-api-access-22qj5 for pod openshift-network-diagnostics/network-check-target-4t5nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:12:07.289850 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:07.288960 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5 podName:b71e8d09-c0ee-4f33-a269-9c70833e43d4 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:09.288945573 +0000 UTC m=+6.211197725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-22qj5" (UniqueName: "kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5") pod "network-check-target-4t5nc" (UID: "b71e8d09-c0ee-4f33-a269-9c70833e43d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:12:07.569340 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:07.569192 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-12 07:07:06 +0000 UTC" deadline="2028-03-17 23:50:05.768456954 +0000 UTC" Jul 13 07:12:07.569340 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:07.569259 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14728h37m58.199202651s" Jul 13 07:12:07.641065 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:07.641032 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:07.641558 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:07.641161 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4t5nc" podUID="b71e8d09-c0ee-4f33-a269-9c70833e43d4" Jul 13 07:12:07.641648 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:07.641628 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:07.641755 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:07.641734 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhvbm" podUID="d3595a67-9572-42c0-a4f2-8ef34b5ab1e1" Jul 13 07:12:08.634222 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:08.633885 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:08.634442 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:08.634292 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj87l" podUID="1bdf96df-7918-4178-a8d0-04488841c04c" Jul 13 07:12:08.685050 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:08.684983 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal" event={"ID":"c6527244e4faae6846389be1f06153b7","Type":"ContainerStarted","Data":"1f9cb001af54fbe4177bcbbc4896b1ba38ebc42ce42b1fd32a168a32a2893a13"} Jul 13 07:12:08.695765 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:08.695682 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" event={"ID":"2bb34bbdde37be762e22d213be20c7bb","Type":"ContainerStarted","Data":"ae1b9a29bd8e7ced2400c7ca919eba2581a477669d993b09b3f893a169e67317"} Jul 13 07:12:08.723264 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:08.723195 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-197.ec2.internal" podStartSLOduration=3.723169442 podStartE2EDuration="3.723169442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:08.703371518 +0000 UTC m=+5.625623697" watchObservedRunningTime="2026-07-13 07:12:08.723169442 +0000 UTC m=+5.645421656" Jul 13 07:12:09.206025 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:09.205935 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs\") pod \"network-metrics-daemon-nj87l\" (UID: \"1bdf96df-7918-4178-a8d0-04488841c04c\") " pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:09.206506 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:09.206113 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret\") pod \"global-pull-secret-syncer-jhvbm\" (UID: \"d3595a67-9572-42c0-a4f2-8ef34b5ab1e1\") " pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:09.206506 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:09.206435 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 07:12:09.206751 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:09.206590 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret podName:d3595a67-9572-42c0-a4f2-8ef34b5ab1e1 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:13.206542545 +0000 UTC m=+10.128794706 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret") pod "global-pull-secret-syncer-jhvbm" (UID: "d3595a67-9572-42c0-a4f2-8ef34b5ab1e1") : object "kube-system"/"original-pull-secret" not registered Jul 13 07:12:09.207756 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:09.207491 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:12:09.207756 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:09.207624 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs podName:1bdf96df-7918-4178-a8d0-04488841c04c nodeName:}" failed. No retries permitted until 2026-07-13 07:12:13.207589764 +0000 UTC m=+10.129841916 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs") pod "network-metrics-daemon-nj87l" (UID: "1bdf96df-7918-4178-a8d0-04488841c04c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:12:09.308664 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:09.306987 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22qj5\" (UniqueName: \"kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5\") pod \"network-check-target-4t5nc\" (UID: \"b71e8d09-c0ee-4f33-a269-9c70833e43d4\") " pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:09.308664 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:09.307606 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 07:12:09.308664 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:09.307659 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 07:12:09.308664 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:09.307689 2565 projected.go:196] Error preparing data for projected volume kube-api-access-22qj5 for pod openshift-network-diagnostics/network-check-target-4t5nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:12:09.308664 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:09.307821 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5 podName:b71e8d09-c0ee-4f33-a269-9c70833e43d4 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:13.307785577 +0000 UTC m=+10.230037757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-22qj5" (UniqueName: "kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5") pod "network-check-target-4t5nc" (UID: "b71e8d09-c0ee-4f33-a269-9c70833e43d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:12:09.640426 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:09.639600 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:09.640426 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:09.639737 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4t5nc" podUID="b71e8d09-c0ee-4f33-a269-9c70833e43d4" Jul 13 07:12:09.640426 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:09.640135 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:09.640426 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:09.640235 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhvbm" podUID="d3595a67-9572-42c0-a4f2-8ef34b5ab1e1" Jul 13 07:12:10.633986 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:10.633945 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:10.634521 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:10.634109 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj87l" podUID="1bdf96df-7918-4178-a8d0-04488841c04c" Jul 13 07:12:11.634880 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:11.634116 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:11.634880 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:11.634271 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhvbm" podUID="d3595a67-9572-42c0-a4f2-8ef34b5ab1e1" Jul 13 07:12:11.634880 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:11.634116 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:11.634880 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:11.634769 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4t5nc" podUID="b71e8d09-c0ee-4f33-a269-9c70833e43d4" Jul 13 07:12:12.634094 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:12.633527 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:12.634094 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:12.633689 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj87l" podUID="1bdf96df-7918-4178-a8d0-04488841c04c" Jul 13 07:12:13.241134 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:13.241091 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret\") pod \"global-pull-secret-syncer-jhvbm\" (UID: \"d3595a67-9572-42c0-a4f2-8ef34b5ab1e1\") " pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:13.241682 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:13.241189 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs\") pod \"network-metrics-daemon-nj87l\" (UID: \"1bdf96df-7918-4178-a8d0-04488841c04c\") " pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:13.241682 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:13.241437 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 07:12:13.241682 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:13.241515 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret podName:d3595a67-9572-42c0-a4f2-8ef34b5ab1e1 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:21.241494441 +0000 UTC m=+18.163746599 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret") pod "global-pull-secret-syncer-jhvbm" (UID: "d3595a67-9572-42c0-a4f2-8ef34b5ab1e1") : object "kube-system"/"original-pull-secret" not registered Jul 13 07:12:13.241902 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:13.241885 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:12:13.241965 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:13.241951 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs podName:1bdf96df-7918-4178-a8d0-04488841c04c nodeName:}" failed. No retries permitted until 2026-07-13 07:12:21.241931968 +0000 UTC m=+18.164184129 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs") pod "network-metrics-daemon-nj87l" (UID: "1bdf96df-7918-4178-a8d0-04488841c04c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:12:13.343106 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:13.342390 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22qj5\" (UniqueName: \"kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5\") pod \"network-check-target-4t5nc\" (UID: \"b71e8d09-c0ee-4f33-a269-9c70833e43d4\") " pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:13.343106 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:13.342592 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 07:12:13.343106 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:13.342614 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 07:12:13.343106 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:13.342629 2565 projected.go:196] Error preparing data for projected volume kube-api-access-22qj5 for pod openshift-network-diagnostics/network-check-target-4t5nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:12:13.343106 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:13.342698 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5 podName:b71e8d09-c0ee-4f33-a269-9c70833e43d4 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:21.342676061 +0000 UTC m=+18.264928217 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-22qj5" (UniqueName: "kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5") pod "network-check-target-4t5nc" (UID: "b71e8d09-c0ee-4f33-a269-9c70833e43d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:12:13.634776 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:13.634684 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:13.634952 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:13.634816 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhvbm" podUID="d3595a67-9572-42c0-a4f2-8ef34b5ab1e1" Jul 13 07:12:13.635229 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:13.635209 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:13.635331 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:13.635314 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4t5nc" podUID="b71e8d09-c0ee-4f33-a269-9c70833e43d4" Jul 13 07:12:14.633806 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:14.633524 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:14.633806 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:14.633694 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj87l" podUID="1bdf96df-7918-4178-a8d0-04488841c04c" Jul 13 07:12:15.634365 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:15.634327 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:15.634822 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:15.634470 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhvbm" podUID="d3595a67-9572-42c0-a4f2-8ef34b5ab1e1" Jul 13 07:12:15.634981 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:15.634961 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:15.635115 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:15.635067 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4t5nc" podUID="b71e8d09-c0ee-4f33-a269-9c70833e43d4" Jul 13 07:12:15.716541 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:15.716503 2565 generic.go:356] "Generic (PLEG): container finished" podID="2bb34bbdde37be762e22d213be20c7bb" containerID="ae1b9a29bd8e7ced2400c7ca919eba2581a477669d993b09b3f893a169e67317" exitCode=0 Jul 13 07:12:15.716708 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:15.716562 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" event={"ID":"2bb34bbdde37be762e22d213be20c7bb","Type":"ContainerDied","Data":"ae1b9a29bd8e7ced2400c7ca919eba2581a477669d993b09b3f893a169e67317"} Jul 13 07:12:16.634521 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:16.634438 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:16.635332 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:16.634726 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj87l" podUID="1bdf96df-7918-4178-a8d0-04488841c04c" Jul 13 07:12:17.634306 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:17.634270 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:17.634497 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:17.634331 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:17.634497 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:17.634411 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhvbm" podUID="d3595a67-9572-42c0-a4f2-8ef34b5ab1e1" Jul 13 07:12:17.634630 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:17.634517 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4t5nc" podUID="b71e8d09-c0ee-4f33-a269-9c70833e43d4" Jul 13 07:12:18.634286 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:18.634256 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:18.634469 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:18.634395 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj87l" podUID="1bdf96df-7918-4178-a8d0-04488841c04c" Jul 13 07:12:19.634086 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:19.634048 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:19.634565 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:19.634048 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:19.634565 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:19.634194 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4t5nc" podUID="b71e8d09-c0ee-4f33-a269-9c70833e43d4" Jul 13 07:12:19.634565 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:19.634283 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhvbm" podUID="d3595a67-9572-42c0-a4f2-8ef34b5ab1e1" Jul 13 07:12:20.633631 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:20.633593 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:20.633877 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:20.633731 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj87l" podUID="1bdf96df-7918-4178-a8d0-04488841c04c" Jul 13 07:12:21.309626 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:21.309585 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs\") pod \"network-metrics-daemon-nj87l\" (UID: \"1bdf96df-7918-4178-a8d0-04488841c04c\") " pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:21.310150 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:21.309658 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret\") pod \"global-pull-secret-syncer-jhvbm\" (UID: \"d3595a67-9572-42c0-a4f2-8ef34b5ab1e1\") " pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:21.310150 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:21.309777 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 07:12:21.310150 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:21.309858 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret podName:d3595a67-9572-42c0-a4f2-8ef34b5ab1e1 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:37.309841881 +0000 UTC m=+34.232094049 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret") pod "global-pull-secret-syncer-jhvbm" (UID: "d3595a67-9572-42c0-a4f2-8ef34b5ab1e1") : object "kube-system"/"original-pull-secret" not registered Jul 13 07:12:21.310150 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:21.309778 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:12:21.310150 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:21.309960 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs podName:1bdf96df-7918-4178-a8d0-04488841c04c nodeName:}" failed. No retries permitted until 2026-07-13 07:12:37.309938434 +0000 UTC m=+34.232190599 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs") pod "network-metrics-daemon-nj87l" (UID: "1bdf96df-7918-4178-a8d0-04488841c04c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:12:21.410459 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:21.410427 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22qj5\" (UniqueName: \"kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5\") pod \"network-check-target-4t5nc\" (UID: \"b71e8d09-c0ee-4f33-a269-9c70833e43d4\") " pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:21.410611 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:21.410591 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 07:12:21.410647 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:21.410616 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 07:12:21.410647 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:21.410625 2565 projected.go:196] Error preparing data for projected volume kube-api-access-22qj5 for pod openshift-network-diagnostics/network-check-target-4t5nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:12:21.410726 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:21.410687 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5 podName:b71e8d09-c0ee-4f33-a269-9c70833e43d4 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:37.410670091 +0000 UTC m=+34.332922245 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-22qj5" (UniqueName: "kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5") pod "network-check-target-4t5nc" (UID: "b71e8d09-c0ee-4f33-a269-9c70833e43d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:12:21.633697 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:21.633672 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:21.633796 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:21.633679 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:21.633845 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:21.633792 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4t5nc" podUID="b71e8d09-c0ee-4f33-a269-9c70833e43d4" Jul 13 07:12:21.637041 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:21.634233 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhvbm" podUID="d3595a67-9572-42c0-a4f2-8ef34b5ab1e1" Jul 13 07:12:22.634500 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:22.634461 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:22.635020 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:22.634620 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj87l" podUID="1bdf96df-7918-4178-a8d0-04488841c04c" Jul 13 07:12:23.634978 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:23.634944 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:23.635423 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:23.635065 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhvbm" podUID="d3595a67-9572-42c0-a4f2-8ef34b5ab1e1" Jul 13 07:12:23.635423 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:23.635113 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:23.635423 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:23.635222 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4t5nc" podUID="b71e8d09-c0ee-4f33-a269-9c70833e43d4" Jul 13 07:12:24.634017 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:24.633973 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:24.634201 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:24.634126 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj87l" podUID="1bdf96df-7918-4178-a8d0-04488841c04c" Jul 13 07:12:25.633602 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:25.633566 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:25.634065 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:25.633687 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:25.634065 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:25.633747 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4t5nc" podUID="b71e8d09-c0ee-4f33-a269-9c70833e43d4" Jul 13 07:12:25.634065 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:25.633747 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhvbm" podUID="d3595a67-9572-42c0-a4f2-8ef34b5ab1e1" Jul 13 07:12:26.634492 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.634172 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:26.635250 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:26.634587 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj87l" podUID="1bdf96df-7918-4178-a8d0-04488841c04c" Jul 13 07:12:26.739930 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.739892 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" event={"ID":"832cceee-0a43-4624-a02d-eeb70022d09c","Type":"ContainerStarted","Data":"185caebd0cf45f1fc9ef2eeb286063bbac9d6ebb15ce8bde02f03fdc164285e2"} Jul 13 07:12:26.741786 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.741756 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q9787" event={"ID":"fb41cbdc-4be4-4e54-9c8d-fad3734be1af","Type":"ContainerStarted","Data":"170566263db887f614fba86f1c6e2ac657323028b8f9b5f9b6254853dd22cd38"} Jul 13 07:12:26.745216 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.745181 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" event={"ID":"2c57f984-083f-4a77-ae2a-234f3d84bee2","Type":"ContainerStarted","Data":"67f9bfda0cef9915d391608e45466af7f4c14056f3551ba59c27dc50f0eb1231"} Jul 13 07:12:26.745384 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.745265 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" event={"ID":"2c57f984-083f-4a77-ae2a-234f3d84bee2","Type":"ContainerStarted","Data":"d2558a3cc7d2edb15d6aa2c23cd9d6a04b9c41ccc104b3a818b8482af74f61e2"} Jul 13 07:12:26.745384 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.745331 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" event={"ID":"2c57f984-083f-4a77-ae2a-234f3d84bee2","Type":"ContainerStarted","Data":"2a086456a93d5230351b66327f7c425596e29ffba3cf04d5ff189c9bcf190826"} Jul 13 07:12:26.745384 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.745363 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" event={"ID":"2c57f984-083f-4a77-ae2a-234f3d84bee2","Type":"ContainerStarted","Data":"9bb7ff3364d0bdfd7a7f66a5807db9ff0be15c9f5089528555ab1b3d615006ce"} Jul 13 07:12:26.745579 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.745406 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" event={"ID":"2c57f984-083f-4a77-ae2a-234f3d84bee2","Type":"ContainerStarted","Data":"e7cce4e55155a3d63d59bd10c40517d4830b31e7a58e61689324285b129c36f4"} Jul 13 07:12:26.745579 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.745443 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" event={"ID":"2c57f984-083f-4a77-ae2a-234f3d84bee2","Type":"ContainerStarted","Data":"0c8ac202261d1d955a089e24a3368ccc6d5ba239866f82d249c98e30e8936bbc"} Jul 13 07:12:26.746858 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.746829 2565 generic.go:356] "Generic (PLEG): container finished" podID="24f469df-890b-4f58-a8ff-5c75cbfb1442" containerID="e3d9d7573587f1476f968cdf9959ac2cb45cc29f085fa7305c3262ef0179c0cc" exitCode=0 Jul 13 07:12:26.747012 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.746924 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhkjr" event={"ID":"24f469df-890b-4f58-a8ff-5c75cbfb1442","Type":"ContainerDied","Data":"e3d9d7573587f1476f968cdf9959ac2cb45cc29f085fa7305c3262ef0179c0cc"} Jul 13 07:12:26.749291 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.748763 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bqlnb" event={"ID":"4900d593-e893-4320-8eaf-b3d326987b17","Type":"ContainerStarted","Data":"ba642e4f9bc9a36e2b9b8e959d187e9758a4d9133e728bd785a37049ff9a7f6a"} Jul 13 07:12:26.750889 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.750856 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" event={"ID":"2bb34bbdde37be762e22d213be20c7bb","Type":"ContainerStarted","Data":"51e2a630c347d91ce5697b4fc4e7842fe240679a77fca0726fd413e33ca466a3"} Jul 13 07:12:26.752366 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.752342 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b5lgv" event={"ID":"3709e359-4669-4da2-b46d-3ccf1049dc47","Type":"ContainerStarted","Data":"3caa5067a99346e27f2b7df5564b1597bfa47a46b18446dfca9ba7fe84ddeaf0"} Jul 13 07:12:26.753891 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.753872 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" event={"ID":"f68c6447-7ee4-4fee-893f-d91af0fbac42","Type":"ContainerStarted","Data":"e43fa00e211823a0d9056f16205650eb13e7b1650d2aa4fa62b5c95cde0d5db3"} Jul 13 07:12:26.755503 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.755481 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g8tq6" event={"ID":"b406c045-33a5-4746-813c-bd867ef08fd6","Type":"ContainerStarted","Data":"bebcb64090551f34e4bae1e18479a7ceec030b1a33c8cd7eec11b7b7e49cdf16"} Jul 13 07:12:26.760498 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.760448 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q9787" podStartSLOduration=2.8228431179999998 podStartE2EDuration="22.760431742s" totalImagesPullingTime="19.937588624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:26.759596276 +0000 UTC m=+23.681848445" watchObservedRunningTime="2026-07-13 07:12:26.760431742 +0000 UTC m=+23.682683918" Jul 13 07:12:26.775761 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.775706 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-197.ec2.internal" podStartSLOduration=21.775685735 podStartE2EDuration="21.775685735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:26.775020015 +0000 UTC m=+23.697272188" watchObservedRunningTime="2026-07-13 07:12:26.775685735 +0000 UTC m=+23.697937910" Jul 13 07:12:26.789672 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.789619 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bqlnb" podStartSLOduration=2.712640494 podStartE2EDuration="22.789603285s" totalImagesPullingTime="20.076962791s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:26.789565291 +0000 UTC m=+23.711817464" watchObservedRunningTime="2026-07-13 07:12:26.789603285 +0000 UTC m=+23.711855458" Jul 13 07:12:26.838245 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.838190 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g8tq6" podStartSLOduration=2.483352903 podStartE2EDuration="22.838172132s" totalImagesPullingTime="20.354819229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:26.837859056 +0000 UTC m=+23.760111229" watchObservedRunningTime="2026-07-13 07:12:26.838172132 +0000 UTC m=+23.760424306" Jul 13 07:12:26.855469 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.855422 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8wdtx" podStartSLOduration=2.787966447 podStartE2EDuration="22.855406001s" totalImagesPullingTime="20.067439554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:26.855173181 +0000 UTC m=+23.777425354" watchObservedRunningTime="2026-07-13 07:12:26.855406001 +0000 UTC m=+23.777658207" Jul 13 07:12:26.979614 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:26.979582 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:27.059767 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:27.059720 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:27.317301 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:27.317264 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 13 07:12:27.528058 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:27.527965 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-13T07:12:27.317296009Z","UUID":"87b9e33e-eea4-46eb-9371-88845918afc8","Handler":null,"Name":"","Endpoint":""} Jul 13 07:12:27.530564 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:27.530353 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 13 07:12:27.530564 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:27.530411 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 13 07:12:27.633991 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:27.633955 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:27.634191 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:27.634170 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:27.634261 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:27.634166 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhvbm" podUID="d3595a67-9572-42c0-a4f2-8ef34b5ab1e1" Jul 13 07:12:27.634335 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:27.634293 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4t5nc" podUID="b71e8d09-c0ee-4f33-a269-9c70833e43d4" Jul 13 07:12:27.760146 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:27.760109 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sw8p8" event={"ID":"44262e0d-e49f-4ba4-ab5a-616e586539a7","Type":"ContainerStarted","Data":"a1c3bf24edc2a2d06b1b72af2c4f0f88116896c46ce6ca4d6abf9bc4fdf31f70"} Jul 13 07:12:27.762234 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:27.762195 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" event={"ID":"832cceee-0a43-4624-a02d-eeb70022d09c","Type":"ContainerStarted","Data":"5a62459398e7eec77974de060056ac65de31ba759d2f0a4f5c20649bc0798268"} Jul 13 07:12:27.776394 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:27.776349 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sw8p8" podStartSLOduration=3.684091165 podStartE2EDuration="23.776333243s" totalImagesPullingTime="20.092242078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:27.775882647 +0000 UTC m=+24.698134821" watchObservedRunningTime="2026-07-13 07:12:27.776333243 +0000 UTC m=+24.698585410" Jul 13 07:12:27.776569 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:27.776551 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-b5lgv" podStartSLOduration=11.940852665 podStartE2EDuration="23.776546398s" totalImagesPullingTime="11.835693733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:26.877344878 +0000 UTC m=+23.799597047" watchObservedRunningTime="2026-07-13 07:12:27.776546398 +0000 UTC m=+24.698798571" Jul 13 07:12:27.905817 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:27.905724 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:28.010180 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:28.010134 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:28.633654 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:28.633627 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:28.633824 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:28.633769 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj87l" podUID="1bdf96df-7918-4178-a8d0-04488841c04c" Jul 13 07:12:28.766306 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:28.766276 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" event={"ID":"832cceee-0a43-4624-a02d-eeb70022d09c","Type":"ContainerStarted","Data":"f28a22ee1131e16fdd3d1f0f57dff24fe7d58f7c880f6cc005cb843afedfbf4c"} Jul 13 07:12:28.770153 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:28.770124 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" event={"ID":"2c57f984-083f-4a77-ae2a-234f3d84bee2","Type":"ContainerStarted","Data":"48a7f251cf7d92d942a4831b440143a9bbeb19b9865d160847e1197a4623b31c"} Jul 13 07:12:28.784292 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:28.784232 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qn5f4" podStartSLOduration=2.41723317 podStartE2EDuration="24.784209654s" totalImagesPullingTime="22.366976484s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:28.78346061 +0000 UTC m=+25.705712784" watchObservedRunningTime="2026-07-13 07:12:28.784209654 +0000 UTC m=+25.706461829" Jul 13 07:12:29.633982 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:29.633948 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:29.634241 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:29.633948 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:29.634241 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:29.634061 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4t5nc" podUID="b71e8d09-c0ee-4f33-a269-9c70833e43d4" Jul 13 07:12:29.634241 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:29.634120 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhvbm" podUID="d3595a67-9572-42c0-a4f2-8ef34b5ab1e1" Jul 13 07:12:30.633731 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:30.633543 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:30.634132 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:30.633809 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj87l" podUID="1bdf96df-7918-4178-a8d0-04488841c04c" Jul 13 07:12:30.652347 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:30.652294 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:30.705925 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:30.705885 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:31.209097 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:31.209061 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-b5lgv" Jul 13 07:12:31.209721 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:31.209695 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-b5lgv" Jul 13 07:12:31.634400 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:31.634163 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:31.635028 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:31.634222 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:31.635028 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:31.634523 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhvbm" podUID="d3595a67-9572-42c0-a4f2-8ef34b5ab1e1" Jul 13 07:12:31.635028 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:31.634574 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4t5nc" podUID="b71e8d09-c0ee-4f33-a269-9c70833e43d4" Jul 13 07:12:31.780825 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:31.780791 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" event={"ID":"2c57f984-083f-4a77-ae2a-234f3d84bee2","Type":"ContainerStarted","Data":"f3d6de375c1dc606efb69486d7dae0f25e1d16ddaff9dfd67508402470cd5b0b"} Jul 13 07:12:31.781029 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:31.781010 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:31.782927 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:31.782894 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhkjr" event={"ID":"24f469df-890b-4f58-a8ff-5c75cbfb1442","Type":"ContainerStarted","Data":"1b60214ac7290de09a7b38d01d4d879fd2b7481e87eeee570762ad402d071603"} Jul 13 07:12:31.783211 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:31.783191 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-b5lgv" Jul 13 07:12:31.783628 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:31.783613 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-b5lgv" Jul 13 07:12:31.796106 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:31.796083 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:31.829421 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:31.829372 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" podStartSLOduration=7.73104705 podStartE2EDuration="27.829356167s" totalImagesPullingTime="20.098309117s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:31.829015505 +0000 UTC m=+28.751267678" watchObservedRunningTime="2026-07-13 07:12:31.829356167 +0000 UTC m=+28.751608339" Jul 13 07:12:31.835702 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:31.835677 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:31.894204 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:31.894157 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:31.959424 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:31.959387 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:32.565668 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:32.565637 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:32.634012 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:32.633979 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:32.634167 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:32.634102 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj87l" podUID="1bdf96df-7918-4178-a8d0-04488841c04c" Jul 13 07:12:32.667118 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:32.667073 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:32.787113 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:32.787079 2565 generic.go:356] "Generic (PLEG): container finished" podID="24f469df-890b-4f58-a8ff-5c75cbfb1442" containerID="1b60214ac7290de09a7b38d01d4d879fd2b7481e87eeee570762ad402d071603" exitCode=0 Jul 13 07:12:32.787331 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:32.787165 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhkjr" event={"ID":"24f469df-890b-4f58-a8ff-5c75cbfb1442","Type":"ContainerDied","Data":"1b60214ac7290de09a7b38d01d4d879fd2b7481e87eeee570762ad402d071603"} Jul 13 07:12:32.787701 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:32.787667 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:32.787792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:32.787730 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:32.802559 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:32.802539 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:12:33.242879 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:33.242849 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:33.321871 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:33.321838 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:33.423232 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:33.423162 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:33.523164 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:33.523082 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:33.622793 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:33.622764 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:33.634713 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:33.634682 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:33.634865 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:33.634775 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4t5nc" podUID="b71e8d09-c0ee-4f33-a269-9c70833e43d4" Jul 13 07:12:33.634865 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:33.634819 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:33.634943 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:33.634919 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhvbm" podUID="d3595a67-9572-42c0-a4f2-8ef34b5ab1e1" Jul 13 07:12:33.640804 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:33.640774 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nj87l"] Jul 13 07:12:33.640928 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:33.640898 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:33.641038 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:33.641016 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj87l" podUID="1bdf96df-7918-4178-a8d0-04488841c04c" Jul 13 07:12:33.641579 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:33.641556 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4t5nc"] Jul 13 07:12:33.644517 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:33.644492 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jhvbm"] Jul 13 07:12:33.792040 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:33.792015 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:33.792371 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:33.792055 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhkjr" event={"ID":"24f469df-890b-4f58-a8ff-5c75cbfb1442","Type":"ContainerStarted","Data":"2f151c4a255e78467df3e32b57b55e4ad24044186e71865a015f228a278c83dc"} Jul 13 07:12:33.792371 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:33.792239 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhvbm" podUID="d3595a67-9572-42c0-a4f2-8ef34b5ab1e1" Jul 13 07:12:33.792556 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:33.792540 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:33.792650 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:33.792630 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4t5nc" podUID="b71e8d09-c0ee-4f33-a269-9c70833e43d4" Jul 13 07:12:34.797127 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:34.796880 2565 generic.go:356] "Generic (PLEG): container finished" podID="24f469df-890b-4f58-a8ff-5c75cbfb1442" containerID="2f151c4a255e78467df3e32b57b55e4ad24044186e71865a015f228a278c83dc" exitCode=0 Jul 13 07:12:34.797127 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:34.796951 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhkjr" event={"ID":"24f469df-890b-4f58-a8ff-5c75cbfb1442","Type":"ContainerDied","Data":"2f151c4a255e78467df3e32b57b55e4ad24044186e71865a015f228a278c83dc"} Jul 13 07:12:35.633937 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:35.633748 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:35.633937 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:35.633748 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:35.633937 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:35.633748 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:35.634370 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:35.633977 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj87l" podUID="1bdf96df-7918-4178-a8d0-04488841c04c" Jul 13 07:12:35.634370 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:35.634112 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhvbm" podUID="d3595a67-9572-42c0-a4f2-8ef34b5ab1e1" Jul 13 07:12:35.634370 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:35.634241 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4t5nc" podUID="b71e8d09-c0ee-4f33-a269-9c70833e43d4" Jul 13 07:12:36.802754 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:36.802721 2565 generic.go:356] "Generic (PLEG): container finished" podID="24f469df-890b-4f58-a8ff-5c75cbfb1442" containerID="9877db5a9e1d72edc7e936092c05204123fe4ef11f161ec73783ac9f66dada8f" exitCode=0 Jul 13 07:12:36.803155 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:36.802785 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhkjr" event={"ID":"24f469df-890b-4f58-a8ff-5c75cbfb1442","Type":"ContainerDied","Data":"9877db5a9e1d72edc7e936092c05204123fe4ef11f161ec73783ac9f66dada8f"} Jul 13 07:12:37.327290 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:37.327258 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret\") pod \"global-pull-secret-syncer-jhvbm\" (UID: \"d3595a67-9572-42c0-a4f2-8ef34b5ab1e1\") " pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:37.327465 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:37.327344 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs\") pod \"network-metrics-daemon-nj87l\" (UID: \"1bdf96df-7918-4178-a8d0-04488841c04c\") " pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:37.327465 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:37.327407 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 13 07:12:37.327465 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:37.327437 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:12:37.327622 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:37.327469 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret podName:d3595a67-9572-42c0-a4f2-8ef34b5ab1e1 nodeName:}" failed. No retries permitted until 2026-07-13 07:13:09.327451615 +0000 UTC m=+66.249703770 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret") pod "global-pull-secret-syncer-jhvbm" (UID: "d3595a67-9572-42c0-a4f2-8ef34b5ab1e1") : object "kube-system"/"original-pull-secret" not registered Jul 13 07:12:37.327622 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:37.327488 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs podName:1bdf96df-7918-4178-a8d0-04488841c04c nodeName:}" failed. No retries permitted until 2026-07-13 07:13:09.327479576 +0000 UTC m=+66.249731727 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs") pod "network-metrics-daemon-nj87l" (UID: "1bdf96df-7918-4178-a8d0-04488841c04c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 13 07:12:37.428159 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:37.428127 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22qj5\" (UniqueName: \"kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5\") pod \"network-check-target-4t5nc\" (UID: \"b71e8d09-c0ee-4f33-a269-9c70833e43d4\") " pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:37.428304 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:37.428287 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 13 07:12:37.428377 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:37.428326 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 13 07:12:37.428377 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:37.428339 2565 projected.go:196] Error preparing data for projected volume kube-api-access-22qj5 for pod openshift-network-diagnostics/network-check-target-4t5nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:12:37.428460 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:37.428402 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5 podName:b71e8d09-c0ee-4f33-a269-9c70833e43d4 nodeName:}" failed. No retries permitted until 2026-07-13 07:13:09.428385938 +0000 UTC m=+66.350638094 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-22qj5" (UniqueName: "kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5") pod "network-check-target-4t5nc" (UID: "b71e8d09-c0ee-4f33-a269-9c70833e43d4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 13 07:12:37.633671 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:37.633598 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:37.633815 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:37.633597 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:37.633815 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:37.633716 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nj87l" podUID="1bdf96df-7918-4178-a8d0-04488841c04c" Jul 13 07:12:37.633926 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:37.633820 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4t5nc" podUID="b71e8d09-c0ee-4f33-a269-9c70833e43d4" Jul 13 07:12:37.633926 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:37.633864 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:37.634014 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:37.633925 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jhvbm" podUID="d3595a67-9572-42c0-a4f2-8ef34b5ab1e1" Jul 13 07:12:38.349104 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.349070 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:38.413747 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.413690 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:38.515860 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.515817 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:38.856816 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.856787 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-197.ec2.internal" event="NodeReady" Jul 13 07:12:38.856962 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.856917 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 13 07:12:38.906010 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.905942 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-66d7c494cd-rsrkn"] Jul 13 07:12:38.907903 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.907880 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:38.910419 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.910397 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 13 07:12:38.910557 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.910489 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 13 07:12:38.911198 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.910965 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 13 07:12:38.911198 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.911052 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-b6hvc\"" Jul 13 07:12:38.917079 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.917060 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 13 07:12:38.917372 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.917346 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sgkm7"] Jul 13 07:12:38.919149 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.919129 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ttnn7"] Jul 13 07:12:38.919264 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.919244 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sgkm7" Jul 13 07:12:38.920939 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.920918 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ttnn7" Jul 13 07:12:38.921371 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.921345 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66d7c494cd-rsrkn"] Jul 13 07:12:38.923295 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.923149 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 13 07:12:38.923730 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.923548 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 13 07:12:38.923730 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.923609 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xj5f5\"" Jul 13 07:12:38.923730 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.923621 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 13 07:12:38.923918 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.923811 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x4nqx\"" Jul 13 07:12:38.923971 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.923945 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 13 07:12:38.924107 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.924086 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 13 07:12:38.932327 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.932291 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ttnn7"] Jul 13 07:12:38.932708 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:38.932686 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sgkm7"] Jul 13 07:12:39.039029 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.039001 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-config-volume\") pod \"dns-default-sgkm7\" (UID: \"c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8\") " pod="openshift-dns/dns-default-sgkm7" Jul 13 07:12:39.039144 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.039045 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhwxf\" (UniqueName: \"kubernetes.io/projected/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-kube-api-access-rhwxf\") pod \"dns-default-sgkm7\" (UID: \"c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8\") " pod="openshift-dns/dns-default-sgkm7" Jul 13 07:12:39.039144 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.039082 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-tls\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.039144 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.039112 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-metrics-tls\") pod \"dns-default-sgkm7\" (UID: \"c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8\") " pod="openshift-dns/dns-default-sgkm7" Jul 13 07:12:39.039144 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.039128 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-tmp-dir\") pod \"dns-default-sgkm7\" (UID: \"c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8\") " pod="openshift-dns/dns-default-sgkm7" Jul 13 07:12:39.039144 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.039142 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-certificates\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.039394 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.039203 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-ca-trust-extracted\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.039394 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.039230 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-trusted-ca\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.039394 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.039264 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-installation-pull-secrets\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.039394 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.039286 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-bound-sa-token\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.039394 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.039301 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psgpv\" (UniqueName: \"kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-kube-api-access-psgpv\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.039394 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.039364 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a3d4b3e-f6ad-444b-b69d-c5602afb93fe-cert\") pod \"ingress-canary-ttnn7\" (UID: \"6a3d4b3e-f6ad-444b-b69d-c5602afb93fe\") " pod="openshift-ingress-canary/ingress-canary-ttnn7" Jul 13 07:12:39.039394 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.039390 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9wt8\" (UniqueName: \"kubernetes.io/projected/6a3d4b3e-f6ad-444b-b69d-c5602afb93fe-kube-api-access-f9wt8\") pod \"ingress-canary-ttnn7\" (UID: \"6a3d4b3e-f6ad-444b-b69d-c5602afb93fe\") " pod="openshift-ingress-canary/ingress-canary-ttnn7" Jul 13 07:12:39.039707 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.039410 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-image-registry-private-configuration\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.045000 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.044971 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:39.140231 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.140206 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9wt8\" (UniqueName: \"kubernetes.io/projected/6a3d4b3e-f6ad-444b-b69d-c5602afb93fe-kube-api-access-f9wt8\") pod \"ingress-canary-ttnn7\" (UID: \"6a3d4b3e-f6ad-444b-b69d-c5602afb93fe\") " pod="openshift-ingress-canary/ingress-canary-ttnn7" Jul 13 07:12:39.141509 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.140244 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-image-registry-private-configuration\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.141509 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.140265 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-config-volume\") pod \"dns-default-sgkm7\" (UID: \"c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8\") " pod="openshift-dns/dns-default-sgkm7" Jul 13 07:12:39.141509 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.140290 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhwxf\" (UniqueName: \"kubernetes.io/projected/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-kube-api-access-rhwxf\") pod \"dns-default-sgkm7\" (UID: \"c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8\") " pod="openshift-dns/dns-default-sgkm7" Jul 13 07:12:39.141509 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.140332 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-tls\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.141509 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.140375 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-metrics-tls\") pod \"dns-default-sgkm7\" (UID: \"c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8\") " pod="openshift-dns/dns-default-sgkm7" Jul 13 07:12:39.141509 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.140432 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-tmp-dir\") pod \"dns-default-sgkm7\" (UID: \"c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8\") " pod="openshift-dns/dns-default-sgkm7" Jul 13 07:12:39.141509 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.140463 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-certificates\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.141509 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.140505 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-ca-trust-extracted\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.141509 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.140530 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-trusted-ca\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.141509 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.140567 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-installation-pull-secrets\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.141509 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.140595 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-bound-sa-token\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.141509 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:39.140615 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 07:12:39.141509 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.140622 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psgpv\" (UniqueName: \"kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-kube-api-access-psgpv\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.141509 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:39.140633 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66d7c494cd-rsrkn: secret "image-registry-tls" not found Jul 13 07:12:39.141509 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:39.140681 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 07:12:39.142175 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:39.140710 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-tls podName:ef6a14c6-4fc4-4e28-8727-5541519dcd4e nodeName:}" failed. No retries permitted until 2026-07-13 07:12:39.640687318 +0000 UTC m=+36.562939485 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-tls") pod "image-registry-66d7c494cd-rsrkn" (UID: "ef6a14c6-4fc4-4e28-8727-5541519dcd4e") : secret "image-registry-tls" not found Jul 13 07:12:39.142175 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:39.140739 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-metrics-tls podName:c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:39.640721736 +0000 UTC m=+36.562973894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-metrics-tls") pod "dns-default-sgkm7" (UID: "c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8") : secret "dns-default-metrics-tls" not found Jul 13 07:12:39.142175 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.140679 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a3d4b3e-f6ad-444b-b69d-c5602afb93fe-cert\") pod \"ingress-canary-ttnn7\" (UID: \"6a3d4b3e-f6ad-444b-b69d-c5602afb93fe\") " pod="openshift-ingress-canary/ingress-canary-ttnn7" Jul 13 07:12:39.142175 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.140932 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-tmp-dir\") pod \"dns-default-sgkm7\" (UID: \"c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8\") " pod="openshift-dns/dns-default-sgkm7" Jul 13 07:12:39.142175 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.141020 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-config-volume\") pod \"dns-default-sgkm7\" (UID: \"c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8\") " pod="openshift-dns/dns-default-sgkm7" Jul 13 07:12:39.142175 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.141217 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-certificates\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.142175 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.141253 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-ca-trust-extracted\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.142463 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.142399 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-trusted-ca\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.145350 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.145289 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-image-registry-private-configuration\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.145350 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.145305 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-installation-pull-secrets\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.145506 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.145358 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a3d4b3e-f6ad-444b-b69d-c5602afb93fe-cert\") pod \"ingress-canary-ttnn7\" (UID: \"6a3d4b3e-f6ad-444b-b69d-c5602afb93fe\") " pod="openshift-ingress-canary/ingress-canary-ttnn7" Jul 13 07:12:39.145987 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.145962 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:39.149767 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.149740 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhwxf\" (UniqueName: \"kubernetes.io/projected/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-kube-api-access-rhwxf\") pod \"dns-default-sgkm7\" (UID: \"c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8\") " pod="openshift-dns/dns-default-sgkm7" Jul 13 07:12:39.150240 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.150213 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9wt8\" (UniqueName: \"kubernetes.io/projected/6a3d4b3e-f6ad-444b-b69d-c5602afb93fe-kube-api-access-f9wt8\") pod \"ingress-canary-ttnn7\" (UID: \"6a3d4b3e-f6ad-444b-b69d-c5602afb93fe\") " pod="openshift-ingress-canary/ingress-canary-ttnn7" Jul 13 07:12:39.153008 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.152986 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-bound-sa-token\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.153207 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.153190 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psgpv\" (UniqueName: \"kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-kube-api-access-psgpv\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.238266 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.238240 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ttnn7" Jul 13 07:12:39.301439 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.301410 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:39.399698 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.399663 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:39.460431 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.460393 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:39.634462 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.634390 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:12:39.634462 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.634406 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:12:39.634675 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.634390 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:12:39.637647 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.637475 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 07:12:39.637647 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.637488 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 07:12:39.637647 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.637526 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5sc2t\"" Jul 13 07:12:39.638807 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.638785 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 07:12:39.638936 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.638850 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 07:12:39.639001 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.638949 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4492s\"" Jul 13 07:12:39.644336 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.644302 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-tls\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:39.644449 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:39.644359 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-metrics-tls\") pod \"dns-default-sgkm7\" (UID: \"c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8\") " pod="openshift-dns/dns-default-sgkm7" Jul 13 07:12:39.644449 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:39.644436 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 07:12:39.644559 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:39.644451 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66d7c494cd-rsrkn: secret "image-registry-tls" not found Jul 13 07:12:39.644559 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:39.644465 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 07:12:39.644559 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:39.644512 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-tls podName:ef6a14c6-4fc4-4e28-8727-5541519dcd4e nodeName:}" failed. No retries permitted until 2026-07-13 07:12:40.644492685 +0000 UTC m=+37.566744855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-tls") pod "image-registry-66d7c494cd-rsrkn" (UID: "ef6a14c6-4fc4-4e28-8727-5541519dcd4e") : secret "image-registry-tls" not found Jul 13 07:12:39.644559 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:39.644531 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-metrics-tls podName:c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:40.644522714 +0000 UTC m=+37.566774872 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-metrics-tls") pod "dns-default-sgkm7" (UID: "c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8") : secret "dns-default-metrics-tls" not found Jul 13 07:12:40.651200 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:40.651173 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-tls\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:40.651633 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:40.651213 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-metrics-tls\") pod \"dns-default-sgkm7\" (UID: \"c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8\") " pod="openshift-dns/dns-default-sgkm7" Jul 13 07:12:40.651633 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:40.651331 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 07:12:40.651633 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:40.651358 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 07:12:40.651633 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:40.651380 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66d7c494cd-rsrkn: secret "image-registry-tls" not found Jul 13 07:12:40.651633 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:40.651389 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-metrics-tls podName:c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:42.651371277 +0000 UTC m=+39.573623429 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-metrics-tls") pod "dns-default-sgkm7" (UID: "c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8") : secret "dns-default-metrics-tls" not found Jul 13 07:12:40.651633 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:40.651434 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-tls podName:ef6a14c6-4fc4-4e28-8727-5541519dcd4e nodeName:}" failed. No retries permitted until 2026-07-13 07:12:42.651416387 +0000 UTC m=+39.573668555 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-tls") pod "image-registry-66d7c494cd-rsrkn" (UID: "ef6a14c6-4fc4-4e28-8727-5541519dcd4e") : secret "image-registry-tls" not found Jul 13 07:12:40.776751 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:40.776555 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ttnn7"] Jul 13 07:12:40.780299 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:40.780274 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a3d4b3e_f6ad_444b_b69d_c5602afb93fe.slice/crio-331a8b9f2b2716e789e933da2a249a4409587eebdefe47cabf0b0337b8938c30 WatchSource:0}: Error finding container 331a8b9f2b2716e789e933da2a249a4409587eebdefe47cabf0b0337b8938c30: Status 404 returned error can't find the container with id 331a8b9f2b2716e789e933da2a249a4409587eebdefe47cabf0b0337b8938c30 Jul 13 07:12:40.813201 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:40.813169 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ttnn7" event={"ID":"6a3d4b3e-f6ad-444b-b69d-c5602afb93fe","Type":"ContainerStarted","Data":"331a8b9f2b2716e789e933da2a249a4409587eebdefe47cabf0b0337b8938c30"} Jul 13 07:12:40.815914 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:40.815887 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhkjr" event={"ID":"24f469df-890b-4f58-a8ff-5c75cbfb1442","Type":"ContainerStarted","Data":"1549c444401cb9c1f40c873878407d91e47adf49e8e508cead314ec656c7a464"} Jul 13 07:12:40.878457 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:40.878433 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:40.978029 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:40.977949 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:41.300168 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.300137 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2qghx"] Jul 13 07:12:41.302718 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.302701 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:41.305476 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.305451 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 13 07:12:41.305596 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.305452 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 13 07:12:41.305596 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.305455 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 13 07:12:41.305596 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.305460 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 13 07:12:41.306653 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.306626 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8g2nr\"" Jul 13 07:12:41.315433 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.315409 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2qghx"] Jul 13 07:12:41.326566 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.326535 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:41.383892 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.383867 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:41.460102 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.460073 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0c99f85-cd64-45cb-a2ae-37cceb18333d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:41.460271 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.460139 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0c99f85-cd64-45cb-a2ae-37cceb18333d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:41.460271 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.460221 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0c99f85-cd64-45cb-a2ae-37cceb18333d-data-volume\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:41.460390 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.460294 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0c99f85-cd64-45cb-a2ae-37cceb18333d-crio-socket\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:41.460390 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.460341 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkhk2\" (UniqueName: \"kubernetes.io/projected/e0c99f85-cd64-45cb-a2ae-37cceb18333d-kube-api-access-xkhk2\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:41.561628 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.561546 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0c99f85-cd64-45cb-a2ae-37cceb18333d-crio-socket\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:41.561628 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.561582 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkhk2\" (UniqueName: \"kubernetes.io/projected/e0c99f85-cd64-45cb-a2ae-37cceb18333d-kube-api-access-xkhk2\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:41.561628 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.561614 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0c99f85-cd64-45cb-a2ae-37cceb18333d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:41.561888 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:41.561673 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 07:12:41.561888 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.561710 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0c99f85-cd64-45cb-a2ae-37cceb18333d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:41.561888 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:41.561727 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0c99f85-cd64-45cb-a2ae-37cceb18333d-kube-rbac-proxy-cm podName:e0c99f85-cd64-45cb-a2ae-37cceb18333d nodeName:}" failed. No retries permitted until 2026-07-13 07:12:42.061713597 +0000 UTC m=+38.983965747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0c99f85-cd64-45cb-a2ae-37cceb18333d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2qghx" (UID: "e0c99f85-cd64-45cb-a2ae-37cceb18333d") : configmap "kube-rbac-proxy" not found Jul 13 07:12:41.561888 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.561777 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0c99f85-cd64-45cb-a2ae-37cceb18333d-data-volume\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:41.561888 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:41.561847 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 07:12:41.562121 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:41.561909 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c99f85-cd64-45cb-a2ae-37cceb18333d-insights-runtime-extractor-tls podName:e0c99f85-cd64-45cb-a2ae-37cceb18333d nodeName:}" failed. No retries permitted until 2026-07-13 07:12:42.061891751 +0000 UTC m=+38.984143912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0c99f85-cd64-45cb-a2ae-37cceb18333d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qghx" (UID: "e0c99f85-cd64-45cb-a2ae-37cceb18333d") : secret "insights-runtime-extractor-tls" not found Jul 13 07:12:41.562121 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.561934 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e0c99f85-cd64-45cb-a2ae-37cceb18333d-crio-socket\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:41.562201 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.562120 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e0c99f85-cd64-45cb-a2ae-37cceb18333d-data-volume\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:41.574557 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.574535 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkhk2\" (UniqueName: \"kubernetes.io/projected/e0c99f85-cd64-45cb-a2ae-37cceb18333d-kube-api-access-xkhk2\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:41.603823 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.603792 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:41.604472 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.604453 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hdjgp"] Jul 13 07:12:41.606724 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.606694 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hdjgp" Jul 13 07:12:41.609185 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.609166 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 13 07:12:41.609281 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.609187 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-nzzgg\"" Jul 13 07:12:41.609281 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.609195 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 13 07:12:41.618351 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.618330 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hdjgp"] Jul 13 07:12:41.671570 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.671539 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:41.728876 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.728833 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:41.763233 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.763201 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dd9k\" (UniqueName: \"kubernetes.io/projected/26243c9e-354b-4202-b393-9388d5a89aec-kube-api-access-6dd9k\") pod \"migrator-7f59b54f6c-hdjgp\" (UID: \"26243c9e-354b-4202-b393-9388d5a89aec\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hdjgp" Jul 13 07:12:41.821725 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.821652 2565 generic.go:356] "Generic (PLEG): container finished" podID="24f469df-890b-4f58-a8ff-5c75cbfb1442" containerID="1549c444401cb9c1f40c873878407d91e47adf49e8e508cead314ec656c7a464" exitCode=0 Jul 13 07:12:41.821855 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.821724 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhkjr" event={"ID":"24f469df-890b-4f58-a8ff-5c75cbfb1442","Type":"ContainerDied","Data":"1549c444401cb9c1f40c873878407d91e47adf49e8e508cead314ec656c7a464"} Jul 13 07:12:41.864334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.864286 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dd9k\" (UniqueName: \"kubernetes.io/projected/26243c9e-354b-4202-b393-9388d5a89aec-kube-api-access-6dd9k\") pod \"migrator-7f59b54f6c-hdjgp\" (UID: \"26243c9e-354b-4202-b393-9388d5a89aec\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hdjgp" Jul 13 07:12:41.875135 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.875107 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dd9k\" (UniqueName: \"kubernetes.io/projected/26243c9e-354b-4202-b393-9388d5a89aec-kube-api-access-6dd9k\") pod \"migrator-7f59b54f6c-hdjgp\" (UID: \"26243c9e-354b-4202-b393-9388d5a89aec\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hdjgp" Jul 13 07:12:41.916713 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:41.916688 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hdjgp" Jul 13 07:12:42.066373 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:42.066134 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0c99f85-cd64-45cb-a2ae-37cceb18333d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:42.066541 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:42.066280 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 07:12:42.066541 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:42.066533 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c99f85-cd64-45cb-a2ae-37cceb18333d-insights-runtime-extractor-tls podName:e0c99f85-cd64-45cb-a2ae-37cceb18333d nodeName:}" failed. No retries permitted until 2026-07-13 07:12:43.066505358 +0000 UTC m=+39.988757522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0c99f85-cd64-45cb-a2ae-37cceb18333d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qghx" (UID: "e0c99f85-cd64-45cb-a2ae-37cceb18333d") : secret "insights-runtime-extractor-tls" not found Jul 13 07:12:42.066667 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:42.066561 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0c99f85-cd64-45cb-a2ae-37cceb18333d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:42.066718 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:42.066683 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 07:12:42.066771 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:42.066731 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0c99f85-cd64-45cb-a2ae-37cceb18333d-kube-rbac-proxy-cm podName:e0c99f85-cd64-45cb-a2ae-37cceb18333d nodeName:}" failed. No retries permitted until 2026-07-13 07:12:43.066718411 +0000 UTC m=+39.988970578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0c99f85-cd64-45cb-a2ae-37cceb18333d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2qghx" (UID: "e0c99f85-cd64-45cb-a2ae-37cceb18333d") : configmap "kube-rbac-proxy" not found Jul 13 07:12:42.068544 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:42.068518 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hdjgp"] Jul 13 07:12:42.072651 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:42.072587 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26243c9e_354b_4202_b393_9388d5a89aec.slice/crio-8faf83ca3d287aa66f6686c2382e818cc3030ebaf08e4d950f0e8d4792ddce07 WatchSource:0}: Error finding container 8faf83ca3d287aa66f6686c2382e818cc3030ebaf08e4d950f0e8d4792ddce07: Status 404 returned error can't find the container with id 8faf83ca3d287aa66f6686c2382e818cc3030ebaf08e4d950f0e8d4792ddce07 Jul 13 07:12:42.138530 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:42.138481 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:42.236868 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:42.236835 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:42.671127 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:42.671098 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-tls\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:42.671291 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:42.671146 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-metrics-tls\") pod \"dns-default-sgkm7\" (UID: \"c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8\") " pod="openshift-dns/dns-default-sgkm7" Jul 13 07:12:42.671291 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:42.671274 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 07:12:42.671291 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:42.671281 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 07:12:42.671461 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:42.671304 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66d7c494cd-rsrkn: secret "image-registry-tls" not found Jul 13 07:12:42.671461 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:42.671363 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-metrics-tls podName:c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:46.671341522 +0000 UTC m=+43.593593690 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-metrics-tls") pod "dns-default-sgkm7" (UID: "c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8") : secret "dns-default-metrics-tls" not found Jul 13 07:12:42.671461 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:42.671382 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-tls podName:ef6a14c6-4fc4-4e28-8727-5541519dcd4e nodeName:}" failed. No retries permitted until 2026-07-13 07:12:46.671373442 +0000 UTC m=+43.593625603 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-tls") pod "image-registry-66d7c494cd-rsrkn" (UID: "ef6a14c6-4fc4-4e28-8727-5541519dcd4e") : secret "image-registry-tls" not found Jul 13 07:12:42.827783 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:42.827751 2565 generic.go:356] "Generic (PLEG): container finished" podID="24f469df-890b-4f58-a8ff-5c75cbfb1442" containerID="13bda5a31c287f1d63c2b084b1654a36316a6915219e2c858522ca8da8cf30b2" exitCode=0 Jul 13 07:12:42.828175 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:42.827837 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhkjr" event={"ID":"24f469df-890b-4f58-a8ff-5c75cbfb1442","Type":"ContainerDied","Data":"13bda5a31c287f1d63c2b084b1654a36316a6915219e2c858522ca8da8cf30b2"} Jul 13 07:12:42.829066 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:42.829041 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hdjgp" event={"ID":"26243c9e-354b-4202-b393-9388d5a89aec","Type":"ContainerStarted","Data":"8faf83ca3d287aa66f6686c2382e818cc3030ebaf08e4d950f0e8d4792ddce07"} Jul 13 07:12:42.849549 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:42.849495 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:42.953024 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:42.952985 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:43.074985 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:43.074937 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0c99f85-cd64-45cb-a2ae-37cceb18333d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:43.075169 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:43.075081 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0c99f85-cd64-45cb-a2ae-37cceb18333d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:43.075169 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:43.075155 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 07:12:43.075286 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:43.075237 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c99f85-cd64-45cb-a2ae-37cceb18333d-insights-runtime-extractor-tls podName:e0c99f85-cd64-45cb-a2ae-37cceb18333d nodeName:}" failed. No retries permitted until 2026-07-13 07:12:45.075214436 +0000 UTC m=+41.997466610 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0c99f85-cd64-45cb-a2ae-37cceb18333d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qghx" (UID: "e0c99f85-cd64-45cb-a2ae-37cceb18333d") : secret "insights-runtime-extractor-tls" not found Jul 13 07:12:43.075286 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:43.075162 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 13 07:12:43.075445 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:43.075298 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0c99f85-cd64-45cb-a2ae-37cceb18333d-kube-rbac-proxy-cm podName:e0c99f85-cd64-45cb-a2ae-37cceb18333d nodeName:}" failed. No retries permitted until 2026-07-13 07:12:45.075281746 +0000 UTC m=+41.997533902 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e0c99f85-cd64-45cb-a2ae-37cceb18333d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2qghx" (UID: "e0c99f85-cd64-45cb-a2ae-37cceb18333d") : configmap "kube-rbac-proxy" not found Jul 13 07:12:43.121493 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:43.121456 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q9787_fb41cbdc-4be4-4e54-9c8d-fad3734be1af/dns-node-resolver/0.log" Jul 13 07:12:43.315150 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:43.315096 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:43.515093 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:43.515059 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:43.616447 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:43.616410 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:43.721851 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:43.721822 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bqlnb_4900d593-e893-4320-8eaf-b3d326987b17/node-ca/0.log" Jul 13 07:12:43.835187 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:43.835105 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hhkjr" event={"ID":"24f469df-890b-4f58-a8ff-5c75cbfb1442","Type":"ContainerStarted","Data":"036d0d0fdd562557cf75981fab6347f9a563f2df57e682e50853572e5d0c427b"} Jul 13 07:12:43.860450 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:43.860392 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hhkjr" podStartSLOduration=9.198643852 podStartE2EDuration="39.860370496s" totalImagesPullingTime="30.661726644s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:43.858311284 +0000 UTC m=+40.780563447" watchObservedRunningTime="2026-07-13 07:12:43.860370496 +0000 UTC m=+40.782622670" Jul 13 07:12:43.981077 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:43.981040 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:44.080062 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.080022 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:44.451271 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.451246 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-qq9xm"] Jul 13 07:12:44.473851 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.473830 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-qq9xm"] Jul 13 07:12:44.473973 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.473931 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-qq9xm" Jul 13 07:12:44.476272 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.476248 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 13 07:12:44.476613 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.476599 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5n647\"" Jul 13 07:12:44.476692 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.476626 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 13 07:12:44.476731 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.476706 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 13 07:12:44.476858 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.476843 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 13 07:12:44.489480 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.489457 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:44.543388 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.543358 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:44.588447 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.588414 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkb7c\" (UniqueName: \"kubernetes.io/projected/f9f2589b-bcb8-4f5c-946f-06cdef9fbead-kube-api-access-kkb7c\") pod \"service-ca-79f68b9f4f-qq9xm\" (UID: \"f9f2589b-bcb8-4f5c-946f-06cdef9fbead\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qq9xm" Jul 13 07:12:44.588558 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.588468 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f9f2589b-bcb8-4f5c-946f-06cdef9fbead-signing-key\") pod \"service-ca-79f68b9f4f-qq9xm\" (UID: \"f9f2589b-bcb8-4f5c-946f-06cdef9fbead\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qq9xm" Jul 13 07:12:44.588558 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.588505 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f9f2589b-bcb8-4f5c-946f-06cdef9fbead-signing-cabundle\") pod \"service-ca-79f68b9f4f-qq9xm\" (UID: \"f9f2589b-bcb8-4f5c-946f-06cdef9fbead\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qq9xm" Jul 13 07:12:44.689398 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.689367 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkb7c\" (UniqueName: \"kubernetes.io/projected/f9f2589b-bcb8-4f5c-946f-06cdef9fbead-kube-api-access-kkb7c\") pod \"service-ca-79f68b9f4f-qq9xm\" (UID: \"f9f2589b-bcb8-4f5c-946f-06cdef9fbead\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qq9xm" Jul 13 07:12:44.689579 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.689417 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f9f2589b-bcb8-4f5c-946f-06cdef9fbead-signing-key\") pod \"service-ca-79f68b9f4f-qq9xm\" (UID: \"f9f2589b-bcb8-4f5c-946f-06cdef9fbead\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qq9xm" Jul 13 07:12:44.689579 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.689451 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f9f2589b-bcb8-4f5c-946f-06cdef9fbead-signing-cabundle\") pod \"service-ca-79f68b9f4f-qq9xm\" (UID: \"f9f2589b-bcb8-4f5c-946f-06cdef9fbead\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qq9xm" Jul 13 07:12:44.690332 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.690290 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/f9f2589b-bcb8-4f5c-946f-06cdef9fbead-signing-cabundle\") pod \"service-ca-79f68b9f4f-qq9xm\" (UID: \"f9f2589b-bcb8-4f5c-946f-06cdef9fbead\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qq9xm" Jul 13 07:12:44.692496 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.692472 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/f9f2589b-bcb8-4f5c-946f-06cdef9fbead-signing-key\") pod \"service-ca-79f68b9f4f-qq9xm\" (UID: \"f9f2589b-bcb8-4f5c-946f-06cdef9fbead\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qq9xm" Jul 13 07:12:44.698099 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.698076 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkb7c\" (UniqueName: \"kubernetes.io/projected/f9f2589b-bcb8-4f5c-946f-06cdef9fbead-kube-api-access-kkb7c\") pod \"service-ca-79f68b9f4f-qq9xm\" (UID: \"f9f2589b-bcb8-4f5c-946f-06cdef9fbead\") " pod="openshift-service-ca/service-ca-79f68b9f4f-qq9xm" Jul 13 07:12:44.782202 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.782162 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-qq9xm" Jul 13 07:12:44.839226 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.839186 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ttnn7" event={"ID":"6a3d4b3e-f6ad-444b-b69d-c5602afb93fe","Type":"ContainerStarted","Data":"f9241e72a346f35c5bb8cdb20f6e9f4ed4efb3a78fcaed3c9b5362191272f49c"} Jul 13 07:12:44.840874 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.840844 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hdjgp" event={"ID":"26243c9e-354b-4202-b393-9388d5a89aec","Type":"ContainerStarted","Data":"ba83823b526ffe933c1d4d011f59433e0899625215acd79c9b8abb76087da534"} Jul 13 07:12:44.841004 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.840893 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hdjgp" event={"ID":"26243c9e-354b-4202-b393-9388d5a89aec","Type":"ContainerStarted","Data":"34b4b599af21ab2310287c7474968ff73b8e9fb472445415f01ac37de1851ae6"} Jul 13 07:12:44.885289 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.885244 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ttnn7" podStartSLOduration=3.20205636 podStartE2EDuration="6.885226115s" totalImagesPullingTime="3.683169755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:44.85993255 +0000 UTC m=+41.782184724" watchObservedRunningTime="2026-07-13 07:12:44.885226115 +0000 UTC m=+41.807478304" Jul 13 07:12:44.885417 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.885347 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-hdjgp" podStartSLOduration=1.49158937 podStartE2EDuration="3.885342673s" totalImagesPullingTime="2.393753303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:44.884972106 +0000 UTC m=+41.807224281" watchObservedRunningTime="2026-07-13 07:12:44.885342673 +0000 UTC m=+41.807594846" Jul 13 07:12:44.939037 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.938994 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-qq9xm"] Jul 13 07:12:44.942782 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:44.942757 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9f2589b_bcb8_4f5c_946f_06cdef9fbead.slice/crio-e615dc5954813355c576add46db80612007c431c665379325bd6de81d281bd7c WatchSource:0}: Error finding container e615dc5954813355c576add46db80612007c431c665379325bd6de81d281bd7c: Status 404 returned error can't find the container with id e615dc5954813355c576add46db80612007c431c665379325bd6de81d281bd7c Jul 13 07:12:44.986485 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:44.986456 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:45.093110 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:45.093074 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0c99f85-cd64-45cb-a2ae-37cceb18333d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:45.093270 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:45.093228 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 07:12:45.093310 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:45.093273 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0c99f85-cd64-45cb-a2ae-37cceb18333d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:45.093310 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:45.093299 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c99f85-cd64-45cb-a2ae-37cceb18333d-insights-runtime-extractor-tls podName:e0c99f85-cd64-45cb-a2ae-37cceb18333d nodeName:}" failed. No retries permitted until 2026-07-13 07:12:49.093279793 +0000 UTC m=+46.015531946 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0c99f85-cd64-45cb-a2ae-37cceb18333d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qghx" (UID: "e0c99f85-cd64-45cb-a2ae-37cceb18333d") : secret "insights-runtime-extractor-tls" not found Jul 13 07:12:45.093793 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:45.093776 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e0c99f85-cd64-45cb-a2ae-37cceb18333d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:45.098820 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:45.098796 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:45.373144 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:45.373102 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:45.661371 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:45.661269 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:45.760783 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:45.760752 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:45.844511 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:45.844476 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-qq9xm" event={"ID":"f9f2589b-bcb8-4f5c-946f-06cdef9fbead","Type":"ContainerStarted","Data":"e615dc5954813355c576add46db80612007c431c665379325bd6de81d281bd7c"} Jul 13 07:12:46.706372 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:46.706337 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-tls\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:46.706591 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:46.706387 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-metrics-tls\") pod \"dns-default-sgkm7\" (UID: \"c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8\") " pod="openshift-dns/dns-default-sgkm7" Jul 13 07:12:46.706591 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:46.706520 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 13 07:12:46.706591 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:46.706564 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-66d7c494cd-rsrkn: secret "image-registry-tls" not found Jul 13 07:12:46.706718 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:46.706643 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 13 07:12:46.706718 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:46.706647 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-tls podName:ef6a14c6-4fc4-4e28-8727-5541519dcd4e nodeName:}" failed. No retries permitted until 2026-07-13 07:12:54.706615515 +0000 UTC m=+51.628867670 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-tls") pod "image-registry-66d7c494cd-rsrkn" (UID: "ef6a14c6-4fc4-4e28-8727-5541519dcd4e") : secret "image-registry-tls" not found Jul 13 07:12:46.706718 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:46.706689 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-metrics-tls podName:c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8 nodeName:}" failed. No retries permitted until 2026-07-13 07:12:54.706678065 +0000 UTC m=+51.628930216 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-metrics-tls") pod "dns-default-sgkm7" (UID: "c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8") : secret "dns-default-metrics-tls" not found Jul 13 07:12:47.851300 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:47.851265 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-qq9xm" event={"ID":"f9f2589b-bcb8-4f5c-946f-06cdef9fbead","Type":"ContainerStarted","Data":"e56587c384836a14560a30fc0e61f6384713a8b929f4de8e135bc42664fa24be"} Jul 13 07:12:48.579973 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:48.579941 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:48.685651 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:48.685613 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:48.809673 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:48.809646 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:48.904488 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:48.904415 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:49.009354 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:49.009328 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:49.105419 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:49.105393 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:49.129515 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:49.129491 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0c99f85-cd64-45cb-a2ae-37cceb18333d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:49.129671 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:49.129642 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 13 07:12:49.129784 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:12:49.129714 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0c99f85-cd64-45cb-a2ae-37cceb18333d-insights-runtime-extractor-tls podName:e0c99f85-cd64-45cb-a2ae-37cceb18333d nodeName:}" failed. No retries permitted until 2026-07-13 07:12:57.12969441 +0000 UTC m=+54.051946564 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e0c99f85-cd64-45cb-a2ae-37cceb18333d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2qghx" (UID: "e0c99f85-cd64-45cb-a2ae-37cceb18333d") : secret "insights-runtime-extractor-tls" not found Jul 13 07:12:49.206811 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:49.206731 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:49.354124 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:49.354094 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:50.548230 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:50.548187 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:50.745788 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:50.745761 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:50.945912 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:50.945839 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:51.145883 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:51.145858 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:51.346669 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:51.346640 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:52.146958 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:52.146924 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:52.347242 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:52.347200 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:52.541904 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:52.541879 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:52.748297 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:52.748267 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:52.942000 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:52.941938 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:53.042881 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:53.042848 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:53.149291 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:53.149264 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:53.352601 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:53.352567 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:54.549076 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:54.549039 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:54.749624 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:54.749587 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:54.770697 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:54.770658 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-tls\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:54.770822 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:54.770716 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-metrics-tls\") pod \"dns-default-sgkm7\" (UID: \"c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8\") " pod="openshift-dns/dns-default-sgkm7" Jul 13 07:12:54.773165 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:54.773140 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8-metrics-tls\") pod \"dns-default-sgkm7\" (UID: \"c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8\") " pod="openshift-dns/dns-default-sgkm7" Jul 13 07:12:54.773288 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:54.773268 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-tls\") pod \"image-registry-66d7c494cd-rsrkn\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:54.820408 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:54.820290 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:54.831481 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:54.831445 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sgkm7" Jul 13 07:12:54.959388 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:54.959344 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:54.994748 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:54.994657 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-qq9xm" podStartSLOduration=8.23772429 podStartE2EDuration="10.994623901s" totalImagesPullingTime="2.756899611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:47.869437295 +0000 UTC m=+44.791689481" watchObservedRunningTime="2026-07-13 07:12:54.994623901 +0000 UTC m=+51.916876075" Jul 13 07:12:54.995276 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:54.995256 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-66d7c494cd-rsrkn"] Jul 13 07:12:54.999206 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:54.999178 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef6a14c6_4fc4_4e28_8727_5541519dcd4e.slice/crio-670d27242984a4c4078cef1fdee6b610ebafc0cdd19e1d6fdeb041d5e198a978 WatchSource:0}: Error finding container 670d27242984a4c4078cef1fdee6b610ebafc0cdd19e1d6fdeb041d5e198a978: Status 404 returned error can't find the container with id 670d27242984a4c4078cef1fdee6b610ebafc0cdd19e1d6fdeb041d5e198a978 Jul 13 07:12:55.001381 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:55.001308 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sgkm7"] Jul 13 07:12:55.004828 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:55.004805 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc36dd43a_b54d_45ea_ab7f_ee80a1fe58e8.slice/crio-32e6e92a3b739ddebdec3cd853e861161d5c37244dd7a24bc16fcc9ce26eab5a WatchSource:0}: Error finding container 32e6e92a3b739ddebdec3cd853e861161d5c37244dd7a24bc16fcc9ce26eab5a: Status 404 returned error can't find the container with id 32e6e92a3b739ddebdec3cd853e861161d5c37244dd7a24bc16fcc9ce26eab5a Jul 13 07:12:55.057150 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:55.057118 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:55.157382 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:55.157343 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:55.347494 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:55.347431 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:55.871290 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:55.871256 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sgkm7" event={"ID":"c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8","Type":"ContainerStarted","Data":"32e6e92a3b739ddebdec3cd853e861161d5c37244dd7a24bc16fcc9ce26eab5a"} Jul 13 07:12:55.873185 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:55.873154 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" event={"ID":"ef6a14c6-4fc4-4e28-8727-5541519dcd4e","Type":"ContainerStarted","Data":"b4dfef3aad784521d1086eedd51a073241c8ef6a6a2836c263e088e234ab02bf"} Jul 13 07:12:55.873346 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:55.873209 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" event={"ID":"ef6a14c6-4fc4-4e28-8727-5541519dcd4e","Type":"ContainerStarted","Data":"670d27242984a4c4078cef1fdee6b610ebafc0cdd19e1d6fdeb041d5e198a978"} Jul 13 07:12:55.873346 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:55.873298 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:12:55.895146 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:55.895085 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" podStartSLOduration=22.895064516 podStartE2EDuration="22.895064516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:55.893997497 +0000 UTC m=+52.816249683" watchObservedRunningTime="2026-07-13 07:12:55.895064516 +0000 UTC m=+52.817316689" Jul 13 07:12:55.962038 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:55.962002 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:56.063892 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:56.063794 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:56.235837 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:56.235803 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:56.345644 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:56.345612 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:56.747915 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:56.747874 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:56.944909 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:56.944871 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:57.148027 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:57.147934 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:57.192065 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:57.192023 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0c99f85-cd64-45cb-a2ae-37cceb18333d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:57.194525 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:57.194498 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e0c99f85-cd64-45cb-a2ae-37cceb18333d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qghx\" (UID: \"e0c99f85-cd64-45cb-a2ae-37cceb18333d\") " pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:57.212446 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:57.212413 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2qghx" Jul 13 07:12:57.356628 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:57.356562 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:57.438552 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:57.438521 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2qghx"] Jul 13 07:12:57.442064 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:12:57.442032 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c99f85_cd64_45cb_a2ae_37cceb18333d.slice/crio-62a1a8fd7311f14baa7b17bbeea8dc9fcaf61ffd6f310d3bffbb6c1bbf8f5318 WatchSource:0}: Error finding container 62a1a8fd7311f14baa7b17bbeea8dc9fcaf61ffd6f310d3bffbb6c1bbf8f5318: Status 404 returned error can't find the container with id 62a1a8fd7311f14baa7b17bbeea8dc9fcaf61ffd6f310d3bffbb6c1bbf8f5318 Jul 13 07:12:57.880605 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:57.880565 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2qghx" event={"ID":"e0c99f85-cd64-45cb-a2ae-37cceb18333d","Type":"ContainerStarted","Data":"62a1a8fd7311f14baa7b17bbeea8dc9fcaf61ffd6f310d3bffbb6c1bbf8f5318"} Jul 13 07:12:57.882212 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:57.882188 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sgkm7" event={"ID":"c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8","Type":"ContainerStarted","Data":"bdb669f5729469611a3e472a311d5f09166e6de33276a320929e90e9cd5940a0"} Jul 13 07:12:57.882341 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:57.882228 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sgkm7" event={"ID":"c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8","Type":"ContainerStarted","Data":"66d99d1e7fc1de0c6d95b630182fe3a2e5aa0103230eea66badaf3fb7891fa15"} Jul 13 07:12:57.882377 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:57.882344 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sgkm7" Jul 13 07:12:57.899660 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:57.899579 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sgkm7" podStartSLOduration=17.615573973 podStartE2EDuration="19.89955654s" totalImagesPullingTime="2.283982567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:12:57.899306315 +0000 UTC m=+54.821558491" watchObservedRunningTime="2026-07-13 07:12:57.89955654 +0000 UTC m=+54.821808714" Jul 13 07:12:58.545479 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:58.545430 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:58.747730 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:58.747693 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:58.948610 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:58.948515 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:59.146793 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:59.146759 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:59.351353 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:59.351277 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:59.542160 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:59.542119 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:59.642631 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:59.642521 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:59.712643 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:59.712597 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:59.811846 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:59.811809 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:12:59.990957 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:12:59.990915 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:00.060821 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:00.060780 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:00.209517 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:00.209474 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:00.397106 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:00.397067 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:00.459356 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:00.459298 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:00.646838 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:00.646802 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:00.699062 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:00.698974 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:01.416883 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:01.416783 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:01.611621 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:01.611570 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:01.750938 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:01.750910 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:01.897727 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:01.897693 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2qghx" event={"ID":"e0c99f85-cd64-45cb-a2ae-37cceb18333d","Type":"ContainerStarted","Data":"caa6e0e8c0dd084f63205bf9f2f0dd12c0957550fc859bc98c92c425305ad3fc"} Jul 13 07:13:01.897903 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:01.897745 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2qghx" event={"ID":"e0c99f85-cd64-45cb-a2ae-37cceb18333d","Type":"ContainerStarted","Data":"1cff66fc122f3e07d2b3838e48666b9dc2a8fd44318527531c55e2d2b3eb35b6"} Jul 13 07:13:02.048718 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:02.048687 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:02.113752 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:02.113713 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:04.814474 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:04.814448 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fq6rx" Jul 13 07:13:04.908634 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:04.908604 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2qghx" event={"ID":"e0c99f85-cd64-45cb-a2ae-37cceb18333d","Type":"ContainerStarted","Data":"520334e4b83e2b94d15e3461d7b9a84ba0139bf7ec184f543ed6b5d49b60067a"} Jul 13 07:13:04.927014 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:04.926971 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2qghx" podStartSLOduration=17.320465757 podStartE2EDuration="23.926958435s" totalImagesPullingTime="6.606492678s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:04.926195664 +0000 UTC m=+61.848447838" watchObservedRunningTime="2026-07-13 07:13:04.926958435 +0000 UTC m=+61.849210608" Jul 13 07:13:07.887798 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:07.887764 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sgkm7" Jul 13 07:13:08.125537 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.125510 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8dfbbf54-ls9x7"] Jul 13 07:13:08.128423 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.128406 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8dfbbf54-ls9x7" Jul 13 07:13:08.131632 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.131609 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 13 07:13:08.131632 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.131625 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 13 07:13:08.131869 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.131856 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 13 07:13:08.132475 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.132460 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 13 07:13:08.132730 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.132713 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vqksg\"" Jul 13 07:13:08.149056 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.149008 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws"] Jul 13 07:13:08.151202 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.151186 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" Jul 13 07:13:08.152685 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.152658 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8dfbbf54-ls9x7"] Jul 13 07:13:08.156890 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.156865 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 13 07:13:08.157231 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.157208 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 13 07:13:08.157347 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.157294 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 13 07:13:08.157452 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.157222 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 13 07:13:08.163882 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.163863 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66d7c494cd-rsrkn"] Jul 13 07:13:08.176397 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.176372 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws"] Jul 13 07:13:08.184691 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.184667 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2466\" (UniqueName: \"kubernetes.io/projected/bdcf8caa-5777-419c-8fbb-5b5e2d844926-kube-api-access-r2466\") pod \"managed-serviceaccount-addon-agent-b8dfbbf54-ls9x7\" (UID: \"bdcf8caa-5777-419c-8fbb-5b5e2d844926\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8dfbbf54-ls9x7" Jul 13 07:13:08.184820 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.184705 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bdcf8caa-5777-419c-8fbb-5b5e2d844926-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b8dfbbf54-ls9x7\" (UID: \"bdcf8caa-5777-419c-8fbb-5b5e2d844926\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8dfbbf54-ls9x7" Jul 13 07:13:08.280216 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.280189 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:08.285231 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.285208 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bdcf8caa-5777-419c-8fbb-5b5e2d844926-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b8dfbbf54-ls9x7\" (UID: \"bdcf8caa-5777-419c-8fbb-5b5e2d844926\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8dfbbf54-ls9x7" Jul 13 07:13:08.285359 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.285236 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3f5f01da-a82a-41c4-9d9a-5b5563eacd9c-hub\") pod \"cluster-proxy-proxy-agent-7577545f8b-6g9ws\" (UID: \"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" Jul 13 07:13:08.285359 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.285255 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f5f01da-a82a-41c4-9d9a-5b5563eacd9c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7577545f8b-6g9ws\" (UID: \"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" Jul 13 07:13:08.285472 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.285367 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2466\" (UniqueName: \"kubernetes.io/projected/bdcf8caa-5777-419c-8fbb-5b5e2d844926-kube-api-access-r2466\") pod \"managed-serviceaccount-addon-agent-b8dfbbf54-ls9x7\" (UID: \"bdcf8caa-5777-419c-8fbb-5b5e2d844926\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8dfbbf54-ls9x7" Jul 13 07:13:08.285472 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.285390 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3f5f01da-a82a-41c4-9d9a-5b5563eacd9c-ca\") pod \"cluster-proxy-proxy-agent-7577545f8b-6g9ws\" (UID: \"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" Jul 13 07:13:08.285472 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.285412 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3f5f01da-a82a-41c4-9d9a-5b5563eacd9c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7577545f8b-6g9ws\" (UID: \"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" Jul 13 07:13:08.285615 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.285529 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3f5f01da-a82a-41c4-9d9a-5b5563eacd9c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7577545f8b-6g9ws\" (UID: \"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" Jul 13 07:13:08.285615 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.285591 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6nvl\" (UniqueName: \"kubernetes.io/projected/3f5f01da-a82a-41c4-9d9a-5b5563eacd9c-kube-api-access-x6nvl\") pod \"cluster-proxy-proxy-agent-7577545f8b-6g9ws\" (UID: \"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" Jul 13 07:13:08.287762 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.287740 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/bdcf8caa-5777-419c-8fbb-5b5e2d844926-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b8dfbbf54-ls9x7\" (UID: \"bdcf8caa-5777-419c-8fbb-5b5e2d844926\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8dfbbf54-ls9x7" Jul 13 07:13:08.299284 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.299266 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8495fd756d-br9vq"] Jul 13 07:13:08.301245 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.301231 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.304805 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.304779 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2466\" (UniqueName: \"kubernetes.io/projected/bdcf8caa-5777-419c-8fbb-5b5e2d844926-kube-api-access-r2466\") pod \"managed-serviceaccount-addon-agent-b8dfbbf54-ls9x7\" (UID: \"bdcf8caa-5777-419c-8fbb-5b5e2d844926\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8dfbbf54-ls9x7" Jul 13 07:13:08.315491 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.315472 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8495fd756d-br9vq"] Jul 13 07:13:08.385977 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.385953 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6nvl\" (UniqueName: \"kubernetes.io/projected/3f5f01da-a82a-41c4-9d9a-5b5563eacd9c-kube-api-access-x6nvl\") pod \"cluster-proxy-proxy-agent-7577545f8b-6g9ws\" (UID: \"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" Jul 13 07:13:08.386087 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.385982 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc7v6\" (UniqueName: \"kubernetes.io/projected/35201dbf-5ef9-435b-a881-30dc2e7774d3-kube-api-access-pc7v6\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.386087 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.386001 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3f5f01da-a82a-41c4-9d9a-5b5563eacd9c-hub\") pod \"cluster-proxy-proxy-agent-7577545f8b-6g9ws\" (UID: \"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" Jul 13 07:13:08.386087 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.386018 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f5f01da-a82a-41c4-9d9a-5b5563eacd9c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7577545f8b-6g9ws\" (UID: \"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" Jul 13 07:13:08.386299 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.386091 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35201dbf-5ef9-435b-a881-30dc2e7774d3-registry-certificates\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.386299 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.386147 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35201dbf-5ef9-435b-a881-30dc2e7774d3-bound-sa-token\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.386299 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.386178 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35201dbf-5ef9-435b-a881-30dc2e7774d3-ca-trust-extracted\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.386299 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.386213 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35201dbf-5ef9-435b-a881-30dc2e7774d3-registry-tls\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.386299 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.386241 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3f5f01da-a82a-41c4-9d9a-5b5563eacd9c-ca\") pod \"cluster-proxy-proxy-agent-7577545f8b-6g9ws\" (UID: \"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" Jul 13 07:13:08.386299 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.386278 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3f5f01da-a82a-41c4-9d9a-5b5563eacd9c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7577545f8b-6g9ws\" (UID: \"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" Jul 13 07:13:08.386626 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.386304 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3f5f01da-a82a-41c4-9d9a-5b5563eacd9c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7577545f8b-6g9ws\" (UID: \"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" Jul 13 07:13:08.386626 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.386358 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35201dbf-5ef9-435b-a881-30dc2e7774d3-image-registry-private-configuration\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.386626 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.386385 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35201dbf-5ef9-435b-a881-30dc2e7774d3-installation-pull-secrets\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.386626 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.386430 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35201dbf-5ef9-435b-a881-30dc2e7774d3-trusted-ca\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.386841 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.386778 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f5f01da-a82a-41c4-9d9a-5b5563eacd9c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7577545f8b-6g9ws\" (UID: \"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" Jul 13 07:13:08.387387 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.387362 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:08.388727 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.388706 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/3f5f01da-a82a-41c4-9d9a-5b5563eacd9c-ca\") pod \"cluster-proxy-proxy-agent-7577545f8b-6g9ws\" (UID: \"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" Jul 13 07:13:08.388727 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.388725 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/3f5f01da-a82a-41c4-9d9a-5b5563eacd9c-hub\") pod \"cluster-proxy-proxy-agent-7577545f8b-6g9ws\" (UID: \"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" Jul 13 07:13:08.388883 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.388867 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3f5f01da-a82a-41c4-9d9a-5b5563eacd9c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7577545f8b-6g9ws\" (UID: \"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" Jul 13 07:13:08.389015 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.389000 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/3f5f01da-a82a-41c4-9d9a-5b5563eacd9c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7577545f8b-6g9ws\" (UID: \"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" Jul 13 07:13:08.400209 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.400163 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6nvl\" (UniqueName: \"kubernetes.io/projected/3f5f01da-a82a-41c4-9d9a-5b5563eacd9c-kube-api-access-x6nvl\") pod \"cluster-proxy-proxy-agent-7577545f8b-6g9ws\" (UID: \"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" Jul 13 07:13:08.445440 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.445418 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8dfbbf54-ls9x7" Jul 13 07:13:08.461203 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.461183 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" Jul 13 07:13:08.480976 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.480950 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:08.487137 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.487103 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35201dbf-5ef9-435b-a881-30dc2e7774d3-registry-tls\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.487263 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.487181 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35201dbf-5ef9-435b-a881-30dc2e7774d3-image-registry-private-configuration\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.487263 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.487216 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35201dbf-5ef9-435b-a881-30dc2e7774d3-installation-pull-secrets\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.487396 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.487277 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35201dbf-5ef9-435b-a881-30dc2e7774d3-trusted-ca\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.487736 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.487709 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc7v6\" (UniqueName: \"kubernetes.io/projected/35201dbf-5ef9-435b-a881-30dc2e7774d3-kube-api-access-pc7v6\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.487846 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.487816 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35201dbf-5ef9-435b-a881-30dc2e7774d3-registry-certificates\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.488456 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.488429 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/35201dbf-5ef9-435b-a881-30dc2e7774d3-trusted-ca\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.488558 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.488502 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35201dbf-5ef9-435b-a881-30dc2e7774d3-bound-sa-token\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.488624 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.488541 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35201dbf-5ef9-435b-a881-30dc2e7774d3-ca-trust-extracted\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.488624 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.488576 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/35201dbf-5ef9-435b-a881-30dc2e7774d3-registry-certificates\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.489010 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.488962 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/35201dbf-5ef9-435b-a881-30dc2e7774d3-ca-trust-extracted\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.489889 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.489871 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/35201dbf-5ef9-435b-a881-30dc2e7774d3-registry-tls\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.489973 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.489951 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/35201dbf-5ef9-435b-a881-30dc2e7774d3-installation-pull-secrets\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.491004 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.490970 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/35201dbf-5ef9-435b-a881-30dc2e7774d3-image-registry-private-configuration\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.496567 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.496529 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc7v6\" (UniqueName: \"kubernetes.io/projected/35201dbf-5ef9-435b-a881-30dc2e7774d3-kube-api-access-pc7v6\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.498668 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.498602 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/35201dbf-5ef9-435b-a881-30dc2e7774d3-bound-sa-token\") pod \"image-registry-8495fd756d-br9vq\" (UID: \"35201dbf-5ef9-435b-a881-30dc2e7774d3\") " pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.581965 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.581936 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8dfbbf54-ls9x7"] Jul 13 07:13:08.583423 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.583364 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:08.585450 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:13:08.585426 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdcf8caa_5777_419c_8fbb_5b5e2d844926.slice/crio-67745b436e00e2ef75ebd608df0f5f6d059c285390edbf3db26046029abf1c81 WatchSource:0}: Error finding container 67745b436e00e2ef75ebd608df0f5f6d059c285390edbf3db26046029abf1c81: Status 404 returned error can't find the container with id 67745b436e00e2ef75ebd608df0f5f6d059c285390edbf3db26046029abf1c81 Jul 13 07:13:08.602332 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.602292 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws"] Jul 13 07:13:08.604424 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:13:08.604401 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3f5f01da_a82a_41c4_9d9a_5b5563eacd9c.slice/crio-1c7e78d35e4012d09050db38d4bc92c47b279eabc4f824644605d85d4d714af2 WatchSource:0}: Error finding container 1c7e78d35e4012d09050db38d4bc92c47b279eabc4f824644605d85d4d714af2: Status 404 returned error can't find the container with id 1c7e78d35e4012d09050db38d4bc92c47b279eabc4f824644605d85d4d714af2 Jul 13 07:13:08.628378 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.628305 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.750185 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.750128 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8495fd756d-br9vq"] Jul 13 07:13:08.752540 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:13:08.752508 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35201dbf_5ef9_435b_a881_30dc2e7774d3.slice/crio-e5e8851aaed989ed1a110b5d5293438df7b2c0e7677742a80ebc644b33b5dbcb WatchSource:0}: Error finding container e5e8851aaed989ed1a110b5d5293438df7b2c0e7677742a80ebc644b33b5dbcb: Status 404 returned error can't find the container with id e5e8851aaed989ed1a110b5d5293438df7b2c0e7677742a80ebc644b33b5dbcb Jul 13 07:13:08.922206 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.922128 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" event={"ID":"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c","Type":"ContainerStarted","Data":"1c7e78d35e4012d09050db38d4bc92c47b279eabc4f824644605d85d4d714af2"} Jul 13 07:13:08.923356 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.923331 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8dfbbf54-ls9x7" event={"ID":"bdcf8caa-5777-419c-8fbb-5b5e2d844926","Type":"ContainerStarted","Data":"67745b436e00e2ef75ebd608df0f5f6d059c285390edbf3db26046029abf1c81"} Jul 13 07:13:08.924666 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.924644 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8495fd756d-br9vq" event={"ID":"35201dbf-5ef9-435b-a881-30dc2e7774d3","Type":"ContainerStarted","Data":"48eef83696d0e2ee3274f235df16e15fe2e0f298d6c0482055a09fcfd4dfef35"} Jul 13 07:13:08.924767 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.924686 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8495fd756d-br9vq" event={"ID":"35201dbf-5ef9-435b-a881-30dc2e7774d3","Type":"ContainerStarted","Data":"e5e8851aaed989ed1a110b5d5293438df7b2c0e7677742a80ebc644b33b5dbcb"} Jul 13 07:13:08.924833 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.924780 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:08.945210 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:08.945166 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8495fd756d-br9vq" podStartSLOduration=0.945152053 podStartE2EDuration="945.152053ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:13:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:08.944358581 +0000 UTC m=+65.866610758" watchObservedRunningTime="2026-07-13 07:13:08.945152053 +0000 UTC m=+65.867404225" Jul 13 07:13:09.397099 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.396961 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs\") pod \"network-metrics-daemon-nj87l\" (UID: \"1bdf96df-7918-4178-a8d0-04488841c04c\") " pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:13:09.397099 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.397089 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret\") pod \"global-pull-secret-syncer-jhvbm\" (UID: \"d3595a67-9572-42c0-a4f2-8ef34b5ab1e1\") " pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:13:09.400212 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.399940 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 13 07:13:09.400212 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.400195 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 13 07:13:09.412352 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.412183 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bdf96df-7918-4178-a8d0-04488841c04c-metrics-certs\") pod \"network-metrics-daemon-nj87l\" (UID: \"1bdf96df-7918-4178-a8d0-04488841c04c\") " pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:13:09.415388 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.415335 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3595a67-9572-42c0-a4f2-8ef34b5ab1e1-original-pull-secret\") pod \"global-pull-secret-syncer-jhvbm\" (UID: \"d3595a67-9572-42c0-a4f2-8ef34b5ab1e1\") " pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:13:09.498610 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.498150 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22qj5\" (UniqueName: \"kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5\") pod \"network-check-target-4t5nc\" (UID: \"b71e8d09-c0ee-4f33-a269-9c70833e43d4\") " pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:13:09.500960 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.500933 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 13 07:13:09.511412 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.511386 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 13 07:13:09.522676 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.522649 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22qj5\" (UniqueName: \"kubernetes.io/projected/b71e8d09-c0ee-4f33-a269-9c70833e43d4-kube-api-access-22qj5\") pod \"network-check-target-4t5nc\" (UID: \"b71e8d09-c0ee-4f33-a269-9c70833e43d4\") " pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:13:09.621382 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.621347 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:09.648395 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.648306 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-4492s\"" Jul 13 07:13:09.653101 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.653076 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jhvbm" Jul 13 07:13:09.656402 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.656349 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:13:09.662390 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.662371 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5sc2t\"" Jul 13 07:13:09.669609 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.669587 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nj87l" Jul 13 07:13:09.702392 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.702362 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:09.829357 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.829272 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:09.863835 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.863759 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nj87l"] Jul 13 07:13:09.874854 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:13:09.874820 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bdf96df_7918_4178_a8d0_04488841c04c.slice/crio-e7e3c9a8c096c6550d8b2869399b0da5d84a60fb30d881172de8dcb6e8879685 WatchSource:0}: Error finding container e7e3c9a8c096c6550d8b2869399b0da5d84a60fb30d881172de8dcb6e8879685: Status 404 returned error can't find the container with id e7e3c9a8c096c6550d8b2869399b0da5d84a60fb30d881172de8dcb6e8879685 Jul 13 07:13:09.884035 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.880108 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jhvbm"] Jul 13 07:13:09.905942 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.905916 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:09.921805 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.921777 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4t5nc"] Jul 13 07:13:09.926231 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:13:09.926204 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb71e8d09_c0ee_4f33_a269_9c70833e43d4.slice/crio-1b4367d197f5f680ced9cb44ab846d1992332d5bcca9705b6240c8d5cb7f4b5c WatchSource:0}: Error finding container 1b4367d197f5f680ced9cb44ab846d1992332d5bcca9705b6240c8d5cb7f4b5c: Status 404 returned error can't find the container with id 1b4367d197f5f680ced9cb44ab846d1992332d5bcca9705b6240c8d5cb7f4b5c Jul 13 07:13:09.938446 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.938401 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nj87l" event={"ID":"1bdf96df-7918-4178-a8d0-04488841c04c","Type":"ContainerStarted","Data":"e7e3c9a8c096c6550d8b2869399b0da5d84a60fb30d881172de8dcb6e8879685"} Jul 13 07:13:09.943598 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:09.943571 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jhvbm" event={"ID":"d3595a67-9572-42c0-a4f2-8ef34b5ab1e1","Type":"ContainerStarted","Data":"2f5561be1ad2b64a1843f251d01b5228c5e99057af9f4957e78d8c63ee62aeca"} Jul 13 07:13:10.062245 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:10.062205 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:10.171672 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:10.171570 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:10.270978 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:10.270940 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:10.949721 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:10.949689 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4t5nc" event={"ID":"b71e8d09-c0ee-4f33-a269-9c70833e43d4","Type":"ContainerStarted","Data":"1b4367d197f5f680ced9cb44ab846d1992332d5bcca9705b6240c8d5cb7f4b5c"} Jul 13 07:13:12.636753 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:12.636715 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:12.695109 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:12.695074 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:12.858609 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:12.858409 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:12.927081 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:12.926919 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:13.432981 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:13.432946 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:14.795560 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:14.795504 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:14.851985 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:14.851944 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:15.051933 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:15.051839 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:16.451542 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:16.451473 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:16.551592 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:16.551561 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:16.975961 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:16.975877 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" event={"ID":"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c","Type":"ContainerStarted","Data":"09b7dbd9508210c88f5c1ad1df9f0387589cb0e2599a2ae2e6e628e4aec1af61"} Jul 13 07:13:16.975961 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:16.975924 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" event={"ID":"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c","Type":"ContainerStarted","Data":"206587bde661f38e18a2f28f1d8f6e44a11e3898465afc040390998a7cd1d0c8"} Jul 13 07:13:16.975961 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:16.975940 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" event={"ID":"3f5f01da-a82a-41c4-9d9a-5b5563eacd9c","Type":"ContainerStarted","Data":"d59a08719d9b4cb21501b66238bc06cc130c774adf0176c99fd4e6f4ab699b05"} Jul 13 07:13:16.977184 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:16.977151 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8dfbbf54-ls9x7" event={"ID":"bdcf8caa-5777-419c-8fbb-5b5e2d844926","Type":"ContainerStarted","Data":"9a3b904016b103d08ff57427763708ffe28c5ae7414d1d2ee9e1d136ab5f659c"} Jul 13 07:13:16.978686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:16.978646 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jhvbm" event={"ID":"d3595a67-9572-42c0-a4f2-8ef34b5ab1e1","Type":"ContainerStarted","Data":"c3905c4b66043125e547930af3ccc85f360e788f48072095d46802cb4fcb534e"} Jul 13 07:13:16.980070 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:16.980050 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4t5nc" event={"ID":"b71e8d09-c0ee-4f33-a269-9c70833e43d4","Type":"ContainerStarted","Data":"42efb67b23e341b7716127723fd01849ad75dee310e3bafe1b50f652445bab98"} Jul 13 07:13:16.980175 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:16.980155 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:13:16.981951 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:16.981932 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nj87l" event={"ID":"1bdf96df-7918-4178-a8d0-04488841c04c","Type":"ContainerStarted","Data":"ec70b6f12c569df54ac09df63fa5612af501fbd15c4d2d7f1c328aea036de15e"} Jul 13 07:13:16.982023 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:16.981966 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nj87l" event={"ID":"1bdf96df-7918-4178-a8d0-04488841c04c","Type":"ContainerStarted","Data":"0886721ebffc1c2317e0878aea836322146936acd1c2e3e49d4cc3374dc18ba3"} Jul 13 07:13:16.993909 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:16.993870 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7577545f8b-6g9ws" podStartSLOduration=1.067086982 podStartE2EDuration="8.993858516s" totalImagesPullingTime="7.926771534s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:16.993070635 +0000 UTC m=+73.915322808" watchObservedRunningTime="2026-07-13 07:13:16.993858516 +0000 UTC m=+73.916110689" Jul 13 07:13:17.008594 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:17.008550 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jhvbm" podStartSLOduration=66.351501378 podStartE2EDuration="1m13.00853729s" totalImagesPullingTime="6.657035912s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:17.008242593 +0000 UTC m=+73.930494769" watchObservedRunningTime="2026-07-13 07:13:17.00853729 +0000 UTC m=+73.930789462" Jul 13 07:13:17.024290 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:17.024231 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b8dfbbf54-ls9x7" podStartSLOduration=2.038586128 podStartE2EDuration="9.024217743s" totalImagesPullingTime="6.985631615s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:13:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:17.023402719 +0000 UTC m=+73.945654894" watchObservedRunningTime="2026-07-13 07:13:17.024217743 +0000 UTC m=+73.946469988" Jul 13 07:13:17.038922 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:17.038884 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nj87l" podStartSLOduration=67.345825833 podStartE2EDuration="1m13.038873705s" totalImagesPullingTime="5.693047872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:17.038375683 +0000 UTC m=+73.960627872" watchObservedRunningTime="2026-07-13 07:13:17.038873705 +0000 UTC m=+73.961125925" Jul 13 07:13:17.057629 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:17.057594 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4t5nc" podStartSLOduration=66.434588454 podStartE2EDuration="1m13.057581561s" totalImagesPullingTime="6.622993107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:17.056617359 +0000 UTC m=+73.978869532" watchObservedRunningTime="2026-07-13 07:13:17.057581561 +0000 UTC m=+73.979833733" Jul 13 07:13:17.158158 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:17.158132 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:17.259377 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:17.259344 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:17.363116 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:17.363089 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:17.459214 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:17.459183 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:17.516131 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:17.516064 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:18.169041 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:18.169009 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:13:20.297441 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:20.297396 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:21.487016 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:21.486985 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:21.588311 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:21.588282 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:22.068570 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.068540 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:22.210857 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.210830 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:22.310328 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.310295 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:22.413349 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.413271 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:22.418838 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.418817 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9jl54"] Jul 13 07:13:22.421963 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.421945 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.424609 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.424585 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 13 07:13:22.424711 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.424647 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 13 07:13:22.424815 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.424797 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 13 07:13:22.424924 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.424593 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 13 07:13:22.425049 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.425032 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 13 07:13:22.425686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.425602 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 13 07:13:22.425768 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.425737 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ddsqx\"" Jul 13 07:13:22.497264 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.497222 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:22.499160 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.499139 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-metrics-client-ca\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.499241 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.499173 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-root\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.499241 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.499195 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-node-exporter-wtmp\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.499241 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.499215 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-node-exporter-textfile\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.499405 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.499310 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc6dc\" (UniqueName: \"kubernetes.io/projected/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-kube-api-access-rc6dc\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.499405 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.499364 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.499405 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.499396 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-node-exporter-accelerators-collector-config\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.499542 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.499431 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-node-exporter-tls\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.499542 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.499466 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-sys\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.600632 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.600607 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-node-exporter-tls\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.600735 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.600645 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-sys\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.600735 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.600672 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-metrics-client-ca\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.600735 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.600699 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-root\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.600735 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.600732 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-node-exporter-wtmp\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.600944 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:13:22.600738 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 13 07:13:22.600944 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.600757 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-node-exporter-textfile\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.600944 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.600801 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-root\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.600944 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:13:22.600810 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-node-exporter-tls podName:d6a06168-c3aa-4a3b-9a51-a6c4de07f375 nodeName:}" failed. No retries permitted until 2026-07-13 07:13:23.100790795 +0000 UTC m=+80.023042950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-node-exporter-tls") pod "node-exporter-9jl54" (UID: "d6a06168-c3aa-4a3b-9a51-a6c4de07f375") : secret "node-exporter-tls" not found Jul 13 07:13:22.600944 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.600734 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-sys\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.600944 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.600872 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-node-exporter-wtmp\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.600944 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.600886 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc6dc\" (UniqueName: \"kubernetes.io/projected/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-kube-api-access-rc6dc\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.600944 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.600919 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.601411 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.600958 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-node-exporter-accelerators-collector-config\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.601411 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.601139 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-node-exporter-textfile\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.601411 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.601400 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-node-exporter-accelerators-collector-config\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.601637 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.601618 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-metrics-client-ca\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.603307 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.603285 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.614987 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.614967 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc6dc\" (UniqueName: \"kubernetes.io/projected/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-kube-api-access-rc6dc\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:22.625376 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.625353 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:22.727202 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.727130 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:22.825484 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.825456 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:22.943394 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:22.943366 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:23.062052 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:23.062027 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:23.105038 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:23.105014 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-node-exporter-tls\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:23.107212 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:23.107188 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d6a06168-c3aa-4a3b-9a51-a6c4de07f375-node-exporter-tls\") pod \"node-exporter-9jl54\" (UID: \"d6a06168-c3aa-4a3b-9a51-a6c4de07f375\") " pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:23.329271 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:23.329191 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:23.333150 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:23.333130 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9jl54" Jul 13 07:13:23.342173 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:13:23.342151 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a06168_c3aa_4a3b_9a51_a6c4de07f375.slice/crio-f26229a9fecda79e48c9e59e4ddb27bb1818fc78dc832142401b1ecf78a66c42 WatchSource:0}: Error finding container f26229a9fecda79e48c9e59e4ddb27bb1818fc78dc832142401b1ecf78a66c42: Status 404 returned error can't find the container with id f26229a9fecda79e48c9e59e4ddb27bb1818fc78dc832142401b1ecf78a66c42 Jul 13 07:13:23.442840 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:23.442795 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:23.736370 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:23.736342 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:23.866638 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:23.866608 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:23.967299 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:23.967272 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:24.008871 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:24.008773 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9jl54" event={"ID":"d6a06168-c3aa-4a3b-9a51-a6c4de07f375","Type":"ContainerStarted","Data":"f26229a9fecda79e48c9e59e4ddb27bb1818fc78dc832142401b1ecf78a66c42"} Jul 13 07:13:25.013298 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:25.013206 2565 generic.go:356] "Generic (PLEG): container finished" podID="d6a06168-c3aa-4a3b-9a51-a6c4de07f375" containerID="bf94b0f50f8216d40496f8ca0f2775ce97731338ec95dc7e195eb5dde3e8a6ee" exitCode=0 Jul 13 07:13:25.013298 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:25.013286 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9jl54" event={"ID":"d6a06168-c3aa-4a3b-9a51-a6c4de07f375","Type":"ContainerDied","Data":"bf94b0f50f8216d40496f8ca0f2775ce97731338ec95dc7e195eb5dde3e8a6ee"} Jul 13 07:13:25.277293 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:25.277220 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:25.370594 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:25.370566 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:25.519434 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:25.519406 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:25.742911 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:25.742885 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:26.018127 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:26.018053 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9jl54" event={"ID":"d6a06168-c3aa-4a3b-9a51-a6c4de07f375","Type":"ContainerStarted","Data":"d3f233604dec375e8f5ec13676c8d92e1ace0d1f4e54f829588278f785df1731"} Jul 13 07:13:26.018127 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:26.018101 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9jl54" event={"ID":"d6a06168-c3aa-4a3b-9a51-a6c4de07f375","Type":"ContainerStarted","Data":"4ff6c6af99d60b38608d07a2d0271caebf7df375a31d367147a869b04a016fcd"} Jul 13 07:13:26.036846 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:26.036801 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9jl54" podStartSLOduration=3.000330622 podStartE2EDuration="4.036785353s" totalImagesPullingTime="972.294443ms" totalInitContainerRuntime="64.160288ms" isStatefulPod=true podCreationTimestamp="2026-07-13 07:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:13:26.035620115 +0000 UTC m=+82.957872288" watchObservedRunningTime="2026-07-13 07:13:26.036785353 +0000 UTC m=+82.959037526" Jul 13 07:13:26.155076 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:26.155049 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:26.206610 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:26.206580 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:26.442399 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:26.442305 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:26.494031 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:26.494002 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:27.065939 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:27.065904 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:27.163723 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:27.163694 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:27.441974 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:27.441868 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:28.618590 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:28.618553 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:29.947632 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:29.947608 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8495fd756d-br9vq" Jul 13 07:13:30.069419 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:30.069384 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:30.170530 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:30.170501 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:30.649848 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:30.649818 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:30.702072 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:30.702046 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:30.862641 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:30.862618 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:30.935814 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:30.935728 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:31.444078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:31.444034 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:33.183326 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:33.183251 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" podUID="ef6a14c6-4fc4-4e28-8727-5541519dcd4e" containerName="registry" containerID="cri-o://b4dfef3aad784521d1086eedd51a073241c8ef6a6a2836c263e088e234ab02bf" gracePeriod=30 Jul 13 07:13:33.954911 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:33.954884 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:13:34.045723 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.045693 2565 generic.go:356] "Generic (PLEG): container finished" podID="ef6a14c6-4fc4-4e28-8727-5541519dcd4e" containerID="b4dfef3aad784521d1086eedd51a073241c8ef6a6a2836c263e088e234ab02bf" exitCode=0 Jul 13 07:13:34.045846 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.045730 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" Jul 13 07:13:34.045846 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.045767 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" event={"ID":"ef6a14c6-4fc4-4e28-8727-5541519dcd4e","Type":"ContainerDied","Data":"b4dfef3aad784521d1086eedd51a073241c8ef6a6a2836c263e088e234ab02bf"} Jul 13 07:13:34.045846 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.045810 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-66d7c494cd-rsrkn" event={"ID":"ef6a14c6-4fc4-4e28-8727-5541519dcd4e","Type":"ContainerDied","Data":"670d27242984a4c4078cef1fdee6b610ebafc0cdd19e1d6fdeb041d5e198a978"} Jul 13 07:13:34.045846 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.045833 2565 scope.go:117] "RemoveContainer" containerID="b4dfef3aad784521d1086eedd51a073241c8ef6a6a2836c263e088e234ab02bf" Jul 13 07:13:34.059681 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.059664 2565 scope.go:117] "RemoveContainer" containerID="b4dfef3aad784521d1086eedd51a073241c8ef6a6a2836c263e088e234ab02bf" Jul 13 07:13:34.059936 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:13:34.059916 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4dfef3aad784521d1086eedd51a073241c8ef6a6a2836c263e088e234ab02bf\": container with ID starting with b4dfef3aad784521d1086eedd51a073241c8ef6a6a2836c263e088e234ab02bf not found: ID does not exist" containerID="b4dfef3aad784521d1086eedd51a073241c8ef6a6a2836c263e088e234ab02bf" Jul 13 07:13:34.060005 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.059950 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4dfef3aad784521d1086eedd51a073241c8ef6a6a2836c263e088e234ab02bf"} err="failed to get container status \"b4dfef3aad784521d1086eedd51a073241c8ef6a6a2836c263e088e234ab02bf\": rpc error: code = NotFound desc = could not find container \"b4dfef3aad784521d1086eedd51a073241c8ef6a6a2836c263e088e234ab02bf\": container with ID starting with b4dfef3aad784521d1086eedd51a073241c8ef6a6a2836c263e088e234ab02bf not found: ID does not exist" Jul 13 07:13:34.078199 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.078156 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psgpv\" (UniqueName: \"kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-kube-api-access-psgpv\") pod \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " Jul 13 07:13:34.078199 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.078184 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-image-registry-private-configuration\") pod \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " Jul 13 07:13:34.078298 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.078206 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-trusted-ca\") pod \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " Jul 13 07:13:34.078298 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.078265 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-installation-pull-secrets\") pod \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " Jul 13 07:13:34.078385 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.078333 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-ca-trust-extracted\") pod \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " Jul 13 07:13:34.078385 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.078365 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-certificates\") pod \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " Jul 13 07:13:34.078494 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.078389 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-bound-sa-token\") pod \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " Jul 13 07:13:34.078494 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.078420 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-tls\") pod \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\" (UID: \"ef6a14c6-4fc4-4e28-8727-5541519dcd4e\") " Jul 13 07:13:34.078766 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.078732 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ef6a14c6-4fc4-4e28-8727-5541519dcd4e" (UID: "ef6a14c6-4fc4-4e28-8727-5541519dcd4e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:13:34.078856 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.078765 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ef6a14c6-4fc4-4e28-8727-5541519dcd4e" (UID: "ef6a14c6-4fc4-4e28-8727-5541519dcd4e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:13:34.081029 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.081000 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ef6a14c6-4fc4-4e28-8727-5541519dcd4e" (UID: "ef6a14c6-4fc4-4e28-8727-5541519dcd4e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:13:34.081126 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.080997 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ef6a14c6-4fc4-4e28-8727-5541519dcd4e" (UID: "ef6a14c6-4fc4-4e28-8727-5541519dcd4e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:13:34.081126 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.081080 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-kube-api-access-psgpv" (OuterVolumeSpecName: "kube-api-access-psgpv") pod "ef6a14c6-4fc4-4e28-8727-5541519dcd4e" (UID: "ef6a14c6-4fc4-4e28-8727-5541519dcd4e"). InnerVolumeSpecName "kube-api-access-psgpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:13:34.081126 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.081103 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ef6a14c6-4fc4-4e28-8727-5541519dcd4e" (UID: "ef6a14c6-4fc4-4e28-8727-5541519dcd4e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:13:34.081260 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.081242 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ef6a14c6-4fc4-4e28-8727-5541519dcd4e" (UID: "ef6a14c6-4fc4-4e28-8727-5541519dcd4e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:13:34.086602 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.086581 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ef6a14c6-4fc4-4e28-8727-5541519dcd4e" (UID: "ef6a14c6-4fc4-4e28-8727-5541519dcd4e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:13:34.179710 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.179689 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-bound-sa-token\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:13:34.179710 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.179709 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-tls\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:13:34.179822 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.179717 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-psgpv\" (UniqueName: \"kubernetes.io/projected/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-kube-api-access-psgpv\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:13:34.179822 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.179728 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-image-registry-private-configuration\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:13:34.179822 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.179738 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-trusted-ca\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:13:34.179822 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.179746 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-installation-pull-secrets\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:13:34.179822 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.179753 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-ca-trust-extracted\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:13:34.179822 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.179761 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ef6a14c6-4fc4-4e28-8727-5541519dcd4e-registry-certificates\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:13:34.365959 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.365935 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-66d7c494cd-rsrkn"] Jul 13 07:13:34.369978 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:34.369953 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-66d7c494cd-rsrkn"] Jul 13 07:13:35.466037 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:35.466001 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:35.525715 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:35.525689 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:35.637998 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:35.637972 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef6a14c6-4fc4-4e28-8727-5541519dcd4e" path="/var/lib/kubelet/pods/ef6a14c6-4fc4-4e28-8727-5541519dcd4e/volumes" Jul 13 07:13:36.109416 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:36.109382 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:36.164127 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:36.164104 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:37.479382 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:37.479344 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:45.367652 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:45.367617 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:45.465428 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:45.465399 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:47.989019 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:47.988987 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4t5nc" Jul 13 07:13:55.208632 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:55.208586 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:13:55.298939 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:13:55.298908 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:14:00.664378 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:14:00.664338 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:14:00.737474 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:14:00.737438 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:14:07.857684 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:14:07.857645 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:14:07.957449 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:14:07.957421 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:14:08.058381 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:14:08.058346 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:14:35.468840 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:14:35.468802 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:14:38.480967 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:14:38.480929 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:14:38.581424 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:14:38.581372 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:14:50.432654 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:14:50.432606 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:14:50.493074 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:14:50.493037 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:14:55.389768 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:14:55.389685 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:14:55.445383 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:14:55.445355 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:15:00.648728 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:00.648691 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:15:00.749194 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:00.749157 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:15:06.601215 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:06.601176 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:15:07.159805 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:07.159772 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:15:07.259997 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:07.259958 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:15:49.187430 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:49.187396 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:15:49.248843 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:49.248812 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:15:54.915871 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:54.915831 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:15:55.004780 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:55.004737 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:15:55.557273 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:55.557240 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr"] Jul 13 07:15:55.557562 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:55.557545 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef6a14c6-4fc4-4e28-8727-5541519dcd4e" containerName="registry" Jul 13 07:15:55.557640 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:55.557564 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef6a14c6-4fc4-4e28-8727-5541519dcd4e" containerName="registry" Jul 13 07:15:55.557696 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:55.557649 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef6a14c6-4fc4-4e28-8727-5541519dcd4e" containerName="registry" Jul 13 07:15:55.560010 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:55.559984 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr" Jul 13 07:15:55.562363 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:55.562341 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 07:15:55.563568 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:55.563551 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 07:15:55.563658 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:55.563624 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gq2fm\"" Jul 13 07:15:55.568580 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:55.568560 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr"] Jul 13 07:15:55.724287 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:55.724249 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcs75\" (UniqueName: \"kubernetes.io/projected/9942563b-f16e-4bab-b85d-3f89753cb82b-kube-api-access-zcs75\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr\" (UID: \"9942563b-f16e-4bab-b85d-3f89753cb82b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr" Jul 13 07:15:55.724485 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:55.724333 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9942563b-f16e-4bab-b85d-3f89753cb82b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr\" (UID: \"9942563b-f16e-4bab-b85d-3f89753cb82b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr" Jul 13 07:15:55.724485 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:55.724357 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9942563b-f16e-4bab-b85d-3f89753cb82b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr\" (UID: \"9942563b-f16e-4bab-b85d-3f89753cb82b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr" Jul 13 07:15:55.825681 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:55.825602 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9942563b-f16e-4bab-b85d-3f89753cb82b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr\" (UID: \"9942563b-f16e-4bab-b85d-3f89753cb82b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr" Jul 13 07:15:55.825681 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:55.825639 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9942563b-f16e-4bab-b85d-3f89753cb82b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr\" (UID: \"9942563b-f16e-4bab-b85d-3f89753cb82b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr" Jul 13 07:15:55.825846 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:55.825697 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcs75\" (UniqueName: \"kubernetes.io/projected/9942563b-f16e-4bab-b85d-3f89753cb82b-kube-api-access-zcs75\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr\" (UID: \"9942563b-f16e-4bab-b85d-3f89753cb82b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr" Jul 13 07:15:55.826076 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:55.826050 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9942563b-f16e-4bab-b85d-3f89753cb82b-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr\" (UID: \"9942563b-f16e-4bab-b85d-3f89753cb82b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr" Jul 13 07:15:55.826152 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:55.826061 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9942563b-f16e-4bab-b85d-3f89753cb82b-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr\" (UID: \"9942563b-f16e-4bab-b85d-3f89753cb82b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr" Jul 13 07:15:55.834180 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:55.834151 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcs75\" (UniqueName: \"kubernetes.io/projected/9942563b-f16e-4bab-b85d-3f89753cb82b-kube-api-access-zcs75\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr\" (UID: \"9942563b-f16e-4bab-b85d-3f89753cb82b\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr" Jul 13 07:15:55.868769 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:55.868729 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr" Jul 13 07:15:55.991269 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:55.991239 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr"] Jul 13 07:15:55.994290 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:15:55.994257 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9942563b_f16e_4bab_b85d_3f89753cb82b.slice/crio-be00f02eb490490e066036a2aa140c89703779dc7410d775cb469e0361700dbd WatchSource:0}: Error finding container be00f02eb490490e066036a2aa140c89703779dc7410d775cb469e0361700dbd: Status 404 returned error can't find the container with id be00f02eb490490e066036a2aa140c89703779dc7410d775cb469e0361700dbd Jul 13 07:15:56.522955 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:15:56.522915 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr" event={"ID":"9942563b-f16e-4bab-b85d-3f89753cb82b","Type":"ContainerStarted","Data":"be00f02eb490490e066036a2aa140c89703779dc7410d775cb469e0361700dbd"} Jul 13 07:16:04.561639 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:04.561591 2565 generic.go:356] "Generic (PLEG): container finished" podID="9942563b-f16e-4bab-b85d-3f89753cb82b" containerID="029b21b2e1fd0a3ef445f9cefee4616dcbddf9660e1f773dad55a36fcf7297fb" exitCode=0 Jul 13 07:16:04.562006 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:04.561647 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr" event={"ID":"9942563b-f16e-4bab-b85d-3f89753cb82b","Type":"ContainerDied","Data":"029b21b2e1fd0a3ef445f9cefee4616dcbddf9660e1f773dad55a36fcf7297fb"} Jul 13 07:16:09.586001 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:09.585967 2565 generic.go:356] "Generic (PLEG): container finished" podID="9942563b-f16e-4bab-b85d-3f89753cb82b" containerID="a9eeae8c58ad809f30f8447a17a8d0755786523202b2bc22f6cbb88ff1002565" exitCode=0 Jul 13 07:16:09.586406 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:09.586032 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr" event={"ID":"9942563b-f16e-4bab-b85d-3f89753cb82b","Type":"ContainerDied","Data":"a9eeae8c58ad809f30f8447a17a8d0755786523202b2bc22f6cbb88ff1002565"} Jul 13 07:16:19.624483 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:19.624448 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr" event={"ID":"9942563b-f16e-4bab-b85d-3f89753cb82b","Type":"ContainerStarted","Data":"c99f87262c4bde784d33d4500757966048a407d0bc9fabfa2db7f78162f66cab"} Jul 13 07:16:19.642164 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:19.642107 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr" podStartSLOduration=2.995682056 podStartE2EDuration="24.642086377s" totalImagesPullingTime="21.646404321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:15:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:16:19.64079809 +0000 UTC m=+256.563050262" watchObservedRunningTime="2026-07-13 07:16:19.642086377 +0000 UTC m=+256.564338552" Jul 13 07:16:19.838628 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:19.838594 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:16:20.630146 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:20.630108 2565 generic.go:356] "Generic (PLEG): container finished" podID="9942563b-f16e-4bab-b85d-3f89753cb82b" containerID="c99f87262c4bde784d33d4500757966048a407d0bc9fabfa2db7f78162f66cab" exitCode=0 Jul 13 07:16:20.630622 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:20.630199 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr" event={"ID":"9942563b-f16e-4bab-b85d-3f89753cb82b","Type":"ContainerDied","Data":"c99f87262c4bde784d33d4500757966048a407d0bc9fabfa2db7f78162f66cab"} Jul 13 07:16:21.750302 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:21.750277 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr" Jul 13 07:16:21.818497 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:21.818455 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcs75\" (UniqueName: \"kubernetes.io/projected/9942563b-f16e-4bab-b85d-3f89753cb82b-kube-api-access-zcs75\") pod \"9942563b-f16e-4bab-b85d-3f89753cb82b\" (UID: \"9942563b-f16e-4bab-b85d-3f89753cb82b\") " Jul 13 07:16:21.818669 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:21.818530 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9942563b-f16e-4bab-b85d-3f89753cb82b-bundle\") pod \"9942563b-f16e-4bab-b85d-3f89753cb82b\" (UID: \"9942563b-f16e-4bab-b85d-3f89753cb82b\") " Jul 13 07:16:21.818669 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:21.818572 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9942563b-f16e-4bab-b85d-3f89753cb82b-util\") pod \"9942563b-f16e-4bab-b85d-3f89753cb82b\" (UID: \"9942563b-f16e-4bab-b85d-3f89753cb82b\") " Jul 13 07:16:21.819165 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:21.819129 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9942563b-f16e-4bab-b85d-3f89753cb82b-bundle" (OuterVolumeSpecName: "bundle") pod "9942563b-f16e-4bab-b85d-3f89753cb82b" (UID: "9942563b-f16e-4bab-b85d-3f89753cb82b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:16:21.820542 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:21.820512 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9942563b-f16e-4bab-b85d-3f89753cb82b-kube-api-access-zcs75" (OuterVolumeSpecName: "kube-api-access-zcs75") pod "9942563b-f16e-4bab-b85d-3f89753cb82b" (UID: "9942563b-f16e-4bab-b85d-3f89753cb82b"). InnerVolumeSpecName "kube-api-access-zcs75". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:16:21.823769 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:21.823676 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9942563b-f16e-4bab-b85d-3f89753cb82b-util" (OuterVolumeSpecName: "util") pod "9942563b-f16e-4bab-b85d-3f89753cb82b" (UID: "9942563b-f16e-4bab-b85d-3f89753cb82b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:16:21.919252 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:21.919149 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9942563b-f16e-4bab-b85d-3f89753cb82b-util\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:16:21.919252 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:21.919196 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcs75\" (UniqueName: \"kubernetes.io/projected/9942563b-f16e-4bab-b85d-3f89753cb82b-kube-api-access-zcs75\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:16:21.919252 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:21.919208 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9942563b-f16e-4bab-b85d-3f89753cb82b-bundle\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:16:22.638788 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:22.638753 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr" event={"ID":"9942563b-f16e-4bab-b85d-3f89753cb82b","Type":"ContainerDied","Data":"be00f02eb490490e066036a2aa140c89703779dc7410d775cb469e0361700dbd"} Jul 13 07:16:22.638951 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:22.638796 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be00f02eb490490e066036a2aa140c89703779dc7410d775cb469e0361700dbd" Jul 13 07:16:22.638951 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:22.638770 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540gc4zr" Jul 13 07:16:26.884820 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:26.884712 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:16:28.242031 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:28.241996 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:16:30.486155 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:30.486123 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:16:30.587383 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:30.587348 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:16:32.782702 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:32.782671 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:16:32.878570 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:32.878536 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:16:33.217426 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:33.217342 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:16:33.348371 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:33.348335 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:16:33.816303 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:33.816270 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm"] Jul 13 07:16:33.816671 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:33.816507 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9942563b-f16e-4bab-b85d-3f89753cb82b" containerName="pull" Jul 13 07:16:33.816671 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:33.816518 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9942563b-f16e-4bab-b85d-3f89753cb82b" containerName="pull" Jul 13 07:16:33.816671 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:33.816526 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9942563b-f16e-4bab-b85d-3f89753cb82b" containerName="extract" Jul 13 07:16:33.816671 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:33.816532 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9942563b-f16e-4bab-b85d-3f89753cb82b" containerName="extract" Jul 13 07:16:33.816671 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:33.816545 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9942563b-f16e-4bab-b85d-3f89753cb82b" containerName="util" Jul 13 07:16:33.816671 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:33.816550 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9942563b-f16e-4bab-b85d-3f89753cb82b" containerName="util" Jul 13 07:16:33.816671 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:33.816598 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9942563b-f16e-4bab-b85d-3f89753cb82b" containerName="extract" Jul 13 07:16:33.818482 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:33.818466 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm" Jul 13 07:16:33.821115 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:33.821088 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gq2fm\"" Jul 13 07:16:33.821115 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:33.821107 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 07:16:33.821293 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:33.821109 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 07:16:33.828976 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:33.828951 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm"] Jul 13 07:16:33.899247 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:33.899208 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk5rx\" (UniqueName: \"kubernetes.io/projected/3ad05065-0bff-49f6-adb7-4c0077c5496d-kube-api-access-nk5rx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm\" (UID: \"3ad05065-0bff-49f6-adb7-4c0077c5496d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm" Jul 13 07:16:33.899452 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:33.899260 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ad05065-0bff-49f6-adb7-4c0077c5496d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm\" (UID: \"3ad05065-0bff-49f6-adb7-4c0077c5496d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm" Jul 13 07:16:33.899452 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:33.899350 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ad05065-0bff-49f6-adb7-4c0077c5496d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm\" (UID: \"3ad05065-0bff-49f6-adb7-4c0077c5496d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm" Jul 13 07:16:34.000265 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:34.000237 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk5rx\" (UniqueName: \"kubernetes.io/projected/3ad05065-0bff-49f6-adb7-4c0077c5496d-kube-api-access-nk5rx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm\" (UID: \"3ad05065-0bff-49f6-adb7-4c0077c5496d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm" Jul 13 07:16:34.000426 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:34.000278 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ad05065-0bff-49f6-adb7-4c0077c5496d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm\" (UID: \"3ad05065-0bff-49f6-adb7-4c0077c5496d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm" Jul 13 07:16:34.000426 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:34.000333 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ad05065-0bff-49f6-adb7-4c0077c5496d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm\" (UID: \"3ad05065-0bff-49f6-adb7-4c0077c5496d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm" Jul 13 07:16:34.000735 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:34.000713 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ad05065-0bff-49f6-adb7-4c0077c5496d-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm\" (UID: \"3ad05065-0bff-49f6-adb7-4c0077c5496d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm" Jul 13 07:16:34.000772 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:34.000724 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ad05065-0bff-49f6-adb7-4c0077c5496d-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm\" (UID: \"3ad05065-0bff-49f6-adb7-4c0077c5496d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm" Jul 13 07:16:34.010538 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:34.010504 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk5rx\" (UniqueName: \"kubernetes.io/projected/3ad05065-0bff-49f6-adb7-4c0077c5496d-kube-api-access-nk5rx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm\" (UID: \"3ad05065-0bff-49f6-adb7-4c0077c5496d\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm" Jul 13 07:16:34.127411 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:34.127311 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm" Jul 13 07:16:34.265181 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:34.265144 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm"] Jul 13 07:16:34.267636 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:16:34.267608 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ad05065_0bff_49f6_adb7_4c0077c5496d.slice/crio-5796dc1a959c4bd788f9a457caaec50be4283a1d1f009a456f358f0f32f67987 WatchSource:0}: Error finding container 5796dc1a959c4bd788f9a457caaec50be4283a1d1f009a456f358f0f32f67987: Status 404 returned error can't find the container with id 5796dc1a959c4bd788f9a457caaec50be4283a1d1f009a456f358f0f32f67987 Jul 13 07:16:34.676065 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:34.676025 2565 generic.go:356] "Generic (PLEG): container finished" podID="3ad05065-0bff-49f6-adb7-4c0077c5496d" containerID="a7d8c349f1817b493eb4ddcc8e0959a3f17fb445558372a555f2f2e52ccca5ce" exitCode=0 Jul 13 07:16:34.676247 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:34.676082 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm" event={"ID":"3ad05065-0bff-49f6-adb7-4c0077c5496d","Type":"ContainerDied","Data":"a7d8c349f1817b493eb4ddcc8e0959a3f17fb445558372a555f2f2e52ccca5ce"} Jul 13 07:16:34.676247 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:34.676115 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm" event={"ID":"3ad05065-0bff-49f6-adb7-4c0077c5496d","Type":"ContainerStarted","Data":"5796dc1a959c4bd788f9a457caaec50be4283a1d1f009a456f358f0f32f67987"} Jul 13 07:16:34.981215 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:34.981131 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:16:35.375732 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:35.375695 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:16:36.684431 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:36.684335 2565 generic.go:356] "Generic (PLEG): container finished" podID="3ad05065-0bff-49f6-adb7-4c0077c5496d" containerID="7dab0e624b0e1eba2d572e3dc34913166d97d35a8833b47da749ff1c67934c75" exitCode=0 Jul 13 07:16:36.684431 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:36.684419 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm" event={"ID":"3ad05065-0bff-49f6-adb7-4c0077c5496d","Type":"ContainerDied","Data":"7dab0e624b0e1eba2d572e3dc34913166d97d35a8833b47da749ff1c67934c75"} Jul 13 07:16:37.256646 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:37.256609 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:16:37.357881 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:37.357846 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:16:37.690228 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:37.690142 2565 generic.go:356] "Generic (PLEG): container finished" podID="3ad05065-0bff-49f6-adb7-4c0077c5496d" containerID="09016e6c9bc98022ea547391cd36d9557ee27686355ec0868846298d70f6f4ca" exitCode=0 Jul 13 07:16:37.690228 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:37.690203 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm" event={"ID":"3ad05065-0bff-49f6-adb7-4c0077c5496d","Type":"ContainerDied","Data":"09016e6c9bc98022ea547391cd36d9557ee27686355ec0868846298d70f6f4ca"} Jul 13 07:16:38.810626 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:38.810600 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm" Jul 13 07:16:38.834029 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:38.834004 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nk5rx\" (UniqueName: \"kubernetes.io/projected/3ad05065-0bff-49f6-adb7-4c0077c5496d-kube-api-access-nk5rx\") pod \"3ad05065-0bff-49f6-adb7-4c0077c5496d\" (UID: \"3ad05065-0bff-49f6-adb7-4c0077c5496d\") " Jul 13 07:16:38.834155 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:38.834056 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ad05065-0bff-49f6-adb7-4c0077c5496d-util\") pod \"3ad05065-0bff-49f6-adb7-4c0077c5496d\" (UID: \"3ad05065-0bff-49f6-adb7-4c0077c5496d\") " Jul 13 07:16:38.834155 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:38.834102 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ad05065-0bff-49f6-adb7-4c0077c5496d-bundle\") pod \"3ad05065-0bff-49f6-adb7-4c0077c5496d\" (UID: \"3ad05065-0bff-49f6-adb7-4c0077c5496d\") " Jul 13 07:16:38.834493 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:38.834466 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ad05065-0bff-49f6-adb7-4c0077c5496d-bundle" (OuterVolumeSpecName: "bundle") pod "3ad05065-0bff-49f6-adb7-4c0077c5496d" (UID: "3ad05065-0bff-49f6-adb7-4c0077c5496d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:16:38.836109 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:38.836080 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ad05065-0bff-49f6-adb7-4c0077c5496d-kube-api-access-nk5rx" (OuterVolumeSpecName: "kube-api-access-nk5rx") pod "3ad05065-0bff-49f6-adb7-4c0077c5496d" (UID: "3ad05065-0bff-49f6-adb7-4c0077c5496d"). InnerVolumeSpecName "kube-api-access-nk5rx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:16:38.840241 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:38.840216 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3ad05065-0bff-49f6-adb7-4c0077c5496d-util" (OuterVolumeSpecName: "util") pod "3ad05065-0bff-49f6-adb7-4c0077c5496d" (UID: "3ad05065-0bff-49f6-adb7-4c0077c5496d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:16:38.934925 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:38.934885 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3ad05065-0bff-49f6-adb7-4c0077c5496d-bundle\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:16:38.934925 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:38.934917 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nk5rx\" (UniqueName: \"kubernetes.io/projected/3ad05065-0bff-49f6-adb7-4c0077c5496d-kube-api-access-nk5rx\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:16:38.934925 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:38.934930 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3ad05065-0bff-49f6-adb7-4c0077c5496d-util\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:16:39.699039 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:39.699000 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm" event={"ID":"3ad05065-0bff-49f6-adb7-4c0077c5496d","Type":"ContainerDied","Data":"5796dc1a959c4bd788f9a457caaec50be4283a1d1f009a456f358f0f32f67987"} Jul 13 07:16:39.699192 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:39.699049 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5796dc1a959c4bd788f9a457caaec50be4283a1d1f009a456f358f0f32f67987" Jul 13 07:16:39.699192 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:39.699014 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f422jm" Jul 13 07:16:41.698148 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:41.698115 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:16:41.799547 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:41.799515 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:16:42.074105 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:42.074073 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:16:42.178589 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:42.178548 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:16:43.622879 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:43.622848 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:16:45.913444 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:45.913412 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-66nsx"] Jul 13 07:16:45.913816 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:45.913637 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ad05065-0bff-49f6-adb7-4c0077c5496d" containerName="extract" Jul 13 07:16:45.913816 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:45.913648 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ad05065-0bff-49f6-adb7-4c0077c5496d" containerName="extract" Jul 13 07:16:45.913816 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:45.913662 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ad05065-0bff-49f6-adb7-4c0077c5496d" containerName="pull" Jul 13 07:16:45.913816 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:45.913668 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ad05065-0bff-49f6-adb7-4c0077c5496d" containerName="pull" Jul 13 07:16:45.913816 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:45.913677 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ad05065-0bff-49f6-adb7-4c0077c5496d" containerName="util" Jul 13 07:16:45.913816 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:45.913682 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ad05065-0bff-49f6-adb7-4c0077c5496d" containerName="util" Jul 13 07:16:45.913816 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:45.913723 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ad05065-0bff-49f6-adb7-4c0077c5496d" containerName="extract" Jul 13 07:16:45.915686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:45.915669 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-66nsx" Jul 13 07:16:45.918164 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:45.918140 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 13 07:16:45.919186 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:45.919166 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 13 07:16:45.919262 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:45.919184 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-v7hp6\"" Jul 13 07:16:45.925766 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:45.925740 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-66nsx"] Jul 13 07:16:45.985554 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:45.985520 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwnhn\" (UniqueName: \"kubernetes.io/projected/61ad150d-2cf1-44ec-9004-1ddb5698de05-kube-api-access-pwnhn\") pod \"cert-manager-55b4d954d5-66nsx\" (UID: \"61ad150d-2cf1-44ec-9004-1ddb5698de05\") " pod="cert-manager/cert-manager-55b4d954d5-66nsx" Jul 13 07:16:45.985714 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:45.985595 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61ad150d-2cf1-44ec-9004-1ddb5698de05-bound-sa-token\") pod \"cert-manager-55b4d954d5-66nsx\" (UID: \"61ad150d-2cf1-44ec-9004-1ddb5698de05\") " pod="cert-manager/cert-manager-55b4d954d5-66nsx" Jul 13 07:16:46.086754 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:46.086716 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61ad150d-2cf1-44ec-9004-1ddb5698de05-bound-sa-token\") pod \"cert-manager-55b4d954d5-66nsx\" (UID: \"61ad150d-2cf1-44ec-9004-1ddb5698de05\") " pod="cert-manager/cert-manager-55b4d954d5-66nsx" Jul 13 07:16:46.086934 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:46.086762 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwnhn\" (UniqueName: \"kubernetes.io/projected/61ad150d-2cf1-44ec-9004-1ddb5698de05-kube-api-access-pwnhn\") pod \"cert-manager-55b4d954d5-66nsx\" (UID: \"61ad150d-2cf1-44ec-9004-1ddb5698de05\") " pod="cert-manager/cert-manager-55b4d954d5-66nsx" Jul 13 07:16:46.099008 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:46.098977 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwnhn\" (UniqueName: \"kubernetes.io/projected/61ad150d-2cf1-44ec-9004-1ddb5698de05-kube-api-access-pwnhn\") pod \"cert-manager-55b4d954d5-66nsx\" (UID: \"61ad150d-2cf1-44ec-9004-1ddb5698de05\") " pod="cert-manager/cert-manager-55b4d954d5-66nsx" Jul 13 07:16:46.099231 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:46.099209 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61ad150d-2cf1-44ec-9004-1ddb5698de05-bound-sa-token\") pod \"cert-manager-55b4d954d5-66nsx\" (UID: \"61ad150d-2cf1-44ec-9004-1ddb5698de05\") " pod="cert-manager/cert-manager-55b4d954d5-66nsx" Jul 13 07:16:46.224614 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:46.224521 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-66nsx" Jul 13 07:16:46.346807 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:46.346778 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-66nsx"] Jul 13 07:16:46.350119 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:16:46.350094 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61ad150d_2cf1_44ec_9004_1ddb5698de05.slice/crio-19119c00a33969e93633a551b3e7bf64e7127ff1076efb80ecea57e38d6288e4 WatchSource:0}: Error finding container 19119c00a33969e93633a551b3e7bf64e7127ff1076efb80ecea57e38d6288e4: Status 404 returned error can't find the container with id 19119c00a33969e93633a551b3e7bf64e7127ff1076efb80ecea57e38d6288e4 Jul 13 07:16:46.723466 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:46.723426 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-66nsx" event={"ID":"61ad150d-2cf1-44ec-9004-1ddb5698de05","Type":"ContainerStarted","Data":"19119c00a33969e93633a551b3e7bf64e7127ff1076efb80ecea57e38d6288e4"} Jul 13 07:16:48.043468 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:48.043432 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:16:48.150266 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:48.150225 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:16:48.732255 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:48.732213 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-66nsx" event={"ID":"61ad150d-2cf1-44ec-9004-1ddb5698de05","Type":"ContainerStarted","Data":"b39909590f86c5232609d8e9084ed6359452add8d44385f4f2767e540c7cb5f3"} Jul 13 07:16:50.141580 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.141523 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-66nsx" podStartSLOduration=2.855321709 podStartE2EDuration="5.141506023s" totalImagesPullingTime="2.286184314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:16:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:16:48.748291562 +0000 UTC m=+285.670543735" watchObservedRunningTime="2026-07-13 07:16:50.141506023 +0000 UTC m=+287.063758196" Jul 13 07:16:50.141991 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.141640 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85"] Jul 13 07:16:50.143794 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.143778 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85" Jul 13 07:16:50.146224 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.146202 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 13 07:16:50.146300 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.146244 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 13 07:16:50.146300 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.146268 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gq2fm\"" Jul 13 07:16:50.152473 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.152446 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85"] Jul 13 07:16:50.218976 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.218940 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqmxj\" (UniqueName: \"kubernetes.io/projected/6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf-kube-api-access-mqmxj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85\" (UID: \"6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85" Jul 13 07:16:50.219141 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.218988 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85\" (UID: \"6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85" Jul 13 07:16:50.219141 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.219049 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85\" (UID: \"6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85" Jul 13 07:16:50.320325 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.320287 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqmxj\" (UniqueName: \"kubernetes.io/projected/6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf-kube-api-access-mqmxj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85\" (UID: \"6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85" Jul 13 07:16:50.320436 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.320389 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85\" (UID: \"6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85" Jul 13 07:16:50.320436 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.320427 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85\" (UID: \"6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85" Jul 13 07:16:50.320818 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.320796 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85\" (UID: \"6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85" Jul 13 07:16:50.320861 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.320821 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85\" (UID: \"6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85" Jul 13 07:16:50.328956 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.328921 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqmxj\" (UniqueName: \"kubernetes.io/projected/6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf-kube-api-access-mqmxj\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85\" (UID: \"6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85" Jul 13 07:16:50.401923 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.401838 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:16:50.453034 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.452996 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85" Jul 13 07:16:50.575460 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.575430 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85"] Jul 13 07:16:50.578452 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:16:50.578419 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f5d3f8b_e94a_43e6_b692_26b9f7a5b6cf.slice/crio-eaa7cfbc90645ab583f1fbb12217888362cdd5e558895a02cfeaa110e119cc71 WatchSource:0}: Error finding container eaa7cfbc90645ab583f1fbb12217888362cdd5e558895a02cfeaa110e119cc71: Status 404 returned error can't find the container with id eaa7cfbc90645ab583f1fbb12217888362cdd5e558895a02cfeaa110e119cc71 Jul 13 07:16:50.740203 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.740171 2565 generic.go:356] "Generic (PLEG): container finished" podID="6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf" containerID="2b86400858292769f966414fc8b33cb24825d9c8f4f00b7cf3c34026d557075b" exitCode=0 Jul 13 07:16:50.740369 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.740234 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85" event={"ID":"6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf","Type":"ContainerDied","Data":"2b86400858292769f966414fc8b33cb24825d9c8f4f00b7cf3c34026d557075b"} Jul 13 07:16:50.740369 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:50.740284 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85" event={"ID":"6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf","Type":"ContainerStarted","Data":"eaa7cfbc90645ab583f1fbb12217888362cdd5e558895a02cfeaa110e119cc71"} Jul 13 07:16:52.750009 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:52.749975 2565 generic.go:356] "Generic (PLEG): container finished" podID="6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf" containerID="86446b9ba5c8e4e2c2088dce3ed8d1596060608ce4875309e52d339ba7614da3" exitCode=0 Jul 13 07:16:52.750418 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:52.750061 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85" event={"ID":"6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf","Type":"ContainerDied","Data":"86446b9ba5c8e4e2c2088dce3ed8d1596060608ce4875309e52d339ba7614da3"} Jul 13 07:16:53.755111 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:53.755080 2565 generic.go:356] "Generic (PLEG): container finished" podID="6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf" containerID="1eb6cbdeb2da94ea03155ec9486c5d7adacb0f897b5a4a9c23a09aef1610a387" exitCode=0 Jul 13 07:16:53.755504 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:53.755161 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85" event={"ID":"6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf","Type":"ContainerDied","Data":"1eb6cbdeb2da94ea03155ec9486c5d7adacb0f897b5a4a9c23a09aef1610a387"} Jul 13 07:16:54.892064 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:54.892036 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85" Jul 13 07:16:54.954992 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:54.954957 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqmxj\" (UniqueName: \"kubernetes.io/projected/6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf-kube-api-access-mqmxj\") pod \"6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf\" (UID: \"6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf\") " Jul 13 07:16:54.955151 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:54.955007 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf-bundle\") pod \"6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf\" (UID: \"6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf\") " Jul 13 07:16:54.955151 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:54.955041 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf-util\") pod \"6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf\" (UID: \"6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf\") " Jul 13 07:16:54.955939 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:54.955909 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf-bundle" (OuterVolumeSpecName: "bundle") pod "6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf" (UID: "6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:16:54.957098 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:54.957070 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf-kube-api-access-mqmxj" (OuterVolumeSpecName: "kube-api-access-mqmxj") pod "6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf" (UID: "6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf"). InnerVolumeSpecName "kube-api-access-mqmxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:16:54.963746 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:54.963704 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf-util" (OuterVolumeSpecName: "util") pod "6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf" (UID: "6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:16:55.055759 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:55.055679 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf-bundle\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:16:55.055759 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:55.055708 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf-util\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:16:55.055759 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:55.055717 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqmxj\" (UniqueName: \"kubernetes.io/projected/6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf-kube-api-access-mqmxj\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:16:55.764010 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:55.763975 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85" event={"ID":"6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf","Type":"ContainerDied","Data":"eaa7cfbc90645ab583f1fbb12217888362cdd5e558895a02cfeaa110e119cc71"} Jul 13 07:16:55.764168 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:55.764028 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eaa7cfbc90645ab583f1fbb12217888362cdd5e558895a02cfeaa110e119cc71" Jul 13 07:16:55.764168 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:16:55.763990 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affgq85" Jul 13 07:17:01.919549 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:01.919515 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:02.835303 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:02.835273 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2"] Jul 13 07:17:02.835532 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:02.835520 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf" containerName="util" Jul 13 07:17:02.835575 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:02.835534 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf" containerName="util" Jul 13 07:17:02.835575 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:02.835546 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf" containerName="pull" Jul 13 07:17:02.835575 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:02.835551 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf" containerName="pull" Jul 13 07:17:02.835575 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:02.835560 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf" containerName="extract" Jul 13 07:17:02.835575 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:02.835566 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf" containerName="extract" Jul 13 07:17:02.835720 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:02.835605 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f5d3f8b-e94a-43e6-b692-26b9f7a5b6cf" containerName="extract" Jul 13 07:17:02.837716 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:02.837701 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" Jul 13 07:17:02.840529 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:02.840508 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 13 07:17:02.840771 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:02.840756 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-bfvgg\"" Jul 13 07:17:02.840771 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:02.840761 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 13 07:17:02.841220 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:02.841203 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 13 07:17:02.841465 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:02.841444 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 13 07:17:02.854612 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:02.854591 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2"] Jul 13 07:17:02.909132 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:02.909096 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fb118592-97c7-43d9-8798-a99200ad855c-manifests\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-l7hc2\" (UID: \"fb118592-97c7-43d9-8798-a99200ad855c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" Jul 13 07:17:02.909132 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:02.909128 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb118592-97c7-43d9-8798-a99200ad855c-tmp\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-l7hc2\" (UID: \"fb118592-97c7-43d9-8798-a99200ad855c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" Jul 13 07:17:02.909356 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:02.909153 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcf88\" (UniqueName: \"kubernetes.io/projected/fb118592-97c7-43d9-8798-a99200ad855c-kube-api-access-zcf88\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-l7hc2\" (UID: \"fb118592-97c7-43d9-8798-a99200ad855c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" Jul 13 07:17:02.909356 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:02.909237 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fb118592-97c7-43d9-8798-a99200ad855c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-l7hc2\" (UID: \"fb118592-97c7-43d9-8798-a99200ad855c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" Jul 13 07:17:02.909356 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:02.909281 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb118592-97c7-43d9-8798-a99200ad855c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-l7hc2\" (UID: \"fb118592-97c7-43d9-8798-a99200ad855c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" Jul 13 07:17:03.010584 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:03.010534 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fb118592-97c7-43d9-8798-a99200ad855c-manifests\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-l7hc2\" (UID: \"fb118592-97c7-43d9-8798-a99200ad855c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" Jul 13 07:17:03.010584 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:03.010588 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb118592-97c7-43d9-8798-a99200ad855c-tmp\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-l7hc2\" (UID: \"fb118592-97c7-43d9-8798-a99200ad855c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" Jul 13 07:17:03.011047 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:03.010628 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcf88\" (UniqueName: \"kubernetes.io/projected/fb118592-97c7-43d9-8798-a99200ad855c-kube-api-access-zcf88\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-l7hc2\" (UID: \"fb118592-97c7-43d9-8798-a99200ad855c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" Jul 13 07:17:03.011047 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:03.010651 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fb118592-97c7-43d9-8798-a99200ad855c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-l7hc2\" (UID: \"fb118592-97c7-43d9-8798-a99200ad855c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" Jul 13 07:17:03.011047 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:03.010676 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb118592-97c7-43d9-8798-a99200ad855c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-l7hc2\" (UID: \"fb118592-97c7-43d9-8798-a99200ad855c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" Jul 13 07:17:03.011047 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:03.010952 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fb118592-97c7-43d9-8798-a99200ad855c-manifests\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-l7hc2\" (UID: \"fb118592-97c7-43d9-8798-a99200ad855c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" Jul 13 07:17:03.012973 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:03.012944 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fb118592-97c7-43d9-8798-a99200ad855c-tmp\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-l7hc2\" (UID: \"fb118592-97c7-43d9-8798-a99200ad855c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" Jul 13 07:17:03.013215 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:03.013195 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fb118592-97c7-43d9-8798-a99200ad855c-webhook-cert\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-l7hc2\" (UID: \"fb118592-97c7-43d9-8798-a99200ad855c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" Jul 13 07:17:03.013284 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:03.013195 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fb118592-97c7-43d9-8798-a99200ad855c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-l7hc2\" (UID: \"fb118592-97c7-43d9-8798-a99200ad855c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" Jul 13 07:17:03.019771 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:03.019751 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcf88\" (UniqueName: \"kubernetes.io/projected/fb118592-97c7-43d9-8798-a99200ad855c-kube-api-access-zcf88\") pod \"opendatahub-operator-controller-manager-5b4d7c976f-l7hc2\" (UID: \"fb118592-97c7-43d9-8798-a99200ad855c\") " pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" Jul 13 07:17:03.111885 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:03.111801 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:03.147327 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:03.147298 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" Jul 13 07:17:03.213162 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:03.213131 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:03.291984 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:03.291933 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:03.305230 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:03.305203 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2"] Jul 13 07:17:03.308308 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:17:03.308281 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb118592_97c7_43d9_8798_a99200ad855c.slice/crio-53df789b5b38113967bd779348ebdc153fffb7e353fbe2688baeb86ad7031b66 WatchSource:0}: Error finding container 53df789b5b38113967bd779348ebdc153fffb7e353fbe2688baeb86ad7031b66: Status 404 returned error can't find the container with id 53df789b5b38113967bd779348ebdc153fffb7e353fbe2688baeb86ad7031b66 Jul 13 07:17:03.363502 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:03.363444 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:03.474818 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:03.474791 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 13 07:17:03.487837 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:03.487804 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:03.615865 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:03.615757 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:03.793011 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:03.792970 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" event={"ID":"fb118592-97c7-43d9-8798-a99200ad855c","Type":"ContainerStarted","Data":"53df789b5b38113967bd779348ebdc153fffb7e353fbe2688baeb86ad7031b66"} Jul 13 07:17:06.809691 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:06.809653 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" event={"ID":"fb118592-97c7-43d9-8798-a99200ad855c","Type":"ContainerStarted","Data":"38cc733981ab9c160a3f40e2f6644a32dc8207cb8dcc50b0382ee3e7db2756de"} Jul 13 07:17:07.814455 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:07.814423 2565 generic.go:356] "Generic (PLEG): container finished" podID="fb118592-97c7-43d9-8798-a99200ad855c" containerID="38cc733981ab9c160a3f40e2f6644a32dc8207cb8dcc50b0382ee3e7db2756de" exitCode=0 Jul 13 07:17:07.814824 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:07.814507 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" event={"ID":"fb118592-97c7-43d9-8798-a99200ad855c","Type":"ContainerDied","Data":"38cc733981ab9c160a3f40e2f6644a32dc8207cb8dcc50b0382ee3e7db2756de"} Jul 13 07:17:07.814969 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:07.814955 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 07:17:08.820932 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:08.820894 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" event={"ID":"fb118592-97c7-43d9-8798-a99200ad855c","Type":"ContainerStarted","Data":"88d4364c9ad5e6b2feea92d2e974f312f24e4b60337d6f2b269943b10a3922f5"} Jul 13 07:17:08.821378 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:08.821036 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" Jul 13 07:17:08.845674 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:08.845628 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" podStartSLOduration=2.441602423 podStartE2EDuration="6.845613635s" totalImagesPullingTime="3.398846114s" totalInitContainerRuntime="1.005165098s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:17:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:17:08.843525204 +0000 UTC m=+305.765777377" watchObservedRunningTime="2026-07-13 07:17:08.845613635 +0000 UTC m=+305.767865807" Jul 13 07:17:19.518486 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:19.518449 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:19.617451 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:19.617416 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:19.827064 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:19.826980 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5b4d7c976f-l7hc2" Jul 13 07:17:22.254445 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:22.254416 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:22.417572 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:22.417540 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:23.054861 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.054824 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sngbb"] Jul 13 07:17:23.062758 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.062730 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-sngbb" Jul 13 07:17:23.066259 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.066232 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 13 07:17:23.073812 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.073793 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4t76d\"" Jul 13 07:17:23.083395 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.083372 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sngbb"] Jul 13 07:17:23.108407 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.108364 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:23.168905 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.168859 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab07d64c-e94f-4a2b-bf28-16e619440df2-cert\") pod \"odh-model-controller-7998c67dc4-sngbb\" (UID: \"ab07d64c-e94f-4a2b-bf28-16e619440df2\") " pod="opendatahub/odh-model-controller-7998c67dc4-sngbb" Jul 13 07:17:23.169090 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.168914 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7b7c\" (UniqueName: \"kubernetes.io/projected/ab07d64c-e94f-4a2b-bf28-16e619440df2-kube-api-access-l7b7c\") pod \"odh-model-controller-7998c67dc4-sngbb\" (UID: \"ab07d64c-e94f-4a2b-bf28-16e619440df2\") " pod="opendatahub/odh-model-controller-7998c67dc4-sngbb" Jul 13 07:17:23.213457 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.213409 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:23.270079 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.270043 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab07d64c-e94f-4a2b-bf28-16e619440df2-cert\") pod \"odh-model-controller-7998c67dc4-sngbb\" (UID: \"ab07d64c-e94f-4a2b-bf28-16e619440df2\") " pod="opendatahub/odh-model-controller-7998c67dc4-sngbb" Jul 13 07:17:23.270079 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.270081 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7b7c\" (UniqueName: \"kubernetes.io/projected/ab07d64c-e94f-4a2b-bf28-16e619440df2-kube-api-access-l7b7c\") pod \"odh-model-controller-7998c67dc4-sngbb\" (UID: \"ab07d64c-e94f-4a2b-bf28-16e619440df2\") " pod="opendatahub/odh-model-controller-7998c67dc4-sngbb" Jul 13 07:17:23.270620 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:17:23.270213 2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 13 07:17:23.270620 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:17:23.270297 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab07d64c-e94f-4a2b-bf28-16e619440df2-cert podName:ab07d64c-e94f-4a2b-bf28-16e619440df2 nodeName:}" failed. No retries permitted until 2026-07-13 07:17:23.770270592 +0000 UTC m=+320.692522745 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ab07d64c-e94f-4a2b-bf28-16e619440df2-cert") pod "odh-model-controller-7998c67dc4-sngbb" (UID: "ab07d64c-e94f-4a2b-bf28-16e619440df2") : secret "odh-model-controller-webhook-cert" not found Jul 13 07:17:23.281597 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.281571 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7b7c\" (UniqueName: \"kubernetes.io/projected/ab07d64c-e94f-4a2b-bf28-16e619440df2-kube-api-access-l7b7c\") pod \"odh-model-controller-7998c67dc4-sngbb\" (UID: \"ab07d64c-e94f-4a2b-bf28-16e619440df2\") " pod="opendatahub/odh-model-controller-7998c67dc4-sngbb" Jul 13 07:17:23.314087 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.313991 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:23.466328 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.466292 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:23.773919 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.773882 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab07d64c-e94f-4a2b-bf28-16e619440df2-cert\") pod \"odh-model-controller-7998c67dc4-sngbb\" (UID: \"ab07d64c-e94f-4a2b-bf28-16e619440df2\") " pod="opendatahub/odh-model-controller-7998c67dc4-sngbb" Jul 13 07:17:23.776301 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.776281 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ab07d64c-e94f-4a2b-bf28-16e619440df2-cert\") pod \"odh-model-controller-7998c67dc4-sngbb\" (UID: \"ab07d64c-e94f-4a2b-bf28-16e619440df2\") " pod="opendatahub/odh-model-controller-7998c67dc4-sngbb" Jul 13 07:17:23.842472 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.842439 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-mfsdb"] Jul 13 07:17:23.844878 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.844861 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-mfsdb" Jul 13 07:17:23.847641 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.847498 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 13 07:17:23.851577 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.851507 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:23.855826 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.855805 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-mfsdb"] Jul 13 07:17:23.974287 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.974246 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-sngbb" Jul 13 07:17:23.975479 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.975441 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9ffw\" (UniqueName: \"kubernetes.io/projected/1a8a2b9d-4cae-4c04-95ce-51fe2d029dcd-kube-api-access-c9ffw\") pod \"model-serving-api-54d89bd5fc-mfsdb\" (UID: \"1a8a2b9d-4cae-4c04-95ce-51fe2d029dcd\") " pod="opendatahub/model-serving-api-54d89bd5fc-mfsdb" Jul 13 07:17:23.975613 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:23.975513 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a8a2b9d-4cae-4c04-95ce-51fe2d029dcd-tls-certs\") pod \"model-serving-api-54d89bd5fc-mfsdb\" (UID: \"1a8a2b9d-4cae-4c04-95ce-51fe2d029dcd\") " pod="opendatahub/model-serving-api-54d89bd5fc-mfsdb" Jul 13 07:17:24.076684 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:24.076303 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a8a2b9d-4cae-4c04-95ce-51fe2d029dcd-tls-certs\") pod \"model-serving-api-54d89bd5fc-mfsdb\" (UID: \"1a8a2b9d-4cae-4c04-95ce-51fe2d029dcd\") " pod="opendatahub/model-serving-api-54d89bd5fc-mfsdb" Jul 13 07:17:24.076684 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:24.076377 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9ffw\" (UniqueName: \"kubernetes.io/projected/1a8a2b9d-4cae-4c04-95ce-51fe2d029dcd-kube-api-access-c9ffw\") pod \"model-serving-api-54d89bd5fc-mfsdb\" (UID: \"1a8a2b9d-4cae-4c04-95ce-51fe2d029dcd\") " pod="opendatahub/model-serving-api-54d89bd5fc-mfsdb" Jul 13 07:17:24.079740 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:24.079672 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a8a2b9d-4cae-4c04-95ce-51fe2d029dcd-tls-certs\") pod \"model-serving-api-54d89bd5fc-mfsdb\" (UID: \"1a8a2b9d-4cae-4c04-95ce-51fe2d029dcd\") " pod="opendatahub/model-serving-api-54d89bd5fc-mfsdb" Jul 13 07:17:24.093407 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:24.093368 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9ffw\" (UniqueName: \"kubernetes.io/projected/1a8a2b9d-4cae-4c04-95ce-51fe2d029dcd-kube-api-access-c9ffw\") pod \"model-serving-api-54d89bd5fc-mfsdb\" (UID: \"1a8a2b9d-4cae-4c04-95ce-51fe2d029dcd\") " pod="opendatahub/model-serving-api-54d89bd5fc-mfsdb" Jul 13 07:17:24.093545 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:24.093454 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:24.115967 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:24.115932 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-sngbb"] Jul 13 07:17:24.120099 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:17:24.120071 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab07d64c_e94f_4a2b_bf28_16e619440df2.slice/crio-aba3949a6842550f5dd0359ee30327bbd83e9bed797436f24c71c3265f55d3cd WatchSource:0}: Error finding container aba3949a6842550f5dd0359ee30327bbd83e9bed797436f24c71c3265f55d3cd: Status 404 returned error can't find the container with id aba3949a6842550f5dd0359ee30327bbd83e9bed797436f24c71c3265f55d3cd Jul 13 07:17:24.156673 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:24.156645 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-mfsdb" Jul 13 07:17:24.285379 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:24.285353 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-mfsdb"] Jul 13 07:17:24.288500 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:17:24.288463 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a8a2b9d_4cae_4c04_95ce_51fe2d029dcd.slice/crio-46f6aa74c7853bcc75e3bfef34182ccfa52d30f34d407689d70a7f7a65bc2c8c WatchSource:0}: Error finding container 46f6aa74c7853bcc75e3bfef34182ccfa52d30f34d407689d70a7f7a65bc2c8c: Status 404 returned error can't find the container with id 46f6aa74c7853bcc75e3bfef34182ccfa52d30f34d407689d70a7f7a65bc2c8c Jul 13 07:17:24.883822 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:24.883784 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-sngbb" event={"ID":"ab07d64c-e94f-4a2b-bf28-16e619440df2","Type":"ContainerStarted","Data":"aba3949a6842550f5dd0359ee30327bbd83e9bed797436f24c71c3265f55d3cd"} Jul 13 07:17:24.887848 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:24.887661 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-mfsdb" event={"ID":"1a8a2b9d-4cae-4c04-95ce-51fe2d029dcd","Type":"ContainerStarted","Data":"46f6aa74c7853bcc75e3bfef34182ccfa52d30f34d407689d70a7f7a65bc2c8c"} Jul 13 07:17:27.903086 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:27.903039 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-sngbb" event={"ID":"ab07d64c-e94f-4a2b-bf28-16e619440df2","Type":"ContainerStarted","Data":"22965b3f6aadad770787aeeb0ef9d4ca20040e2de499b2525295e3f73bc38ab9"} Jul 13 07:17:27.903611 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:27.903109 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-sngbb" Jul 13 07:17:27.904574 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:27.904544 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-mfsdb" event={"ID":"1a8a2b9d-4cae-4c04-95ce-51fe2d029dcd","Type":"ContainerStarted","Data":"0a56e25b2b298d0efa6483cb1a579720b1414bd6d8dd9407d5b44d0dda4a3bce"} Jul 13 07:17:27.904731 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:27.904602 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-mfsdb" Jul 13 07:17:27.920308 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:27.920270 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-sngbb" podStartSLOduration=1.894827518 podStartE2EDuration="4.920255402s" totalImagesPullingTime="3.025427884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:17:27.918515806 +0000 UTC m=+324.840768004" watchObservedRunningTime="2026-07-13 07:17:27.920255402 +0000 UTC m=+324.842507574" Jul 13 07:17:27.934712 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:27.934664 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-mfsdb" podStartSLOduration=2.087235842 podStartE2EDuration="4.934646982s" totalImagesPullingTime="2.84741114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:17:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:17:27.933915002 +0000 UTC m=+324.856167188" watchObservedRunningTime="2026-07-13 07:17:27.934646982 +0000 UTC m=+324.856899155" Jul 13 07:17:28.341543 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:28.341506 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:28.474488 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:28.474457 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:28.580801 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:28.580768 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-55f9f4ffd9-gsbd4"] Jul 13 07:17:28.587331 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:28.587278 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-gsbd4" Jul 13 07:17:28.590073 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:28.590039 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 13 07:17:28.591122 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:28.591099 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 13 07:17:28.591277 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:28.591101 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 13 07:17:28.591429 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:28.591110 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 13 07:17:28.591429 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:28.591123 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vwll2\"" Jul 13 07:17:28.594366 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:28.594299 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55f9f4ffd9-gsbd4"] Jul 13 07:17:28.713256 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:28.713217 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmk4z\" (UniqueName: \"kubernetes.io/projected/82a2e396-6550-4c4b-b4c1-f211e589c5c5-kube-api-access-bmk4z\") pod \"kube-auth-proxy-55f9f4ffd9-gsbd4\" (UID: \"82a2e396-6550-4c4b-b4c1-f211e589c5c5\") " pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-gsbd4" Jul 13 07:17:28.713476 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:28.713299 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82a2e396-6550-4c4b-b4c1-f211e589c5c5-tls-certs\") pod \"kube-auth-proxy-55f9f4ffd9-gsbd4\" (UID: \"82a2e396-6550-4c4b-b4c1-f211e589c5c5\") " pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-gsbd4" Jul 13 07:17:28.713476 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:28.713380 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82a2e396-6550-4c4b-b4c1-f211e589c5c5-tmp\") pod \"kube-auth-proxy-55f9f4ffd9-gsbd4\" (UID: \"82a2e396-6550-4c4b-b4c1-f211e589c5c5\") " pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-gsbd4" Jul 13 07:17:28.814598 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:28.814562 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmk4z\" (UniqueName: \"kubernetes.io/projected/82a2e396-6550-4c4b-b4c1-f211e589c5c5-kube-api-access-bmk4z\") pod \"kube-auth-proxy-55f9f4ffd9-gsbd4\" (UID: \"82a2e396-6550-4c4b-b4c1-f211e589c5c5\") " pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-gsbd4" Jul 13 07:17:28.814786 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:28.814637 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82a2e396-6550-4c4b-b4c1-f211e589c5c5-tls-certs\") pod \"kube-auth-proxy-55f9f4ffd9-gsbd4\" (UID: \"82a2e396-6550-4c4b-b4c1-f211e589c5c5\") " pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-gsbd4" Jul 13 07:17:28.814786 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:28.814684 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82a2e396-6550-4c4b-b4c1-f211e589c5c5-tmp\") pod \"kube-auth-proxy-55f9f4ffd9-gsbd4\" (UID: \"82a2e396-6550-4c4b-b4c1-f211e589c5c5\") " pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-gsbd4" Jul 13 07:17:28.816998 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:28.816971 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82a2e396-6550-4c4b-b4c1-f211e589c5c5-tmp\") pod \"kube-auth-proxy-55f9f4ffd9-gsbd4\" (UID: \"82a2e396-6550-4c4b-b4c1-f211e589c5c5\") " pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-gsbd4" Jul 13 07:17:28.817201 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:28.817182 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82a2e396-6550-4c4b-b4c1-f211e589c5c5-tls-certs\") pod \"kube-auth-proxy-55f9f4ffd9-gsbd4\" (UID: \"82a2e396-6550-4c4b-b4c1-f211e589c5c5\") " pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-gsbd4" Jul 13 07:17:28.823208 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:28.823184 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmk4z\" (UniqueName: \"kubernetes.io/projected/82a2e396-6550-4c4b-b4c1-f211e589c5c5-kube-api-access-bmk4z\") pod \"kube-auth-proxy-55f9f4ffd9-gsbd4\" (UID: \"82a2e396-6550-4c4b-b4c1-f211e589c5c5\") " pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-gsbd4" Jul 13 07:17:28.897588 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:28.897516 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-gsbd4" Jul 13 07:17:29.045336 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.045292 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-55f9f4ffd9-gsbd4"] Jul 13 07:17:29.048295 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:17:29.048271 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82a2e396_6550_4c4b_b4c1_f211e589c5c5.slice/crio-2d089d64e9178c456de52a116ecbf6024fa4972fc7c48f2864c93cc5e56bc7b8 WatchSource:0}: Error finding container 2d089d64e9178c456de52a116ecbf6024fa4972fc7c48f2864c93cc5e56bc7b8: Status 404 returned error can't find the container with id 2d089d64e9178c456de52a116ecbf6024fa4972fc7c48f2864c93cc5e56bc7b8 Jul 13 07:17:29.501924 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.501895 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh"] Jul 13 07:17:29.504771 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.504747 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.505087 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.505052 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:29.507840 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.507809 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 13 07:17:29.508084 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.508063 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-gpgf2\"" Jul 13 07:17:29.508194 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.508112 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 13 07:17:29.508194 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.508113 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 13 07:17:29.508194 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.508115 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 13 07:17:29.522980 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.522953 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh"] Jul 13 07:17:29.592079 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.592030 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:29.620763 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.620731 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz52s\" (UniqueName: \"kubernetes.io/projected/3aa0a78d-71d7-4781-a13b-30d995fe862b-kube-api-access-pz52s\") pod \"istiod-openshift-gateway-7574459656-ld6nh\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.620912 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.620776 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ld6nh\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.620912 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.620795 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3aa0a78d-71d7-4781-a13b-30d995fe862b-local-certs\") pod \"istiod-openshift-gateway-7574459656-ld6nh\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.620912 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.620819 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ld6nh\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.620912 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.620847 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3aa0a78d-71d7-4781-a13b-30d995fe862b-cacerts\") pod \"istiod-openshift-gateway-7574459656-ld6nh\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.620912 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.620867 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-token\") pod \"istiod-openshift-gateway-7574459656-ld6nh\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.621073 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.620917 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ld6nh\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.722193 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.722167 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3aa0a78d-71d7-4781-a13b-30d995fe862b-local-certs\") pod \"istiod-openshift-gateway-7574459656-ld6nh\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.722362 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.722201 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ld6nh\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.722362 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.722235 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3aa0a78d-71d7-4781-a13b-30d995fe862b-cacerts\") pod \"istiod-openshift-gateway-7574459656-ld6nh\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.722497 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.722414 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-token\") pod \"istiod-openshift-gateway-7574459656-ld6nh\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.722497 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.722454 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ld6nh\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.722497 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.722490 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz52s\" (UniqueName: \"kubernetes.io/projected/3aa0a78d-71d7-4781-a13b-30d995fe862b-kube-api-access-pz52s\") pod \"istiod-openshift-gateway-7574459656-ld6nh\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.722671 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.722537 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ld6nh\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.723017 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.722992 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-ld6nh\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.724674 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.724650 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3aa0a78d-71d7-4781-a13b-30d995fe862b-local-certs\") pod \"istiod-openshift-gateway-7574459656-ld6nh\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.724764 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.724696 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3aa0a78d-71d7-4781-a13b-30d995fe862b-cacerts\") pod \"istiod-openshift-gateway-7574459656-ld6nh\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.725041 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.725024 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-ld6nh\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.725101 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.725086 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-ld6nh\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.731519 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.731498 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-token\") pod \"istiod-openshift-gateway-7574459656-ld6nh\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.732117 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.732095 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz52s\" (UniqueName: \"kubernetes.io/projected/3aa0a78d-71d7-4781-a13b-30d995fe862b-kube-api-access-pz52s\") pod \"istiod-openshift-gateway-7574459656-ld6nh\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.814681 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.814590 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:29.916058 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.916018 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-gsbd4" event={"ID":"82a2e396-6550-4c4b-b4c1-f211e589c5c5","Type":"ContainerStarted","Data":"2d089d64e9178c456de52a116ecbf6024fa4972fc7c48f2864c93cc5e56bc7b8"} Jul 13 07:17:29.964786 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:29.964764 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh"] Jul 13 07:17:29.967105 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:17:29.967070 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aa0a78d_71d7_4781_a13b_30d995fe862b.slice/crio-544e977c97a877f90ac0f158ec61815ecda341d0f05cafa37a0f640d3a44545b WatchSource:0}: Error finding container 544e977c97a877f90ac0f158ec61815ecda341d0f05cafa37a0f640d3a44545b: Status 404 returned error can't find the container with id 544e977c97a877f90ac0f158ec61815ecda341d0f05cafa37a0f640d3a44545b Jul 13 07:17:30.916712 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:30.916680 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:30.921304 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:30.921277 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" event={"ID":"3aa0a78d-71d7-4781-a13b-30d995fe862b","Type":"ContainerStarted","Data":"544e977c97a877f90ac0f158ec61815ecda341d0f05cafa37a0f640d3a44545b"} Jul 13 07:17:32.932907 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:32.932872 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-gsbd4" event={"ID":"82a2e396-6550-4c4b-b4c1-f211e589c5c5","Type":"ContainerStarted","Data":"9a48c265be86d7fc59a33f1436450f9a251ed6c3c2fc29fe141dceb818904d31"} Jul 13 07:17:32.952227 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:32.952168 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-55f9f4ffd9-gsbd4" podStartSLOduration=1.938855225 podStartE2EDuration="4.952151242s" totalImagesPullingTime="3.013296017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:17:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:17:32.95088294 +0000 UTC m=+329.873135127" watchObservedRunningTime="2026-07-13 07:17:32.952151242 +0000 UTC m=+329.874403415" Jul 13 07:17:33.032854 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:33.032818 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:17:33.032935 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:33.032886 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:17:33.942598 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:33.942562 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" event={"ID":"3aa0a78d-71d7-4781-a13b-30d995fe862b","Type":"ContainerStarted","Data":"4581d10a901a4897436d3aa1096503c2b28877279a271dea876c6812340eb862"} Jul 13 07:17:33.943246 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:33.943223 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:33.953756 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:33.953732 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xgrh2"] Jul 13 07:17:33.956743 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:33.956722 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wmpzw"] Jul 13 07:17:33.956897 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:33.956876 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xgrh2" Jul 13 07:17:33.959760 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:33.959543 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 13 07:17:33.959760 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:33.959720 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wmpzw" Jul 13 07:17:33.959947 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:33.959863 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-ngkh4\"" Jul 13 07:17:33.967988 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:33.967794 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 13 07:17:33.968633 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:33.968401 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-rcvj9\"" Jul 13 07:17:33.974706 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:33.974685 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wmpzw"] Jul 13 07:17:33.977776 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:33.977749 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xgrh2"] Jul 13 07:17:33.988790 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:33.988731 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" podStartSLOduration=1.925598004 podStartE2EDuration="4.988712425s" totalImagesPullingTime="3.063114421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:17:33.988273208 +0000 UTC m=+330.910525382" watchObservedRunningTime="2026-07-13 07:17:33.988712425 +0000 UTC m=+330.910964599" Jul 13 07:17:34.060584 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.060541 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hscj7\" (UniqueName: \"kubernetes.io/projected/38ecc585-1619-4cab-919e-c391bcf32d2f-kube-api-access-hscj7\") pod \"kserve-controller-manager-d6f4b65b8-xgrh2\" (UID: \"38ecc585-1619-4cab-919e-c391bcf32d2f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xgrh2" Jul 13 07:17:34.060794 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.060593 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38ecc585-1619-4cab-919e-c391bcf32d2f-cert\") pod \"kserve-controller-manager-d6f4b65b8-xgrh2\" (UID: \"38ecc585-1619-4cab-919e-c391bcf32d2f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xgrh2" Jul 13 07:17:34.060914 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.060891 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvw96\" (UniqueName: \"kubernetes.io/projected/68a9f171-f008-4aac-b5bd-5685e65de3a3-kube-api-access-wvw96\") pod \"llmisvc-controller-manager-777c6bd7d5-wmpzw\" (UID: \"68a9f171-f008-4aac-b5bd-5685e65de3a3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wmpzw" Jul 13 07:17:34.061165 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.061143 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68a9f171-f008-4aac-b5bd-5685e65de3a3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wmpzw\" (UID: \"68a9f171-f008-4aac-b5bd-5685e65de3a3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wmpzw" Jul 13 07:17:34.092372 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.092333 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:34.161708 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.161674 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68a9f171-f008-4aac-b5bd-5685e65de3a3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wmpzw\" (UID: \"68a9f171-f008-4aac-b5bd-5685e65de3a3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wmpzw" Jul 13 07:17:34.161899 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.161717 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hscj7\" (UniqueName: \"kubernetes.io/projected/38ecc585-1619-4cab-919e-c391bcf32d2f-kube-api-access-hscj7\") pod \"kserve-controller-manager-d6f4b65b8-xgrh2\" (UID: \"38ecc585-1619-4cab-919e-c391bcf32d2f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xgrh2" Jul 13 07:17:34.161899 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.161741 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38ecc585-1619-4cab-919e-c391bcf32d2f-cert\") pod \"kserve-controller-manager-d6f4b65b8-xgrh2\" (UID: \"38ecc585-1619-4cab-919e-c391bcf32d2f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xgrh2" Jul 13 07:17:34.161899 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.161807 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvw96\" (UniqueName: \"kubernetes.io/projected/68a9f171-f008-4aac-b5bd-5685e65de3a3-kube-api-access-wvw96\") pod \"llmisvc-controller-manager-777c6bd7d5-wmpzw\" (UID: \"68a9f171-f008-4aac-b5bd-5685e65de3a3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wmpzw" Jul 13 07:17:34.164290 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.164266 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38ecc585-1619-4cab-919e-c391bcf32d2f-cert\") pod \"kserve-controller-manager-d6f4b65b8-xgrh2\" (UID: \"38ecc585-1619-4cab-919e-c391bcf32d2f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xgrh2" Jul 13 07:17:34.164421 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.164406 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/68a9f171-f008-4aac-b5bd-5685e65de3a3-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wmpzw\" (UID: \"68a9f171-f008-4aac-b5bd-5685e65de3a3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wmpzw" Jul 13 07:17:34.173921 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.173898 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hscj7\" (UniqueName: \"kubernetes.io/projected/38ecc585-1619-4cab-919e-c391bcf32d2f-kube-api-access-hscj7\") pod \"kserve-controller-manager-d6f4b65b8-xgrh2\" (UID: \"38ecc585-1619-4cab-919e-c391bcf32d2f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-xgrh2" Jul 13 07:17:34.174011 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.173933 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvw96\" (UniqueName: \"kubernetes.io/projected/68a9f171-f008-4aac-b5bd-5685e65de3a3-kube-api-access-wvw96\") pod \"llmisvc-controller-manager-777c6bd7d5-wmpzw\" (UID: \"68a9f171-f008-4aac-b5bd-5685e65de3a3\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wmpzw" Jul 13 07:17:34.194211 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.194148 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:34.273157 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.273129 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xgrh2" Jul 13 07:17:34.280693 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.280667 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wmpzw" Jul 13 07:17:34.414346 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.414292 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-xgrh2"] Jul 13 07:17:34.417600 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:17:34.417570 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ecc585_1619_4cab_919e_c391bcf32d2f.slice/crio-9ed8f85ce20b54d52bae81d2203adb47e485eedc1ff3163ea373a7ec218a1636 WatchSource:0}: Error finding container 9ed8f85ce20b54d52bae81d2203adb47e485eedc1ff3163ea373a7ec218a1636: Status 404 returned error can't find the container with id 9ed8f85ce20b54d52bae81d2203adb47e485eedc1ff3163ea373a7ec218a1636 Jul 13 07:17:34.487842 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.487813 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wmpzw"] Jul 13 07:17:34.490310 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:17:34.490281 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod68a9f171_f008_4aac_b5bd_5685e65de3a3.slice/crio-6d17be2a52d293e630525862a0c2a3a747fa93494676b98e79b31ef9bec9ce24 WatchSource:0}: Error finding container 6d17be2a52d293e630525862a0c2a3a747fa93494676b98e79b31ef9bec9ce24: Status 404 returned error can't find the container with id 6d17be2a52d293e630525862a0c2a3a747fa93494676b98e79b31ef9bec9ce24 Jul 13 07:17:34.926375 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.926283 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw"] Jul 13 07:17:34.929530 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.929507 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:34.932798 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.932776 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-jnl9b\"" Jul 13 07:17:34.946958 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.946895 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wmpzw" event={"ID":"68a9f171-f008-4aac-b5bd-5685e65de3a3","Type":"ContainerStarted","Data":"6d17be2a52d293e630525862a0c2a3a747fa93494676b98e79b31ef9bec9ce24"} Jul 13 07:17:34.948091 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.948059 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw"] Jul 13 07:17:34.948195 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.948115 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xgrh2" event={"ID":"38ecc585-1619-4cab-919e-c391bcf32d2f","Type":"ContainerStarted","Data":"9ed8f85ce20b54d52bae81d2203adb47e485eedc1ff3163ea373a7ec218a1636"} Jul 13 07:17:34.950533 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.950503 2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-ld6nh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 13 07:17:34.950670 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.950560 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" podUID="3aa0a78d-71d7-4781-a13b-30d995fe862b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 13 07:17:34.966167 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:34.966144 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:35.069003 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.068963 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/653b9081-9efc-4a65-8a6f-601fd7fb9c70-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.069003 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.069005 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv2v5\" (UniqueName: \"kubernetes.io/projected/653b9081-9efc-4a65-8a6f-601fd7fb9c70-kube-api-access-rv2v5\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.069266 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.069099 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/653b9081-9efc-4a65-8a6f-601fd7fb9c70-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.069266 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.069155 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/653b9081-9efc-4a65-8a6f-601fd7fb9c70-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.069266 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.069197 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/653b9081-9efc-4a65-8a6f-601fd7fb9c70-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.069266 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.069222 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/653b9081-9efc-4a65-8a6f-601fd7fb9c70-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.069444 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.069269 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/653b9081-9efc-4a65-8a6f-601fd7fb9c70-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.069444 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.069422 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/653b9081-9efc-4a65-8a6f-601fd7fb9c70-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.069508 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.069473 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/653b9081-9efc-4a65-8a6f-601fd7fb9c70-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.106751 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.106708 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:35.170485 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.170450 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/653b9081-9efc-4a65-8a6f-601fd7fb9c70-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.170687 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.170504 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/653b9081-9efc-4a65-8a6f-601fd7fb9c70-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.170687 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.170544 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/653b9081-9efc-4a65-8a6f-601fd7fb9c70-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.170687 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.170563 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv2v5\" (UniqueName: \"kubernetes.io/projected/653b9081-9efc-4a65-8a6f-601fd7fb9c70-kube-api-access-rv2v5\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.170687 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.170643 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/653b9081-9efc-4a65-8a6f-601fd7fb9c70-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.170687 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.170683 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/653b9081-9efc-4a65-8a6f-601fd7fb9c70-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.170957 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.170714 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/653b9081-9efc-4a65-8a6f-601fd7fb9c70-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.170957 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.170740 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/653b9081-9efc-4a65-8a6f-601fd7fb9c70-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.170957 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.170766 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/653b9081-9efc-4a65-8a6f-601fd7fb9c70-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.171151 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.171020 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/653b9081-9efc-4a65-8a6f-601fd7fb9c70-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.171575 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.171221 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/653b9081-9efc-4a65-8a6f-601fd7fb9c70-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.171575 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.171429 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/653b9081-9efc-4a65-8a6f-601fd7fb9c70-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.171751 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.171625 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/653b9081-9efc-4a65-8a6f-601fd7fb9c70-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.171751 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.171641 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/653b9081-9efc-4a65-8a6f-601fd7fb9c70-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.173906 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.173884 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/653b9081-9efc-4a65-8a6f-601fd7fb9c70-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.174051 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.174032 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/653b9081-9efc-4a65-8a6f-601fd7fb9c70-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.181965 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.181808 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/653b9081-9efc-4a65-8a6f-601fd7fb9c70-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.184900 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.184877 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv2v5\" (UniqueName: \"kubernetes.io/projected/653b9081-9efc-4a65-8a6f-601fd7fb9c70-kube-api-access-rv2v5\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4d2tqw\" (UID: \"653b9081-9efc-4a65-8a6f-601fd7fb9c70\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.224898 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.224851 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:35.240026 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.239996 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:35.495673 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.495642 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw"] Jul 13 07:17:35.525285 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:17:35.525179 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod653b9081_9efc_4a65_8a6f_601fd7fb9c70.slice/crio-e57b100e49ae0ec8db1e078b54fe26f9cb94fcae09ebf8a4f9c69480c554764c WatchSource:0}: Error finding container e57b100e49ae0ec8db1e078b54fe26f9cb94fcae09ebf8a4f9c69480c554764c: Status 404 returned error can't find the container with id e57b100e49ae0ec8db1e078b54fe26f9cb94fcae09ebf8a4f9c69480c554764c Jul 13 07:17:35.957073 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.957031 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" event={"ID":"653b9081-9efc-4a65-8a6f-601fd7fb9c70","Type":"ContainerStarted","Data":"e57b100e49ae0ec8db1e078b54fe26f9cb94fcae09ebf8a4f9c69480c554764c"} Jul 13 07:17:35.958128 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:35.958104 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:36.060728 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:36.060693 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:36.142748 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:36.142712 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh"] Jul 13 07:17:36.147037 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:36.147001 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:36.220780 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:36.220702 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:37.969555 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:37.969427 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xgrh2" event={"ID":"38ecc585-1619-4cab-919e-c391bcf32d2f","Type":"ContainerStarted","Data":"108a1b122ccc69c72b7f5f7313ffc88e3d25fe311561a5eb1ed6c42237e1f0e6"} Jul 13 07:17:37.969555 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:37.969514 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" podUID="3aa0a78d-71d7-4781-a13b-30d995fe862b" containerName="discovery" containerID="cri-o://4581d10a901a4897436d3aa1096503c2b28877279a271dea876c6812340eb862" gracePeriod=30 Jul 13 07:17:38.039311 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.039250 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xgrh2" podStartSLOduration=2.047175915 podStartE2EDuration="5.039235993s" totalImagesPullingTime="2.992060078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:17:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:17:38.038455182 +0000 UTC m=+334.960707355" watchObservedRunningTime="2026-07-13 07:17:38.039235993 +0000 UTC m=+334.961488205" Jul 13 07:17:38.306016 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.305987 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:38.313757 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.313735 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz52s\" (UniqueName: \"kubernetes.io/projected/3aa0a78d-71d7-4781-a13b-30d995fe862b-kube-api-access-pz52s\") pod \"3aa0a78d-71d7-4781-a13b-30d995fe862b\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " Jul 13 07:17:38.313852 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.313779 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3aa0a78d-71d7-4781-a13b-30d995fe862b-cacerts\") pod \"3aa0a78d-71d7-4781-a13b-30d995fe862b\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " Jul 13 07:17:38.313852 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.313805 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-csr-ca-configmap\") pod \"3aa0a78d-71d7-4781-a13b-30d995fe862b\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " Jul 13 07:17:38.313852 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.313826 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3aa0a78d-71d7-4781-a13b-30d995fe862b-local-certs\") pod \"3aa0a78d-71d7-4781-a13b-30d995fe862b\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " Jul 13 07:17:38.314059 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.313853 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-kubeconfig\") pod \"3aa0a78d-71d7-4781-a13b-30d995fe862b\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " Jul 13 07:17:38.314059 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.313880 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-csr-dns-cert\") pod \"3aa0a78d-71d7-4781-a13b-30d995fe862b\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " Jul 13 07:17:38.314059 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.313903 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-token\") pod \"3aa0a78d-71d7-4781-a13b-30d995fe862b\" (UID: \"3aa0a78d-71d7-4781-a13b-30d995fe862b\") " Jul 13 07:17:38.314263 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.314233 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "3aa0a78d-71d7-4781-a13b-30d995fe862b" (UID: "3aa0a78d-71d7-4781-a13b-30d995fe862b"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:17:38.316246 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.316220 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "3aa0a78d-71d7-4781-a13b-30d995fe862b" (UID: "3aa0a78d-71d7-4781-a13b-30d995fe862b"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:17:38.316371 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.316224 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3aa0a78d-71d7-4781-a13b-30d995fe862b-kube-api-access-pz52s" (OuterVolumeSpecName: "kube-api-access-pz52s") pod "3aa0a78d-71d7-4781-a13b-30d995fe862b" (UID: "3aa0a78d-71d7-4781-a13b-30d995fe862b"). InnerVolumeSpecName "kube-api-access-pz52s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:17:38.316371 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.316268 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3aa0a78d-71d7-4781-a13b-30d995fe862b-local-certs" (OuterVolumeSpecName: "local-certs") pod "3aa0a78d-71d7-4781-a13b-30d995fe862b" (UID: "3aa0a78d-71d7-4781-a13b-30d995fe862b"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:17:38.316487 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.316444 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3aa0a78d-71d7-4781-a13b-30d995fe862b-cacerts" (OuterVolumeSpecName: "cacerts") pod "3aa0a78d-71d7-4781-a13b-30d995fe862b" (UID: "3aa0a78d-71d7-4781-a13b-30d995fe862b"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:17:38.316542 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.316526 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "3aa0a78d-71d7-4781-a13b-30d995fe862b" (UID: "3aa0a78d-71d7-4781-a13b-30d995fe862b"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:17:38.316599 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.316556 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-token" (OuterVolumeSpecName: "istio-token") pod "3aa0a78d-71d7-4781-a13b-30d995fe862b" (UID: "3aa0a78d-71d7-4781-a13b-30d995fe862b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:17:38.414474 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.414440 2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-csr-ca-configmap\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:17:38.414474 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.414470 2565 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3aa0a78d-71d7-4781-a13b-30d995fe862b-local-certs\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:17:38.414474 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.414479 2565 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-kubeconfig\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:17:38.414708 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.414487 2565 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-csr-dns-cert\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:17:38.414708 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.414496 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3aa0a78d-71d7-4781-a13b-30d995fe862b-istio-token\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:17:38.414708 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.414504 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz52s\" (UniqueName: \"kubernetes.io/projected/3aa0a78d-71d7-4781-a13b-30d995fe862b-kube-api-access-pz52s\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:17:38.414708 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.414512 2565 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3aa0a78d-71d7-4781-a13b-30d995fe862b-cacerts\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:17:38.911251 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.911157 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-sngbb" Jul 13 07:17:38.913585 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.913562 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-mfsdb" Jul 13 07:17:38.974889 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.974852 2565 generic.go:356] "Generic (PLEG): container finished" podID="3aa0a78d-71d7-4781-a13b-30d995fe862b" containerID="4581d10a901a4897436d3aa1096503c2b28877279a271dea876c6812340eb862" exitCode=0 Jul 13 07:17:38.975339 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.974892 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" Jul 13 07:17:38.975339 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.974928 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" event={"ID":"3aa0a78d-71d7-4781-a13b-30d995fe862b","Type":"ContainerDied","Data":"4581d10a901a4897436d3aa1096503c2b28877279a271dea876c6812340eb862"} Jul 13 07:17:38.975339 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.974985 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh" event={"ID":"3aa0a78d-71d7-4781-a13b-30d995fe862b","Type":"ContainerDied","Data":"544e977c97a877f90ac0f158ec61815ecda341d0f05cafa37a0f640d3a44545b"} Jul 13 07:17:38.975339 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.975014 2565 scope.go:117] "RemoveContainer" containerID="4581d10a901a4897436d3aa1096503c2b28877279a271dea876c6812340eb862" Jul 13 07:17:38.977085 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.977060 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wmpzw" event={"ID":"68a9f171-f008-4aac-b5bd-5685e65de3a3","Type":"ContainerStarted","Data":"3caad925e594a06eb1e8b76c81ebf2516551c926bb6aceba588bce911d549121"} Jul 13 07:17:38.977200 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.977142 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wmpzw" Jul 13 07:17:38.977200 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.977168 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xgrh2" Jul 13 07:17:38.985896 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.985877 2565 scope.go:117] "RemoveContainer" containerID="4581d10a901a4897436d3aa1096503c2b28877279a271dea876c6812340eb862" Jul 13 07:17:38.986190 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:17:38.986172 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4581d10a901a4897436d3aa1096503c2b28877279a271dea876c6812340eb862\": container with ID starting with 4581d10a901a4897436d3aa1096503c2b28877279a271dea876c6812340eb862 not found: ID does not exist" containerID="4581d10a901a4897436d3aa1096503c2b28877279a271dea876c6812340eb862" Jul 13 07:17:38.986272 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:38.986199 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4581d10a901a4897436d3aa1096503c2b28877279a271dea876c6812340eb862"} err="failed to get container status \"4581d10a901a4897436d3aa1096503c2b28877279a271dea876c6812340eb862\": rpc error: code = NotFound desc = could not find container \"4581d10a901a4897436d3aa1096503c2b28877279a271dea876c6812340eb862\": container with ID starting with 4581d10a901a4897436d3aa1096503c2b28877279a271dea876c6812340eb862 not found: ID does not exist" Jul 13 07:17:39.004215 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:39.004188 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh"] Jul 13 07:17:39.015893 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:39.015865 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-ld6nh"] Jul 13 07:17:39.052486 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:39.052441 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wmpzw" podStartSLOduration=2.083549531 podStartE2EDuration="6.052427389s" totalImagesPullingTime="3.968877858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:17:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:17:39.048210573 +0000 UTC m=+335.970462758" watchObservedRunningTime="2026-07-13 07:17:39.052427389 +0000 UTC m=+335.974679561" Jul 13 07:17:39.638601 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:39.638567 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3aa0a78d-71d7-4781-a13b-30d995fe862b" path="/var/lib/kubelet/pods/3aa0a78d-71d7-4781-a13b-30d995fe862b/volumes" Jul 13 07:17:41.896582 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:41.896545 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:41.949407 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:41.949375 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:43.949184 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:43.949152 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:17:51.401757 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:51.401721 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:17:51.402029 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:51.401794 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:17:51.402029 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:51.401822 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:17:52.033856 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:52.033823 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" event={"ID":"653b9081-9efc-4a65-8a6f-601fd7fb9c70","Type":"ContainerStarted","Data":"30512d9422f42940a48bfcf364831882a6e249d3ed21b1c9f38966f9d129ce61"} Jul 13 07:17:52.056667 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:52.056618 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" podStartSLOduration=2.182997698 podStartE2EDuration="18.056598687s" totalImagesPullingTime="15.873600989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:17:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:17:52.055421861 +0000 UTC m=+348.977674036" watchObservedRunningTime="2026-07-13 07:17:52.056598687 +0000 UTC m=+348.978850880" Jul 13 07:17:52.240478 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:52.240446 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:52.244760 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:52.244737 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:53.038655 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:53.038620 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:17:53.039696 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:17:53.039674 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4d2tqw" Jul 13 07:18:05.362631 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:05.362579 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:09.983986 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:09.983956 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wmpzw" Jul 13 07:18:09.986625 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:09.986589 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-xgrh2" Jul 13 07:18:23.565025 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:23.564983 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:23.667121 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:23.667088 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:23.694547 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:23.694515 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v4qgw"] Jul 13 07:18:23.694836 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:23.694823 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3aa0a78d-71d7-4781-a13b-30d995fe862b" containerName="discovery" Jul 13 07:18:23.694884 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:23.694838 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3aa0a78d-71d7-4781-a13b-30d995fe862b" containerName="discovery" Jul 13 07:18:23.694917 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:23.694898 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3aa0a78d-71d7-4781-a13b-30d995fe862b" containerName="discovery" Jul 13 07:18:23.705757 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:23.705730 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v4qgw" Jul 13 07:18:23.708962 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:23.708935 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v4qgw"] Jul 13 07:18:23.709361 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:23.709340 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 13 07:18:23.709482 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:23.709336 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 13 07:18:23.710677 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:23.710503 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5kstz\"" Jul 13 07:18:23.747055 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:23.747029 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:23.765062 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:23.765035 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj59w\" (UniqueName: \"kubernetes.io/projected/a5547a5a-a7b2-4d94-a543-8905d5fcc680-kube-api-access-xj59w\") pod \"kuadrant-operator-catalog-v4qgw\" (UID: \"a5547a5a-a7b2-4d94-a543-8905d5fcc680\") " pod="kuadrant-system/kuadrant-operator-catalog-v4qgw" Jul 13 07:18:23.866085 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:23.866011 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xj59w\" (UniqueName: \"kubernetes.io/projected/a5547a5a-a7b2-4d94-a543-8905d5fcc680-kube-api-access-xj59w\") pod \"kuadrant-operator-catalog-v4qgw\" (UID: \"a5547a5a-a7b2-4d94-a543-8905d5fcc680\") " pod="kuadrant-system/kuadrant-operator-catalog-v4qgw" Jul 13 07:18:23.874178 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:23.874151 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj59w\" (UniqueName: \"kubernetes.io/projected/a5547a5a-a7b2-4d94-a543-8905d5fcc680-kube-api-access-xj59w\") pod \"kuadrant-operator-catalog-v4qgw\" (UID: \"a5547a5a-a7b2-4d94-a543-8905d5fcc680\") " pod="kuadrant-system/kuadrant-operator-catalog-v4qgw" Jul 13 07:18:24.016839 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:24.016811 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v4qgw" Jul 13 07:18:24.056481 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:24.056448 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v4qgw"] Jul 13 07:18:24.143186 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:24.143155 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v4qgw"] Jul 13 07:18:24.145842 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:18:24.145802 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5547a5a_a7b2_4d94_a543_8905d5fcc680.slice/crio-6b2fde0fc6b9f077b7fc698148ff239b2bdcb7e6ce2949352bdc2250bee8e839 WatchSource:0}: Error finding container 6b2fde0fc6b9f077b7fc698148ff239b2bdcb7e6ce2949352bdc2250bee8e839: Status 404 returned error can't find the container with id 6b2fde0fc6b9f077b7fc698148ff239b2bdcb7e6ce2949352bdc2250bee8e839 Jul 13 07:18:24.169504 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:24.169481 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v4qgw" event={"ID":"a5547a5a-a7b2-4d94-a543-8905d5fcc680","Type":"ContainerStarted","Data":"6b2fde0fc6b9f077b7fc698148ff239b2bdcb7e6ce2949352bdc2250bee8e839"} Jul 13 07:18:24.265534 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:24.265510 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xdm8j"] Jul 13 07:18:24.268475 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:24.268460 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xdm8j" Jul 13 07:18:24.277034 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:24.277009 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xdm8j"] Jul 13 07:18:24.369267 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:24.369238 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7rbb\" (UniqueName: \"kubernetes.io/projected/150fc264-ce80-43af-84ea-beaf2c43df2b-kube-api-access-f7rbb\") pod \"kuadrant-operator-catalog-xdm8j\" (UID: \"150fc264-ce80-43af-84ea-beaf2c43df2b\") " pod="kuadrant-system/kuadrant-operator-catalog-xdm8j" Jul 13 07:18:24.469893 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:24.469820 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7rbb\" (UniqueName: \"kubernetes.io/projected/150fc264-ce80-43af-84ea-beaf2c43df2b-kube-api-access-f7rbb\") pod \"kuadrant-operator-catalog-xdm8j\" (UID: \"150fc264-ce80-43af-84ea-beaf2c43df2b\") " pod="kuadrant-system/kuadrant-operator-catalog-xdm8j" Jul 13 07:18:24.477350 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:24.477306 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7rbb\" (UniqueName: \"kubernetes.io/projected/150fc264-ce80-43af-84ea-beaf2c43df2b-kube-api-access-f7rbb\") pod \"kuadrant-operator-catalog-xdm8j\" (UID: \"150fc264-ce80-43af-84ea-beaf2c43df2b\") " pod="kuadrant-system/kuadrant-operator-catalog-xdm8j" Jul 13 07:18:24.488493 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:24.488463 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:24.578234 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:24.578203 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-xdm8j" Jul 13 07:18:24.694146 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:24.694114 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:24.707954 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:24.707933 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-xdm8j"] Jul 13 07:18:24.709944 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:18:24.709918 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod150fc264_ce80_43af_84ea_beaf2c43df2b.slice/crio-6fa74604674b6387248c3876e7b021fe4af298e749221611d668f7666469cf8a WatchSource:0}: Error finding container 6fa74604674b6387248c3876e7b021fe4af298e749221611d668f7666469cf8a: Status 404 returned error can't find the container with id 6fa74604674b6387248c3876e7b021fe4af298e749221611d668f7666469cf8a Jul 13 07:18:25.176303 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:25.176249 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xdm8j" event={"ID":"150fc264-ce80-43af-84ea-beaf2c43df2b","Type":"ContainerStarted","Data":"6fa74604674b6387248c3876e7b021fe4af298e749221611d668f7666469cf8a"} Jul 13 07:18:27.186280 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:27.186186 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-xdm8j" event={"ID":"150fc264-ce80-43af-84ea-beaf2c43df2b","Type":"ContainerStarted","Data":"63368c33860bd5244004f47fee082c8c66b11e4b07a0a45f4437ffd81ba1ceda"} Jul 13 07:18:27.187594 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:27.187570 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v4qgw" event={"ID":"a5547a5a-a7b2-4d94-a543-8905d5fcc680","Type":"ContainerStarted","Data":"f989920a22fa7b595dd621fca1aba6b64c3b0bdc077322d24a921af13b22c134"} Jul 13 07:18:27.187718 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:27.187654 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-v4qgw" podUID="a5547a5a-a7b2-4d94-a543-8905d5fcc680" containerName="registry-server" containerID="cri-o://f989920a22fa7b595dd621fca1aba6b64c3b0bdc077322d24a921af13b22c134" gracePeriod=2 Jul 13 07:18:27.202558 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:27.202517 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-xdm8j" podStartSLOduration=1.057361431 podStartE2EDuration="3.202501541s" totalImagesPullingTime="2.14514011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:18:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:18:27.2017389 +0000 UTC m=+384.123991077" watchObservedRunningTime="2026-07-13 07:18:27.202501541 +0000 UTC m=+384.124753705" Jul 13 07:18:27.217122 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:27.217081 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-v4qgw" podStartSLOduration=1.511100582 podStartE2EDuration="4.217068563s" totalImagesPullingTime="2.705967981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:18:27.215663526 +0000 UTC m=+384.137915701" watchObservedRunningTime="2026-07-13 07:18:27.217068563 +0000 UTC m=+384.139320746" Jul 13 07:18:27.419045 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:27.419021 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v4qgw" Jul 13 07:18:27.495554 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:27.495525 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xj59w\" (UniqueName: \"kubernetes.io/projected/a5547a5a-a7b2-4d94-a543-8905d5fcc680-kube-api-access-xj59w\") pod \"a5547a5a-a7b2-4d94-a543-8905d5fcc680\" (UID: \"a5547a5a-a7b2-4d94-a543-8905d5fcc680\") " Jul 13 07:18:27.497582 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:27.497555 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5547a5a-a7b2-4d94-a543-8905d5fcc680-kube-api-access-xj59w" (OuterVolumeSpecName: "kube-api-access-xj59w") pod "a5547a5a-a7b2-4d94-a543-8905d5fcc680" (UID: "a5547a5a-a7b2-4d94-a543-8905d5fcc680"). InnerVolumeSpecName "kube-api-access-xj59w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:18:27.596629 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:27.596602 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj59w\" (UniqueName: \"kubernetes.io/projected/a5547a5a-a7b2-4d94-a543-8905d5fcc680-kube-api-access-xj59w\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:18:28.193674 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:28.193575 2565 generic.go:356] "Generic (PLEG): container finished" podID="a5547a5a-a7b2-4d94-a543-8905d5fcc680" containerID="f989920a22fa7b595dd621fca1aba6b64c3b0bdc077322d24a921af13b22c134" exitCode=0 Jul 13 07:18:28.193674 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:28.193633 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v4qgw" Jul 13 07:18:28.193674 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:28.193663 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v4qgw" event={"ID":"a5547a5a-a7b2-4d94-a543-8905d5fcc680","Type":"ContainerDied","Data":"f989920a22fa7b595dd621fca1aba6b64c3b0bdc077322d24a921af13b22c134"} Jul 13 07:18:28.194203 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:28.193738 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v4qgw" event={"ID":"a5547a5a-a7b2-4d94-a543-8905d5fcc680","Type":"ContainerDied","Data":"6b2fde0fc6b9f077b7fc698148ff239b2bdcb7e6ce2949352bdc2250bee8e839"} Jul 13 07:18:28.194203 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:28.193759 2565 scope.go:117] "RemoveContainer" containerID="f989920a22fa7b595dd621fca1aba6b64c3b0bdc077322d24a921af13b22c134" Jul 13 07:18:28.202350 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:28.202304 2565 scope.go:117] "RemoveContainer" containerID="f989920a22fa7b595dd621fca1aba6b64c3b0bdc077322d24a921af13b22c134" Jul 13 07:18:28.202586 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:18:28.202570 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f989920a22fa7b595dd621fca1aba6b64c3b0bdc077322d24a921af13b22c134\": container with ID starting with f989920a22fa7b595dd621fca1aba6b64c3b0bdc077322d24a921af13b22c134 not found: ID does not exist" containerID="f989920a22fa7b595dd621fca1aba6b64c3b0bdc077322d24a921af13b22c134" Jul 13 07:18:28.202652 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:28.202611 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f989920a22fa7b595dd621fca1aba6b64c3b0bdc077322d24a921af13b22c134"} err="failed to get container status \"f989920a22fa7b595dd621fca1aba6b64c3b0bdc077322d24a921af13b22c134\": rpc error: code = NotFound desc = could not find container \"f989920a22fa7b595dd621fca1aba6b64c3b0bdc077322d24a921af13b22c134\": container with ID starting with f989920a22fa7b595dd621fca1aba6b64c3b0bdc077322d24a921af13b22c134 not found: ID does not exist" Jul 13 07:18:28.208844 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:28.208821 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v4qgw"] Jul 13 07:18:28.212658 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:28.212637 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v4qgw"] Jul 13 07:18:29.639014 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:29.638981 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a5547a5a-a7b2-4d94-a543-8905d5fcc680" path="/var/lib/kubelet/pods/a5547a5a-a7b2-4d94-a543-8905d5fcc680/volumes" Jul 13 07:18:34.578663 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:34.578624 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-xdm8j" Jul 13 07:18:34.579065 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:34.578697 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-xdm8j" Jul 13 07:18:34.601341 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:34.601301 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-xdm8j" Jul 13 07:18:35.244888 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:35.244848 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-xdm8j" Jul 13 07:18:39.706241 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:39.706208 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb"] Jul 13 07:18:39.706731 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:39.706508 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a5547a5a-a7b2-4d94-a543-8905d5fcc680" containerName="registry-server" Jul 13 07:18:39.706731 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:39.706520 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a5547a5a-a7b2-4d94-a543-8905d5fcc680" containerName="registry-server" Jul 13 07:18:39.706731 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:39.706597 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a5547a5a-a7b2-4d94-a543-8905d5fcc680" containerName="registry-server" Jul 13 07:18:39.709690 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:39.709670 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb" Jul 13 07:18:39.712155 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:39.712138 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6n99k\"" Jul 13 07:18:39.718604 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:39.718576 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb"] Jul 13 07:18:39.794519 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:39.794489 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd4gl\" (UniqueName: \"kubernetes.io/projected/302ee945-6eef-40ba-8378-adcba96f53f9-kube-api-access-vd4gl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb\" (UID: \"302ee945-6eef-40ba-8378-adcba96f53f9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb" Jul 13 07:18:39.794635 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:39.794534 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/302ee945-6eef-40ba-8378-adcba96f53f9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb\" (UID: \"302ee945-6eef-40ba-8378-adcba96f53f9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb" Jul 13 07:18:39.794635 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:39.794616 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/302ee945-6eef-40ba-8378-adcba96f53f9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb\" (UID: \"302ee945-6eef-40ba-8378-adcba96f53f9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb" Jul 13 07:18:39.895623 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:39.895591 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/302ee945-6eef-40ba-8378-adcba96f53f9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb\" (UID: \"302ee945-6eef-40ba-8378-adcba96f53f9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb" Jul 13 07:18:39.895731 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:39.895647 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/302ee945-6eef-40ba-8378-adcba96f53f9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb\" (UID: \"302ee945-6eef-40ba-8378-adcba96f53f9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb" Jul 13 07:18:39.895731 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:39.895680 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd4gl\" (UniqueName: \"kubernetes.io/projected/302ee945-6eef-40ba-8378-adcba96f53f9-kube-api-access-vd4gl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb\" (UID: \"302ee945-6eef-40ba-8378-adcba96f53f9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb" Jul 13 07:18:39.896010 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:39.895991 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/302ee945-6eef-40ba-8378-adcba96f53f9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb\" (UID: \"302ee945-6eef-40ba-8378-adcba96f53f9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb" Jul 13 07:18:39.896056 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:39.896000 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/302ee945-6eef-40ba-8378-adcba96f53f9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb\" (UID: \"302ee945-6eef-40ba-8378-adcba96f53f9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb" Jul 13 07:18:39.904196 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:39.904174 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd4gl\" (UniqueName: \"kubernetes.io/projected/302ee945-6eef-40ba-8378-adcba96f53f9-kube-api-access-vd4gl\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb\" (UID: \"302ee945-6eef-40ba-8378-adcba96f53f9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb" Jul 13 07:18:40.019396 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.019376 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb" Jul 13 07:18:40.143587 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.143542 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb"] Jul 13 07:18:40.145858 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:18:40.145830 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod302ee945_6eef_40ba_8378_adcba96f53f9.slice/crio-f0bdc3907664c75e2a08e127b581b64b8b2fad090129ae2d127769143f3704e6 WatchSource:0}: Error finding container f0bdc3907664c75e2a08e127b581b64b8b2fad090129ae2d127769143f3704e6: Status 404 returned error can't find the container with id f0bdc3907664c75e2a08e127b581b64b8b2fad090129ae2d127769143f3704e6 Jul 13 07:18:40.246819 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.246787 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb" event={"ID":"302ee945-6eef-40ba-8378-adcba96f53f9","Type":"ContainerStarted","Data":"00c6e4963718e6bc0eb6f31fefb9397baf9edfa0152423bdee0382d3a4813d3f"} Jul 13 07:18:40.246955 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.246840 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb" event={"ID":"302ee945-6eef-40ba-8378-adcba96f53f9","Type":"ContainerStarted","Data":"f0bdc3907664c75e2a08e127b581b64b8b2fad090129ae2d127769143f3704e6"} Jul 13 07:18:40.303072 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.303014 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk"] Jul 13 07:18:40.305249 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.305233 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk" Jul 13 07:18:40.314609 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.314576 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk"] Jul 13 07:18:40.400011 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.399985 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97194eab-7f39-4076-bc88-75334dcc8ed7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk\" (UID: \"97194eab-7f39-4076-bc88-75334dcc8ed7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk" Jul 13 07:18:40.400128 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.400017 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97194eab-7f39-4076-bc88-75334dcc8ed7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk\" (UID: \"97194eab-7f39-4076-bc88-75334dcc8ed7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk" Jul 13 07:18:40.400128 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.400071 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f2d7\" (UniqueName: \"kubernetes.io/projected/97194eab-7f39-4076-bc88-75334dcc8ed7-kube-api-access-6f2d7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk\" (UID: \"97194eab-7f39-4076-bc88-75334dcc8ed7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk" Jul 13 07:18:40.500884 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.500857 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f2d7\" (UniqueName: \"kubernetes.io/projected/97194eab-7f39-4076-bc88-75334dcc8ed7-kube-api-access-6f2d7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk\" (UID: \"97194eab-7f39-4076-bc88-75334dcc8ed7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk" Jul 13 07:18:40.501003 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.500911 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97194eab-7f39-4076-bc88-75334dcc8ed7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk\" (UID: \"97194eab-7f39-4076-bc88-75334dcc8ed7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk" Jul 13 07:18:40.501003 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.500944 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97194eab-7f39-4076-bc88-75334dcc8ed7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk\" (UID: \"97194eab-7f39-4076-bc88-75334dcc8ed7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk" Jul 13 07:18:40.501278 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.501259 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97194eab-7f39-4076-bc88-75334dcc8ed7-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk\" (UID: \"97194eab-7f39-4076-bc88-75334dcc8ed7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk" Jul 13 07:18:40.501365 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.501285 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97194eab-7f39-4076-bc88-75334dcc8ed7-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk\" (UID: \"97194eab-7f39-4076-bc88-75334dcc8ed7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk" Jul 13 07:18:40.509439 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.509423 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f2d7\" (UniqueName: \"kubernetes.io/projected/97194eab-7f39-4076-bc88-75334dcc8ed7-kube-api-access-6f2d7\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk\" (UID: \"97194eab-7f39-4076-bc88-75334dcc8ed7\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk" Jul 13 07:18:40.614459 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.614410 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk" Jul 13 07:18:40.754634 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.754610 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk"] Jul 13 07:18:40.756174 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:18:40.756148 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97194eab_7f39_4076_bc88_75334dcc8ed7.slice/crio-ce219ceaf94760065a911450cc4df3080cbb88b57c2072a80c9d16ea3be458e8 WatchSource:0}: Error finding container ce219ceaf94760065a911450cc4df3080cbb88b57c2072a80c9d16ea3be458e8: Status 404 returned error can't find the container with id ce219ceaf94760065a911450cc4df3080cbb88b57c2072a80c9d16ea3be458e8 Jul 13 07:18:40.787871 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.787843 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km"] Jul 13 07:18:40.790575 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.790560 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km" Jul 13 07:18:40.804074 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.804053 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km"] Jul 13 07:18:40.903349 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.903279 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/462db094-9794-4b22-8ca0-473068ed3c32-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km\" (UID: \"462db094-9794-4b22-8ca0-473068ed3c32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km" Jul 13 07:18:40.903349 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.903308 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l85vp\" (UniqueName: \"kubernetes.io/projected/462db094-9794-4b22-8ca0-473068ed3c32-kube-api-access-l85vp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km\" (UID: \"462db094-9794-4b22-8ca0-473068ed3c32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km" Jul 13 07:18:40.903490 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:40.903350 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/462db094-9794-4b22-8ca0-473068ed3c32-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km\" (UID: \"462db094-9794-4b22-8ca0-473068ed3c32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km" Jul 13 07:18:41.004021 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.003992 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/462db094-9794-4b22-8ca0-473068ed3c32-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km\" (UID: \"462db094-9794-4b22-8ca0-473068ed3c32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km" Jul 13 07:18:41.004160 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.004078 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/462db094-9794-4b22-8ca0-473068ed3c32-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km\" (UID: \"462db094-9794-4b22-8ca0-473068ed3c32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km" Jul 13 07:18:41.004160 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.004098 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l85vp\" (UniqueName: \"kubernetes.io/projected/462db094-9794-4b22-8ca0-473068ed3c32-kube-api-access-l85vp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km\" (UID: \"462db094-9794-4b22-8ca0-473068ed3c32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km" Jul 13 07:18:41.004368 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.004350 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/462db094-9794-4b22-8ca0-473068ed3c32-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km\" (UID: \"462db094-9794-4b22-8ca0-473068ed3c32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km" Jul 13 07:18:41.004469 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.004449 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/462db094-9794-4b22-8ca0-473068ed3c32-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km\" (UID: \"462db094-9794-4b22-8ca0-473068ed3c32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km" Jul 13 07:18:41.012666 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.012643 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l85vp\" (UniqueName: \"kubernetes.io/projected/462db094-9794-4b22-8ca0-473068ed3c32-kube-api-access-l85vp\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km\" (UID: \"462db094-9794-4b22-8ca0-473068ed3c32\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km" Jul 13 07:18:41.104219 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.104193 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km" Jul 13 07:18:41.115172 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.115150 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m"] Jul 13 07:18:41.118226 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.118204 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m" Jul 13 07:18:41.129365 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.129339 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m"] Jul 13 07:18:41.205138 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.205111 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5626ff45-1355-4328-bd1e-902fe9565e51-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m\" (UID: \"5626ff45-1355-4328-bd1e-902fe9565e51\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m" Jul 13 07:18:41.205282 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.205174 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5626ff45-1355-4328-bd1e-902fe9565e51-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m\" (UID: \"5626ff45-1355-4328-bd1e-902fe9565e51\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m" Jul 13 07:18:41.205282 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.205193 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4fzh\" (UniqueName: \"kubernetes.io/projected/5626ff45-1355-4328-bd1e-902fe9565e51-kube-api-access-v4fzh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m\" (UID: \"5626ff45-1355-4328-bd1e-902fe9565e51\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m" Jul 13 07:18:41.235117 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.235097 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km"] Jul 13 07:18:41.237724 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:18:41.237700 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod462db094_9794_4b22_8ca0_473068ed3c32.slice/crio-20e788ade79c805ecccf0f621ca80e2d5b8a4ea87fd627d509da79984c9c2141 WatchSource:0}: Error finding container 20e788ade79c805ecccf0f621ca80e2d5b8a4ea87fd627d509da79984c9c2141: Status 404 returned error can't find the container with id 20e788ade79c805ecccf0f621ca80e2d5b8a4ea87fd627d509da79984c9c2141 Jul 13 07:18:41.252693 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.252665 2565 generic.go:356] "Generic (PLEG): container finished" podID="97194eab-7f39-4076-bc88-75334dcc8ed7" containerID="dac6ab0ab1b11781efc403e58ffafcfaba49c5066c8a08f7fd1eb4939005a1e4" exitCode=0 Jul 13 07:18:41.252810 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.252748 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk" event={"ID":"97194eab-7f39-4076-bc88-75334dcc8ed7","Type":"ContainerDied","Data":"dac6ab0ab1b11781efc403e58ffafcfaba49c5066c8a08f7fd1eb4939005a1e4"} Jul 13 07:18:41.252873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.252806 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk" event={"ID":"97194eab-7f39-4076-bc88-75334dcc8ed7","Type":"ContainerStarted","Data":"ce219ceaf94760065a911450cc4df3080cbb88b57c2072a80c9d16ea3be458e8"} Jul 13 07:18:41.254104 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.254077 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km" event={"ID":"462db094-9794-4b22-8ca0-473068ed3c32","Type":"ContainerStarted","Data":"20e788ade79c805ecccf0f621ca80e2d5b8a4ea87fd627d509da79984c9c2141"} Jul 13 07:18:41.255706 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.255682 2565 generic.go:356] "Generic (PLEG): container finished" podID="302ee945-6eef-40ba-8378-adcba96f53f9" containerID="00c6e4963718e6bc0eb6f31fefb9397baf9edfa0152423bdee0382d3a4813d3f" exitCode=0 Jul 13 07:18:41.255781 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.255715 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb" event={"ID":"302ee945-6eef-40ba-8378-adcba96f53f9","Type":"ContainerDied","Data":"00c6e4963718e6bc0eb6f31fefb9397baf9edfa0152423bdee0382d3a4813d3f"} Jul 13 07:18:41.306494 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.306470 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5626ff45-1355-4328-bd1e-902fe9565e51-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m\" (UID: \"5626ff45-1355-4328-bd1e-902fe9565e51\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m" Jul 13 07:18:41.306609 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.306502 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4fzh\" (UniqueName: \"kubernetes.io/projected/5626ff45-1355-4328-bd1e-902fe9565e51-kube-api-access-v4fzh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m\" (UID: \"5626ff45-1355-4328-bd1e-902fe9565e51\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m" Jul 13 07:18:41.306609 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.306561 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5626ff45-1355-4328-bd1e-902fe9565e51-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m\" (UID: \"5626ff45-1355-4328-bd1e-902fe9565e51\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m" Jul 13 07:18:41.306832 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.306811 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5626ff45-1355-4328-bd1e-902fe9565e51-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m\" (UID: \"5626ff45-1355-4328-bd1e-902fe9565e51\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m" Jul 13 07:18:41.306901 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.306833 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5626ff45-1355-4328-bd1e-902fe9565e51-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m\" (UID: \"5626ff45-1355-4328-bd1e-902fe9565e51\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m" Jul 13 07:18:41.314577 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.314554 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4fzh\" (UniqueName: \"kubernetes.io/projected/5626ff45-1355-4328-bd1e-902fe9565e51-kube-api-access-v4fzh\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m\" (UID: \"5626ff45-1355-4328-bd1e-902fe9565e51\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m" Jul 13 07:18:41.435807 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.435737 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m" Jul 13 07:18:41.560083 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.560045 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m"] Jul 13 07:18:41.562168 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:18:41.562141 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5626ff45_1355_4328_bd1e_902fe9565e51.slice/crio-7a2ca297f2ad4c7aa374191b84d30a83b11ca9dea2d8b3470953fcfdede6b28a WatchSource:0}: Error finding container 7a2ca297f2ad4c7aa374191b84d30a83b11ca9dea2d8b3470953fcfdede6b28a: Status 404 returned error can't find the container with id 7a2ca297f2ad4c7aa374191b84d30a83b11ca9dea2d8b3470953fcfdede6b28a Jul 13 07:18:41.772715 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.772685 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:41.883623 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.883591 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:41.985185 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:41.985150 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:42.261396 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:42.261365 2565 generic.go:356] "Generic (PLEG): container finished" podID="97194eab-7f39-4076-bc88-75334dcc8ed7" containerID="1664ea70948ebcda650bcfa4e3e32377a30d2f6b3795eec95e92663005b52622" exitCode=0 Jul 13 07:18:42.261542 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:42.261447 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk" event={"ID":"97194eab-7f39-4076-bc88-75334dcc8ed7","Type":"ContainerDied","Data":"1664ea70948ebcda650bcfa4e3e32377a30d2f6b3795eec95e92663005b52622"} Jul 13 07:18:42.262913 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:42.262819 2565 generic.go:356] "Generic (PLEG): container finished" podID="5626ff45-1355-4328-bd1e-902fe9565e51" containerID="7c1b0b2664d070f5665b1ddcaa4e726cb80dd874534a61a48bd80d69d7d644d6" exitCode=0 Jul 13 07:18:42.262987 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:42.262911 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m" event={"ID":"5626ff45-1355-4328-bd1e-902fe9565e51","Type":"ContainerDied","Data":"7c1b0b2664d070f5665b1ddcaa4e726cb80dd874534a61a48bd80d69d7d644d6"} Jul 13 07:18:42.262987 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:42.262943 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m" event={"ID":"5626ff45-1355-4328-bd1e-902fe9565e51","Type":"ContainerStarted","Data":"7a2ca297f2ad4c7aa374191b84d30a83b11ca9dea2d8b3470953fcfdede6b28a"} Jul 13 07:18:42.264465 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:42.264440 2565 generic.go:356] "Generic (PLEG): container finished" podID="462db094-9794-4b22-8ca0-473068ed3c32" containerID="f69be68cd14a5fe8df2331093bf3e29e9ac9f85bff2e88342d75cb33ffc8c6dc" exitCode=0 Jul 13 07:18:42.264553 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:42.264533 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km" event={"ID":"462db094-9794-4b22-8ca0-473068ed3c32","Type":"ContainerDied","Data":"f69be68cd14a5fe8df2331093bf3e29e9ac9f85bff2e88342d75cb33ffc8c6dc"} Jul 13 07:18:42.266543 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:42.266523 2565 generic.go:356] "Generic (PLEG): container finished" podID="302ee945-6eef-40ba-8378-adcba96f53f9" containerID="6c7069c68cc30a49f4aa3bad85c1750290f7944c9d0116ed8bc375a122f80097" exitCode=0 Jul 13 07:18:42.266674 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:42.266619 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb" event={"ID":"302ee945-6eef-40ba-8378-adcba96f53f9","Type":"ContainerDied","Data":"6c7069c68cc30a49f4aa3bad85c1750290f7944c9d0116ed8bc375a122f80097"} Jul 13 07:18:42.522976 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:42.522940 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:42.582932 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:42.582852 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:43.273671 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:43.273643 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km" event={"ID":"462db094-9794-4b22-8ca0-473068ed3c32","Type":"ContainerStarted","Data":"d546029074d66ff30a4eb4b133f32ccb79a466d95081f22cbba88991909c6161"} Jul 13 07:18:43.275889 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:43.275865 2565 generic.go:356] "Generic (PLEG): container finished" podID="302ee945-6eef-40ba-8378-adcba96f53f9" containerID="a1ffeb95ec3379c63b607496b3e96cb98e7d25d33f6b46d700f41ffbc2888f10" exitCode=0 Jul 13 07:18:43.275977 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:43.275956 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb" event={"ID":"302ee945-6eef-40ba-8378-adcba96f53f9","Type":"ContainerDied","Data":"a1ffeb95ec3379c63b607496b3e96cb98e7d25d33f6b46d700f41ffbc2888f10"} Jul 13 07:18:43.278135 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:43.278090 2565 generic.go:356] "Generic (PLEG): container finished" podID="97194eab-7f39-4076-bc88-75334dcc8ed7" containerID="40b410a4876acf03b3068fc451c5819dfc14c153f026de896c418b5a9a7942f1" exitCode=0 Jul 13 07:18:43.278186 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:43.278151 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk" event={"ID":"97194eab-7f39-4076-bc88-75334dcc8ed7","Type":"ContainerDied","Data":"40b410a4876acf03b3068fc451c5819dfc14c153f026de896c418b5a9a7942f1"} Jul 13 07:18:43.279883 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:43.279864 2565 generic.go:356] "Generic (PLEG): container finished" podID="5626ff45-1355-4328-bd1e-902fe9565e51" containerID="f0b952721ee2790eef914f4f28523f252f45357a4957aaf8e1492c0dfa286970" exitCode=0 Jul 13 07:18:43.279960 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:43.279916 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m" event={"ID":"5626ff45-1355-4328-bd1e-902fe9565e51","Type":"ContainerDied","Data":"f0b952721ee2790eef914f4f28523f252f45357a4957aaf8e1492c0dfa286970"} Jul 13 07:18:44.292257 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.292222 2565 generic.go:356] "Generic (PLEG): container finished" podID="462db094-9794-4b22-8ca0-473068ed3c32" containerID="d546029074d66ff30a4eb4b133f32ccb79a466d95081f22cbba88991909c6161" exitCode=0 Jul 13 07:18:44.292257 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.292251 2565 generic.go:356] "Generic (PLEG): container finished" podID="462db094-9794-4b22-8ca0-473068ed3c32" containerID="54b7d1fd1f79f9416bc72c07e97fcff9ec559bf62884dcda5e1bec0d1144d74a" exitCode=0 Jul 13 07:18:44.292740 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.292303 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km" event={"ID":"462db094-9794-4b22-8ca0-473068ed3c32","Type":"ContainerDied","Data":"d546029074d66ff30a4eb4b133f32ccb79a466d95081f22cbba88991909c6161"} Jul 13 07:18:44.292740 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.292402 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km" event={"ID":"462db094-9794-4b22-8ca0-473068ed3c32","Type":"ContainerDied","Data":"54b7d1fd1f79f9416bc72c07e97fcff9ec559bf62884dcda5e1bec0d1144d74a"} Jul 13 07:18:44.294357 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.294329 2565 generic.go:356] "Generic (PLEG): container finished" podID="5626ff45-1355-4328-bd1e-902fe9565e51" containerID="ec8845616eb64cf96341b62a6c3aed291c49e6f5c3340975bd553880afd2778d" exitCode=0 Jul 13 07:18:44.294454 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.294390 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m" event={"ID":"5626ff45-1355-4328-bd1e-902fe9565e51","Type":"ContainerDied","Data":"ec8845616eb64cf96341b62a6c3aed291c49e6f5c3340975bd553880afd2778d"} Jul 13 07:18:44.423362 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.423339 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb" Jul 13 07:18:44.451640 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.451615 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk" Jul 13 07:18:44.533428 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.533395 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vd4gl\" (UniqueName: \"kubernetes.io/projected/302ee945-6eef-40ba-8378-adcba96f53f9-kube-api-access-vd4gl\") pod \"302ee945-6eef-40ba-8378-adcba96f53f9\" (UID: \"302ee945-6eef-40ba-8378-adcba96f53f9\") " Jul 13 07:18:44.533579 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.533446 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/302ee945-6eef-40ba-8378-adcba96f53f9-bundle\") pod \"302ee945-6eef-40ba-8378-adcba96f53f9\" (UID: \"302ee945-6eef-40ba-8378-adcba96f53f9\") " Jul 13 07:18:44.533579 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.533467 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/302ee945-6eef-40ba-8378-adcba96f53f9-util\") pod \"302ee945-6eef-40ba-8378-adcba96f53f9\" (UID: \"302ee945-6eef-40ba-8378-adcba96f53f9\") " Jul 13 07:18:44.534134 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.534110 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/302ee945-6eef-40ba-8378-adcba96f53f9-bundle" (OuterVolumeSpecName: "bundle") pod "302ee945-6eef-40ba-8378-adcba96f53f9" (UID: "302ee945-6eef-40ba-8378-adcba96f53f9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:18:44.535472 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.535451 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/302ee945-6eef-40ba-8378-adcba96f53f9-kube-api-access-vd4gl" (OuterVolumeSpecName: "kube-api-access-vd4gl") pod "302ee945-6eef-40ba-8378-adcba96f53f9" (UID: "302ee945-6eef-40ba-8378-adcba96f53f9"). InnerVolumeSpecName "kube-api-access-vd4gl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:18:44.539395 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.539374 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/302ee945-6eef-40ba-8378-adcba96f53f9-util" (OuterVolumeSpecName: "util") pod "302ee945-6eef-40ba-8378-adcba96f53f9" (UID: "302ee945-6eef-40ba-8378-adcba96f53f9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:18:44.634199 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.634130 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97194eab-7f39-4076-bc88-75334dcc8ed7-bundle\") pod \"97194eab-7f39-4076-bc88-75334dcc8ed7\" (UID: \"97194eab-7f39-4076-bc88-75334dcc8ed7\") " Jul 13 07:18:44.634199 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.634186 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f2d7\" (UniqueName: \"kubernetes.io/projected/97194eab-7f39-4076-bc88-75334dcc8ed7-kube-api-access-6f2d7\") pod \"97194eab-7f39-4076-bc88-75334dcc8ed7\" (UID: \"97194eab-7f39-4076-bc88-75334dcc8ed7\") " Jul 13 07:18:44.634395 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.634214 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97194eab-7f39-4076-bc88-75334dcc8ed7-util\") pod \"97194eab-7f39-4076-bc88-75334dcc8ed7\" (UID: \"97194eab-7f39-4076-bc88-75334dcc8ed7\") " Jul 13 07:18:44.634395 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.634364 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/302ee945-6eef-40ba-8378-adcba96f53f9-bundle\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:18:44.634395 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.634379 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/302ee945-6eef-40ba-8378-adcba96f53f9-util\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:18:44.634395 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.634392 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vd4gl\" (UniqueName: \"kubernetes.io/projected/302ee945-6eef-40ba-8378-adcba96f53f9-kube-api-access-vd4gl\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:18:44.634775 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.634748 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97194eab-7f39-4076-bc88-75334dcc8ed7-bundle" (OuterVolumeSpecName: "bundle") pod "97194eab-7f39-4076-bc88-75334dcc8ed7" (UID: "97194eab-7f39-4076-bc88-75334dcc8ed7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:18:44.636134 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.636105 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97194eab-7f39-4076-bc88-75334dcc8ed7-kube-api-access-6f2d7" (OuterVolumeSpecName: "kube-api-access-6f2d7") pod "97194eab-7f39-4076-bc88-75334dcc8ed7" (UID: "97194eab-7f39-4076-bc88-75334dcc8ed7"). InnerVolumeSpecName "kube-api-access-6f2d7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:18:44.639591 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.639570 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97194eab-7f39-4076-bc88-75334dcc8ed7-util" (OuterVolumeSpecName: "util") pod "97194eab-7f39-4076-bc88-75334dcc8ed7" (UID: "97194eab-7f39-4076-bc88-75334dcc8ed7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:18:44.734906 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.734876 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f2d7\" (UniqueName: \"kubernetes.io/projected/97194eab-7f39-4076-bc88-75334dcc8ed7-kube-api-access-6f2d7\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:18:44.734906 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.734901 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97194eab-7f39-4076-bc88-75334dcc8ed7-util\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:18:44.734906 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:44.734910 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97194eab-7f39-4076-bc88-75334dcc8ed7-bundle\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:18:45.300933 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.300906 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk" Jul 13 07:18:45.301330 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.300939 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk" event={"ID":"97194eab-7f39-4076-bc88-75334dcc8ed7","Type":"ContainerDied","Data":"ce219ceaf94760065a911450cc4df3080cbb88b57c2072a80c9d16ea3be458e8"} Jul 13 07:18:45.301330 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.300988 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce219ceaf94760065a911450cc4df3080cbb88b57c2072a80c9d16ea3be458e8" Jul 13 07:18:45.302923 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.302901 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb" Jul 13 07:18:45.303036 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.302920 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb" event={"ID":"302ee945-6eef-40ba-8378-adcba96f53f9","Type":"ContainerDied","Data":"f0bdc3907664c75e2a08e127b581b64b8b2fad090129ae2d127769143f3704e6"} Jul 13 07:18:45.303036 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.302955 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f0bdc3907664c75e2a08e127b581b64b8b2fad090129ae2d127769143f3704e6" Jul 13 07:18:45.437085 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.437060 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m" Jul 13 07:18:45.468422 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.468400 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km" Jul 13 07:18:45.541302 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.541274 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5626ff45-1355-4328-bd1e-902fe9565e51-util\") pod \"5626ff45-1355-4328-bd1e-902fe9565e51\" (UID: \"5626ff45-1355-4328-bd1e-902fe9565e51\") " Jul 13 07:18:45.541469 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.541310 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v4fzh\" (UniqueName: \"kubernetes.io/projected/5626ff45-1355-4328-bd1e-902fe9565e51-kube-api-access-v4fzh\") pod \"5626ff45-1355-4328-bd1e-902fe9565e51\" (UID: \"5626ff45-1355-4328-bd1e-902fe9565e51\") " Jul 13 07:18:45.541469 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.541406 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5626ff45-1355-4328-bd1e-902fe9565e51-bundle\") pod \"5626ff45-1355-4328-bd1e-902fe9565e51\" (UID: \"5626ff45-1355-4328-bd1e-902fe9565e51\") " Jul 13 07:18:45.541869 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.541837 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5626ff45-1355-4328-bd1e-902fe9565e51-bundle" (OuterVolumeSpecName: "bundle") pod "5626ff45-1355-4328-bd1e-902fe9565e51" (UID: "5626ff45-1355-4328-bd1e-902fe9565e51"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:18:45.543446 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.543424 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5626ff45-1355-4328-bd1e-902fe9565e51-kube-api-access-v4fzh" (OuterVolumeSpecName: "kube-api-access-v4fzh") pod "5626ff45-1355-4328-bd1e-902fe9565e51" (UID: "5626ff45-1355-4328-bd1e-902fe9565e51"). InnerVolumeSpecName "kube-api-access-v4fzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:18:45.546800 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.546758 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5626ff45-1355-4328-bd1e-902fe9565e51-util" (OuterVolumeSpecName: "util") pod "5626ff45-1355-4328-bd1e-902fe9565e51" (UID: "5626ff45-1355-4328-bd1e-902fe9565e51"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:18:45.642412 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.642350 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/462db094-9794-4b22-8ca0-473068ed3c32-bundle\") pod \"462db094-9794-4b22-8ca0-473068ed3c32\" (UID: \"462db094-9794-4b22-8ca0-473068ed3c32\") " Jul 13 07:18:45.642412 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.642389 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l85vp\" (UniqueName: \"kubernetes.io/projected/462db094-9794-4b22-8ca0-473068ed3c32-kube-api-access-l85vp\") pod \"462db094-9794-4b22-8ca0-473068ed3c32\" (UID: \"462db094-9794-4b22-8ca0-473068ed3c32\") " Jul 13 07:18:45.642603 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.642469 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/462db094-9794-4b22-8ca0-473068ed3c32-util\") pod \"462db094-9794-4b22-8ca0-473068ed3c32\" (UID: \"462db094-9794-4b22-8ca0-473068ed3c32\") " Jul 13 07:18:45.642671 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.642607 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5626ff45-1355-4328-bd1e-902fe9565e51-bundle\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:18:45.642671 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.642625 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5626ff45-1355-4328-bd1e-902fe9565e51-util\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:18:45.642671 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.642638 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v4fzh\" (UniqueName: \"kubernetes.io/projected/5626ff45-1355-4328-bd1e-902fe9565e51-kube-api-access-v4fzh\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:18:45.642931 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.642900 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/462db094-9794-4b22-8ca0-473068ed3c32-bundle" (OuterVolumeSpecName: "bundle") pod "462db094-9794-4b22-8ca0-473068ed3c32" (UID: "462db094-9794-4b22-8ca0-473068ed3c32"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:18:45.644564 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.644536 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/462db094-9794-4b22-8ca0-473068ed3c32-kube-api-access-l85vp" (OuterVolumeSpecName: "kube-api-access-l85vp") pod "462db094-9794-4b22-8ca0-473068ed3c32" (UID: "462db094-9794-4b22-8ca0-473068ed3c32"). InnerVolumeSpecName "kube-api-access-l85vp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:18:45.648378 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.648355 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/462db094-9794-4b22-8ca0-473068ed3c32-util" (OuterVolumeSpecName: "util") pod "462db094-9794-4b22-8ca0-473068ed3c32" (UID: "462db094-9794-4b22-8ca0-473068ed3c32"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:18:45.743106 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.743073 2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/462db094-9794-4b22-8ca0-473068ed3c32-util\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:18:45.743106 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.743100 2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/462db094-9794-4b22-8ca0-473068ed3c32-bundle\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:18:45.743106 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:45.743110 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l85vp\" (UniqueName: \"kubernetes.io/projected/462db094-9794-4b22-8ca0-473068ed3c32-kube-api-access-l85vp\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:18:46.309649 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:46.309621 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m" Jul 13 07:18:46.309649 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:46.309637 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m" event={"ID":"5626ff45-1355-4328-bd1e-902fe9565e51","Type":"ContainerDied","Data":"7a2ca297f2ad4c7aa374191b84d30a83b11ca9dea2d8b3470953fcfdede6b28a"} Jul 13 07:18:46.310155 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:46.309677 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a2ca297f2ad4c7aa374191b84d30a83b11ca9dea2d8b3470953fcfdede6b28a" Jul 13 07:18:46.311435 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:46.311410 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km" event={"ID":"462db094-9794-4b22-8ca0-473068ed3c32","Type":"ContainerDied","Data":"20e788ade79c805ecccf0f621ca80e2d5b8a4ea87fd627d509da79984c9c2141"} Jul 13 07:18:46.311435 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:46.311431 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km" Jul 13 07:18:46.311629 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:46.311449 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20e788ade79c805ecccf0f621ca80e2d5b8a4ea87fd627d509da79984c9c2141" Jul 13 07:18:47.308723 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:47.308689 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:50.905459 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:50.905423 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:52.264293 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264256 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g"] Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264556 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97194eab-7f39-4076-bc88-75334dcc8ed7" containerName="util" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264567 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="97194eab-7f39-4076-bc88-75334dcc8ed7" containerName="util" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264576 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="302ee945-6eef-40ba-8378-adcba96f53f9" containerName="pull" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264581 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="302ee945-6eef-40ba-8378-adcba96f53f9" containerName="pull" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264587 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="462db094-9794-4b22-8ca0-473068ed3c32" containerName="pull" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264592 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="462db094-9794-4b22-8ca0-473068ed3c32" containerName="pull" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264599 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="302ee945-6eef-40ba-8378-adcba96f53f9" containerName="util" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264604 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="302ee945-6eef-40ba-8378-adcba96f53f9" containerName="util" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264610 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="462db094-9794-4b22-8ca0-473068ed3c32" containerName="util" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264615 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="462db094-9794-4b22-8ca0-473068ed3c32" containerName="util" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264621 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5626ff45-1355-4328-bd1e-902fe9565e51" containerName="extract" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264626 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5626ff45-1355-4328-bd1e-902fe9565e51" containerName="extract" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264637 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="302ee945-6eef-40ba-8378-adcba96f53f9" containerName="extract" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264642 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="302ee945-6eef-40ba-8378-adcba96f53f9" containerName="extract" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264647 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="462db094-9794-4b22-8ca0-473068ed3c32" containerName="extract" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264653 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="462db094-9794-4b22-8ca0-473068ed3c32" containerName="extract" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264663 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5626ff45-1355-4328-bd1e-902fe9565e51" containerName="pull" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264668 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5626ff45-1355-4328-bd1e-902fe9565e51" containerName="pull" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264676 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97194eab-7f39-4076-bc88-75334dcc8ed7" containerName="extract" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264681 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="97194eab-7f39-4076-bc88-75334dcc8ed7" containerName="extract" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264687 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5626ff45-1355-4328-bd1e-902fe9565e51" containerName="util" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264692 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5626ff45-1355-4328-bd1e-902fe9565e51" containerName="util" Jul 13 07:18:52.264686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264698 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97194eab-7f39-4076-bc88-75334dcc8ed7" containerName="pull" Jul 13 07:18:52.265425 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264703 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="97194eab-7f39-4076-bc88-75334dcc8ed7" containerName="pull" Jul 13 07:18:52.265425 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264747 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="462db094-9794-4b22-8ca0-473068ed3c32" containerName="extract" Jul 13 07:18:52.265425 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264753 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="97194eab-7f39-4076-bc88-75334dcc8ed7" containerName="extract" Jul 13 07:18:52.265425 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264760 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5626ff45-1355-4328-bd1e-902fe9565e51" containerName="extract" Jul 13 07:18:52.265425 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.264766 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="302ee945-6eef-40ba-8378-adcba96f53f9" containerName="extract" Jul 13 07:18:52.267577 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.267561 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:18:52.275280 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.275259 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7dvk4\"" Jul 13 07:18:52.287255 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.287228 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g"] Jul 13 07:18:52.399406 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.399363 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93880254-13f3-43a1-b1f3-bfe6b401e827-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8qb5g\" (UID: \"93880254-13f3-43a1-b1f3-bfe6b401e827\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:18:52.399406 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.399415 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnd9d\" (UniqueName: \"kubernetes.io/projected/93880254-13f3-43a1-b1f3-bfe6b401e827-kube-api-access-gnd9d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8qb5g\" (UID: \"93880254-13f3-43a1-b1f3-bfe6b401e827\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:18:52.457016 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.456967 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:52.500009 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.499982 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93880254-13f3-43a1-b1f3-bfe6b401e827-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8qb5g\" (UID: \"93880254-13f3-43a1-b1f3-bfe6b401e827\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:18:52.500155 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.500015 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnd9d\" (UniqueName: \"kubernetes.io/projected/93880254-13f3-43a1-b1f3-bfe6b401e827-kube-api-access-gnd9d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8qb5g\" (UID: \"93880254-13f3-43a1-b1f3-bfe6b401e827\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:18:52.500399 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.500380 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93880254-13f3-43a1-b1f3-bfe6b401e827-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8qb5g\" (UID: \"93880254-13f3-43a1-b1f3-bfe6b401e827\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:18:52.523238 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.523177 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnd9d\" (UniqueName: \"kubernetes.io/projected/93880254-13f3-43a1-b1f3-bfe6b401e827-kube-api-access-gnd9d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-8qb5g\" (UID: \"93880254-13f3-43a1-b1f3-bfe6b401e827\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:18:52.576966 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.576937 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:18:52.713131 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.713104 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g"] Jul 13 07:18:52.715950 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:18:52.715918 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93880254_13f3_43a1_b1f3_bfe6b401e827.slice/crio-2bb0ea8a479d5b95b6fa9166456615e9aebcb19851076650055bbd597af93e56 WatchSource:0}: Error finding container 2bb0ea8a479d5b95b6fa9166456615e9aebcb19851076650055bbd597af93e56: Status 404 returned error can't find the container with id 2bb0ea8a479d5b95b6fa9166456615e9aebcb19851076650055bbd597af93e56 Jul 13 07:18:52.818057 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:52.817971 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:53.131116 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:53.131032 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:53.245346 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:53.245295 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:53.344842 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:53.344810 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" event={"ID":"93880254-13f3-43a1-b1f3-bfe6b401e827","Type":"ContainerStarted","Data":"2bb0ea8a479d5b95b6fa9166456615e9aebcb19851076650055bbd597af93e56"} Jul 13 07:18:53.347903 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:53.347872 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:53.451031 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:53.450928 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:53.906410 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:53.906373 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:55.230435 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:55.230405 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ztvnq"] Jul 13 07:18:55.233090 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:55.233068 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztvnq" Jul 13 07:18:55.235773 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:55.235750 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-plmmp\"" Jul 13 07:18:55.243204 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:55.243142 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ztvnq"] Jul 13 07:18:55.317564 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:55.317524 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfmlg\" (UniqueName: \"kubernetes.io/projected/761ec76e-0c8a-4f0a-a890-b20f046b278e-kube-api-access-cfmlg\") pod \"authorino-operator-75cc8d5cb7-ztvnq\" (UID: \"761ec76e-0c8a-4f0a-a890-b20f046b278e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztvnq" Jul 13 07:18:55.419004 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:55.418972 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfmlg\" (UniqueName: \"kubernetes.io/projected/761ec76e-0c8a-4f0a-a890-b20f046b278e-kube-api-access-cfmlg\") pod \"authorino-operator-75cc8d5cb7-ztvnq\" (UID: \"761ec76e-0c8a-4f0a-a890-b20f046b278e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztvnq" Jul 13 07:18:55.444556 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:55.444530 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfmlg\" (UniqueName: \"kubernetes.io/projected/761ec76e-0c8a-4f0a-a890-b20f046b278e-kube-api-access-cfmlg\") pod \"authorino-operator-75cc8d5cb7-ztvnq\" (UID: \"761ec76e-0c8a-4f0a-a890-b20f046b278e\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztvnq" Jul 13 07:18:55.450369 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:55.450335 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:55.548010 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:55.547977 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztvnq" Jul 13 07:18:55.553171 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:55.553142 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:55.692535 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:55.692506 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ztvnq"] Jul 13 07:18:55.694585 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:18:55.694545 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod761ec76e_0c8a_4f0a_a890_b20f046b278e.slice/crio-669ea48a21bdbc6412935cd24b9de4bcfb88139e5cd2bdb967346173dc6e6178 WatchSource:0}: Error finding container 669ea48a21bdbc6412935cd24b9de4bcfb88139e5cd2bdb967346173dc6e6178: Status 404 returned error can't find the container with id 669ea48a21bdbc6412935cd24b9de4bcfb88139e5cd2bdb967346173dc6e6178 Jul 13 07:18:56.361470 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:56.361429 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztvnq" event={"ID":"761ec76e-0c8a-4f0a-a890-b20f046b278e","Type":"ContainerStarted","Data":"669ea48a21bdbc6412935cd24b9de4bcfb88139e5cd2bdb967346173dc6e6178"} Jul 13 07:18:57.049729 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:57.049693 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-nk465"] Jul 13 07:18:57.053236 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:57.053216 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nk465" Jul 13 07:18:57.057670 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:57.057649 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-9gptk\"" Jul 13 07:18:57.057794 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:57.057696 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 13 07:18:57.070517 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:57.070487 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-nk465"] Jul 13 07:18:57.129257 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:57.129212 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s4lr\" (UniqueName: \"kubernetes.io/projected/f4c816a3-9509-46d8-9746-52aead1d57d4-kube-api-access-7s4lr\") pod \"dns-operator-controller-manager-864dd78c4c-nk465\" (UID: \"f4c816a3-9509-46d8-9746-52aead1d57d4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nk465" Jul 13 07:18:57.230340 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:57.230284 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s4lr\" (UniqueName: \"kubernetes.io/projected/f4c816a3-9509-46d8-9746-52aead1d57d4-kube-api-access-7s4lr\") pod \"dns-operator-controller-manager-864dd78c4c-nk465\" (UID: \"f4c816a3-9509-46d8-9746-52aead1d57d4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nk465" Jul 13 07:18:57.246840 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:57.246809 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s4lr\" (UniqueName: \"kubernetes.io/projected/f4c816a3-9509-46d8-9746-52aead1d57d4-kube-api-access-7s4lr\") pod \"dns-operator-controller-manager-864dd78c4c-nk465\" (UID: \"f4c816a3-9509-46d8-9746-52aead1d57d4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nk465" Jul 13 07:18:57.364441 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:57.364339 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nk465" Jul 13 07:18:57.609881 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:57.609841 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:59.352029 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:59.348583 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-nk465"] Jul 13 07:18:59.379776 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:59.379723 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztvnq" event={"ID":"761ec76e-0c8a-4f0a-a890-b20f046b278e","Type":"ContainerStarted","Data":"2ebbc3a6ba3c08f58ab7faae65a9abfd129d4639f3c7d408ad5d25c8b6f613a4"} Jul 13 07:18:59.379924 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:59.379799 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztvnq" Jul 13 07:18:59.381305 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:59.381275 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" event={"ID":"93880254-13f3-43a1-b1f3-bfe6b401e827","Type":"ContainerStarted","Data":"786a0c5ee7283953af47627404dc1851ee38662c9c4b82de021486a52c636896"} Jul 13 07:18:59.381438 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:59.381355 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:18:59.382502 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:59.382482 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nk465" event={"ID":"f4c816a3-9509-46d8-9746-52aead1d57d4","Type":"ContainerStarted","Data":"a3591cc5d9c45c396e21829a551b078293bac82943c3c1fdcfadd740b0054adb"} Jul 13 07:18:59.398059 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:59.398035 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw"] Jul 13 07:18:59.401345 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:59.401307 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:18:59.404545 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:59.404527 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9j74r\"" Jul 13 07:18:59.410419 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:59.410375 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztvnq" podStartSLOduration=0.909479598 podStartE2EDuration="4.410362234s" totalImagesPullingTime="3.500882636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:18:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:18:59.408984749 +0000 UTC m=+416.331236922" watchObservedRunningTime="2026-07-13 07:18:59.410362234 +0000 UTC m=+416.332614406" Jul 13 07:18:59.415211 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:59.415190 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw"] Jul 13 07:18:59.446893 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:59.446826 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxj74\" (UniqueName: \"kubernetes.io/projected/dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee-kube-api-access-bxj74\") pod \"limitador-operator-controller-manager-859d7b78bd-mxcjw\" (UID: \"dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:18:59.465880 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:59.465830 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" podStartSLOduration=0.977787841 podStartE2EDuration="7.465816235s" totalImagesPullingTime="6.488028394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:18:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:18:59.463496042 +0000 UTC m=+416.385748215" watchObservedRunningTime="2026-07-13 07:18:59.465816235 +0000 UTC m=+416.388068410" Jul 13 07:18:59.547633 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:59.547598 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxj74\" (UniqueName: \"kubernetes.io/projected/dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee-kube-api-access-bxj74\") pod \"limitador-operator-controller-manager-859d7b78bd-mxcjw\" (UID: \"dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:18:59.556982 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:59.556949 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxj74\" (UniqueName: \"kubernetes.io/projected/dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee-kube-api-access-bxj74\") pod \"limitador-operator-controller-manager-859d7b78bd-mxcjw\" (UID: \"dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:18:59.573569 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:59.573539 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:18:59.712070 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:59.711982 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:18:59.847452 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:18:59.847426 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw"] Jul 13 07:18:59.849110 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:18:59.849085 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfedf46e_8e2c_4ed1_998d_1e22bf8d60ee.slice/crio-eea06dcc87a17b1d75cb749413d1f939a8e1d0308ae9aa06fc6b723a706d562d WatchSource:0}: Error finding container eea06dcc87a17b1d75cb749413d1f939a8e1d0308ae9aa06fc6b723a706d562d: Status 404 returned error can't find the container with id eea06dcc87a17b1d75cb749413d1f939a8e1d0308ae9aa06fc6b723a706d562d Jul 13 07:19:00.390671 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:00.390595 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" event={"ID":"dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee","Type":"ContainerStarted","Data":"eea06dcc87a17b1d75cb749413d1f939a8e1d0308ae9aa06fc6b723a706d562d"} Jul 13 07:19:01.264116 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:01.264076 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:01.385008 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:01.384970 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:02.343702 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:02.343653 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:02.403088 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:02.403042 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nk465" event={"ID":"f4c816a3-9509-46d8-9746-52aead1d57d4","Type":"ContainerStarted","Data":"aff55ef8d274cf52432f9e14fbf614554d5b12209988624ecfa24e9df5c17482"} Jul 13 07:19:02.403298 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:02.403135 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nk465" Jul 13 07:19:02.404895 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:02.404832 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" event={"ID":"dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee","Type":"ContainerStarted","Data":"85bdd5da90a1e73acdd90bd2e4be21bf88e446feb17d6a0cb1cfc3753085d070"} Jul 13 07:19:02.405030 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:02.404971 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:19:02.422692 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:02.422644 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nk465" podStartSLOduration=3.22816984 podStartE2EDuration="5.422629751s" totalImagesPullingTime="2.194459911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:19:02.41978692 +0000 UTC m=+419.342039094" watchObservedRunningTime="2026-07-13 07:19:02.422629751 +0000 UTC m=+419.344881951" Jul 13 07:19:02.435619 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:02.435574 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" podStartSLOduration=1.305009134 podStartE2EDuration="3.435554995s" totalImagesPullingTime="2.130545861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:19:02.435137776 +0000 UTC m=+419.357389949" watchObservedRunningTime="2026-07-13 07:19:02.435554995 +0000 UTC m=+419.357807169" Jul 13 07:19:02.523357 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:02.523295 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:10.392900 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:10.392869 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:19:10.393359 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:10.392954 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztvnq" Jul 13 07:19:11.481599 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:11.481555 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:11.577735 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:11.577699 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:12.166295 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.166256 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g"] Jul 13 07:19:12.166509 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.166451 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" podUID="93880254-13f3-43a1-b1f3-bfe6b401e827" containerName="manager" containerID="cri-o://786a0c5ee7283953af47627404dc1851ee38662c9c4b82de021486a52c636896" gracePeriod=2 Jul 13 07:19:12.171741 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.171712 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g"] Jul 13 07:19:12.187614 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.187555 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw"] Jul 13 07:19:12.187766 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.187737 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" podUID="dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee" containerName="manager" containerID="cri-o://85bdd5da90a1e73acdd90bd2e4be21bf88e446feb17d6a0cb1cfc3753085d070" gracePeriod=2 Jul 13 07:19:12.189670 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.189650 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:19:12.190366 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:12.190301 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8qb5g\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="93880254-13f3-43a1-b1f3-bfe6b401e827" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:19:12.195236 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.195214 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t"] Jul 13 07:19:12.195559 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.195543 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93880254-13f3-43a1-b1f3-bfe6b401e827" containerName="manager" Jul 13 07:19:12.195559 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.195559 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="93880254-13f3-43a1-b1f3-bfe6b401e827" containerName="manager" Jul 13 07:19:12.195696 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.195626 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="93880254-13f3-43a1-b1f3-bfe6b401e827" containerName="manager" Jul 13 07:19:12.198641 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.198622 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t" Jul 13 07:19:12.202807 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:12.202767 2565 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-mxcjw\": pods \"limitador-operator-controller-manager-859d7b78bd-mxcjw\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:19:12.203858 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.203832 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw"] Jul 13 07:19:12.204991 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:12.204949 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8qb5g\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="93880254-13f3-43a1-b1f3-bfe6b401e827" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:19:12.212768 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.212744 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t"] Jul 13 07:19:12.229035 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:12.228998 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mxcjw\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:19:12.257495 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.257457 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzsqz\" (UniqueName: \"kubernetes.io/projected/4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce-kube-api-access-fzsqz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nff2t\" (UID: \"4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t" Jul 13 07:19:12.257670 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.257637 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nff2t\" (UID: \"4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t" Jul 13 07:19:12.358808 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.358775 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nff2t\" (UID: \"4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t" Jul 13 07:19:12.358968 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.358842 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzsqz\" (UniqueName: \"kubernetes.io/projected/4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce-kube-api-access-fzsqz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nff2t\" (UID: \"4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t" Jul 13 07:19:12.359249 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.359220 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nff2t\" (UID: \"4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t" Jul 13 07:19:12.370244 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.370216 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzsqz\" (UniqueName: \"kubernetes.io/projected/4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce-kube-api-access-fzsqz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nff2t\" (UID: \"4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t" Jul 13 07:19:12.430784 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.430761 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:19:12.433127 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:12.433098 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mxcjw\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:19:12.433244 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.433230 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:19:12.434920 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:12.434899 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8qb5g\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="93880254-13f3-43a1-b1f3-bfe6b401e827" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:19:12.436718 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:12.436698 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mxcjw\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:19:12.438565 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:12.438548 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8qb5g\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="93880254-13f3-43a1-b1f3-bfe6b401e827" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:19:12.456726 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.456695 2565 generic.go:356] "Generic (PLEG): container finished" podID="dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee" containerID="85bdd5da90a1e73acdd90bd2e4be21bf88e446feb17d6a0cb1cfc3753085d070" exitCode=0 Jul 13 07:19:12.456847 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.456733 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:19:12.456847 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.456797 2565 scope.go:117] "RemoveContainer" containerID="85bdd5da90a1e73acdd90bd2e4be21bf88e446feb17d6a0cb1cfc3753085d070" Jul 13 07:19:12.458095 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.458075 2565 generic.go:356] "Generic (PLEG): container finished" podID="93880254-13f3-43a1-b1f3-bfe6b401e827" containerID="786a0c5ee7283953af47627404dc1851ee38662c9c4b82de021486a52c636896" exitCode=0 Jul 13 07:19:12.458211 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.458120 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:19:12.459281 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.459262 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxj74\" (UniqueName: \"kubernetes.io/projected/dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee-kube-api-access-bxj74\") pod \"dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee\" (UID: \"dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee\") " Jul 13 07:19:12.459380 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.459304 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnd9d\" (UniqueName: \"kubernetes.io/projected/93880254-13f3-43a1-b1f3-bfe6b401e827-kube-api-access-gnd9d\") pod \"93880254-13f3-43a1-b1f3-bfe6b401e827\" (UID: \"93880254-13f3-43a1-b1f3-bfe6b401e827\") " Jul 13 07:19:12.459380 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.459338 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93880254-13f3-43a1-b1f3-bfe6b401e827-extensions-socket-volume\") pod \"93880254-13f3-43a1-b1f3-bfe6b401e827\" (UID: \"93880254-13f3-43a1-b1f3-bfe6b401e827\") " Jul 13 07:19:12.459735 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.459710 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93880254-13f3-43a1-b1f3-bfe6b401e827-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "93880254-13f3-43a1-b1f3-bfe6b401e827" (UID: "93880254-13f3-43a1-b1f3-bfe6b401e827"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:19:12.461229 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.461206 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93880254-13f3-43a1-b1f3-bfe6b401e827-kube-api-access-gnd9d" (OuterVolumeSpecName: "kube-api-access-gnd9d") pod "93880254-13f3-43a1-b1f3-bfe6b401e827" (UID: "93880254-13f3-43a1-b1f3-bfe6b401e827"). InnerVolumeSpecName "kube-api-access-gnd9d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:19:12.461419 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.461398 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee-kube-api-access-bxj74" (OuterVolumeSpecName: "kube-api-access-bxj74") pod "dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee" (UID: "dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee"). InnerVolumeSpecName "kube-api-access-bxj74". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:19:12.461635 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:12.461601 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8qb5g\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="93880254-13f3-43a1-b1f3-bfe6b401e827" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:19:12.463745 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:12.463709 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mxcjw\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:19:12.465573 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.465558 2565 scope.go:117] "RemoveContainer" containerID="85bdd5da90a1e73acdd90bd2e4be21bf88e446feb17d6a0cb1cfc3753085d070" Jul 13 07:19:12.465722 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:12.465703 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mxcjw\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:19:12.465858 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:12.465838 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85bdd5da90a1e73acdd90bd2e4be21bf88e446feb17d6a0cb1cfc3753085d070\": container with ID starting with 85bdd5da90a1e73acdd90bd2e4be21bf88e446feb17d6a0cb1cfc3753085d070 not found: ID does not exist" containerID="85bdd5da90a1e73acdd90bd2e4be21bf88e446feb17d6a0cb1cfc3753085d070" Jul 13 07:19:12.465927 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.465870 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85bdd5da90a1e73acdd90bd2e4be21bf88e446feb17d6a0cb1cfc3753085d070"} err="failed to get container status \"85bdd5da90a1e73acdd90bd2e4be21bf88e446feb17d6a0cb1cfc3753085d070\": rpc error: code = NotFound desc = could not find container \"85bdd5da90a1e73acdd90bd2e4be21bf88e446feb17d6a0cb1cfc3753085d070\": container with ID starting with 85bdd5da90a1e73acdd90bd2e4be21bf88e446feb17d6a0cb1cfc3753085d070 not found: ID does not exist" Jul 13 07:19:12.465927 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.465893 2565 scope.go:117] "RemoveContainer" containerID="786a0c5ee7283953af47627404dc1851ee38662c9c4b82de021486a52c636896" Jul 13 07:19:12.467602 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:12.467577 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8qb5g\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="93880254-13f3-43a1-b1f3-bfe6b401e827" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:19:12.473823 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.473805 2565 scope.go:117] "RemoveContainer" containerID="786a0c5ee7283953af47627404dc1851ee38662c9c4b82de021486a52c636896" Jul 13 07:19:12.474066 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:12.474047 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"786a0c5ee7283953af47627404dc1851ee38662c9c4b82de021486a52c636896\": container with ID starting with 786a0c5ee7283953af47627404dc1851ee38662c9c4b82de021486a52c636896 not found: ID does not exist" containerID="786a0c5ee7283953af47627404dc1851ee38662c9c4b82de021486a52c636896" Jul 13 07:19:12.474162 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.474072 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"786a0c5ee7283953af47627404dc1851ee38662c9c4b82de021486a52c636896"} err="failed to get container status \"786a0c5ee7283953af47627404dc1851ee38662c9c4b82de021486a52c636896\": rpc error: code = NotFound desc = could not find container \"786a0c5ee7283953af47627404dc1851ee38662c9c4b82de021486a52c636896\": container with ID starting with 786a0c5ee7283953af47627404dc1851ee38662c9c4b82de021486a52c636896 not found: ID does not exist" Jul 13 07:19:12.489256 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.489230 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk"] Jul 13 07:19:12.489707 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.489594 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee" containerName="manager" Jul 13 07:19:12.489707 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.489611 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee" containerName="manager" Jul 13 07:19:12.489707 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.489705 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee" containerName="manager" Jul 13 07:19:12.494106 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.494086 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk" Jul 13 07:19:12.500763 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:12.500732 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mxcjw\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:19:12.509674 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.509650 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk"] Jul 13 07:19:12.525586 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:12.525560 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8qb5g\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="93880254-13f3-43a1-b1f3-bfe6b401e827" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:19:12.560006 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.559977 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb8vb\" (UniqueName: \"kubernetes.io/projected/7bddad45-e0c1-47e8-8a92-4fce721c04a3-kube-api-access-qb8vb\") pod \"kuadrant-operator-controller-manager-86878c769f-nw8xk\" (UID: \"7bddad45-e0c1-47e8-8a92-4fce721c04a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk" Jul 13 07:19:12.560104 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.560045 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7bddad45-e0c1-47e8-8a92-4fce721c04a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nw8xk\" (UID: \"7bddad45-e0c1-47e8-8a92-4fce721c04a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk" Jul 13 07:19:12.560104 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.560087 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxj74\" (UniqueName: \"kubernetes.io/projected/dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee-kube-api-access-bxj74\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:19:12.560174 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.560103 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnd9d\" (UniqueName: \"kubernetes.io/projected/93880254-13f3-43a1-b1f3-bfe6b401e827-kube-api-access-gnd9d\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:19:12.560174 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.560115 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/93880254-13f3-43a1-b1f3-bfe6b401e827-extensions-socket-volume\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:19:12.588995 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.588955 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t" Jul 13 07:19:12.660969 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.660938 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb8vb\" (UniqueName: \"kubernetes.io/projected/7bddad45-e0c1-47e8-8a92-4fce721c04a3-kube-api-access-qb8vb\") pod \"kuadrant-operator-controller-manager-86878c769f-nw8xk\" (UID: \"7bddad45-e0c1-47e8-8a92-4fce721c04a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk" Jul 13 07:19:12.661116 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.661008 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7bddad45-e0c1-47e8-8a92-4fce721c04a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nw8xk\" (UID: \"7bddad45-e0c1-47e8-8a92-4fce721c04a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk" Jul 13 07:19:12.661356 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.661336 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7bddad45-e0c1-47e8-8a92-4fce721c04a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nw8xk\" (UID: \"7bddad45-e0c1-47e8-8a92-4fce721c04a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk" Jul 13 07:19:12.670021 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.669994 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb8vb\" (UniqueName: \"kubernetes.io/projected/7bddad45-e0c1-47e8-8a92-4fce721c04a3-kube-api-access-qb8vb\") pod \"kuadrant-operator-controller-manager-86878c769f-nw8xk\" (UID: \"7bddad45-e0c1-47e8-8a92-4fce721c04a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk" Jul 13 07:19:12.728864 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.728834 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t"] Jul 13 07:19:12.729205 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:19:12.729185 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4979fc9d_fdfd_4f3e_9a6f_7a49ffc0c4ce.slice/crio-d85abb207e1f1812906e5e826e8f4144607b34b7d888cf8533c8b4f3e1803673 WatchSource:0}: Error finding container d85abb207e1f1812906e5e826e8f4144607b34b7d888cf8533c8b4f3e1803673: Status 404 returned error can't find the container with id d85abb207e1f1812906e5e826e8f4144607b34b7d888cf8533c8b4f3e1803673 Jul 13 07:19:12.769914 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:12.769878 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mxcjw\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:19:12.772067 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:12.772002 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8qb5g\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="93880254-13f3-43a1-b1f3-bfe6b401e827" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:19:12.774062 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:12.774033 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mxcjw\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:19:12.775831 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:12.775810 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8qb5g\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="93880254-13f3-43a1-b1f3-bfe6b401e827" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:19:12.803909 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.803885 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk" Jul 13 07:19:12.935891 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:12.935867 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk"] Jul 13 07:19:13.412007 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:13.411979 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-nk465" Jul 13 07:19:13.414361 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:13.414326 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mxcjw\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:19:13.416289 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:13.416261 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8qb5g\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="93880254-13f3-43a1-b1f3-bfe6b401e827" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:19:13.469726 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:13.469666 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t" event={"ID":"4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce","Type":"ContainerStarted","Data":"12d9d24fc402e2c9ec736e0d4402e2c0053f31c79c52e22d9ac0bd8bca7be82e"} Jul 13 07:19:13.469726 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:13.469727 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t" event={"ID":"4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce","Type":"ContainerStarted","Data":"d85abb207e1f1812906e5e826e8f4144607b34b7d888cf8533c8b4f3e1803673"} Jul 13 07:19:13.469981 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:13.469870 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t" Jul 13 07:19:13.471449 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:13.471423 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk" event={"ID":"7bddad45-e0c1-47e8-8a92-4fce721c04a3","Type":"ContainerStarted","Data":"0bf331a019d04e32ce0ed9e6978596224a5c1b6792cdabf19d78a0e5591a445b"} Jul 13 07:19:13.471587 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:13.471464 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk" event={"ID":"7bddad45-e0c1-47e8-8a92-4fce721c04a3","Type":"ContainerStarted","Data":"a5b4fcbb50a40f23bf146e2c8a5e6fe0d82cabb3828353b7e39c6b9c05a29e34"} Jul 13 07:19:13.471587 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:13.471495 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk" Jul 13 07:19:13.472190 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:13.472161 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8qb5g\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="93880254-13f3-43a1-b1f3-bfe6b401e827" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:19:13.495332 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:13.495274 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t" podStartSLOduration=1.4952540939999999 podStartE2EDuration="1.495254094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:19:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:19:13.4932185 +0000 UTC m=+430.415470672" watchObservedRunningTime="2026-07-13 07:19:13.495254094 +0000 UTC m=+430.417506266" Jul 13 07:19:13.495332 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:13.495309 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mxcjw\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:19:13.497270 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:13.497246 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mxcjw\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:19:13.517288 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:13.517239 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk" podStartSLOduration=1.5172263190000002 podStartE2EDuration="1.517226319s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:19:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:19:13.516253494 +0000 UTC m=+430.438505714" watchObservedRunningTime="2026-07-13 07:19:13.517226319 +0000 UTC m=+430.439478491" Jul 13 07:19:13.518344 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:13.518302 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8qb5g\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="93880254-13f3-43a1-b1f3-bfe6b401e827" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:19:13.638818 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:13.638774 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-8qb5g\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="93880254-13f3-43a1-b1f3-bfe6b401e827" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-8qb5g" Jul 13 07:19:13.639969 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:13.639947 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93880254-13f3-43a1-b1f3-bfe6b401e827" path="/var/lib/kubelet/pods/93880254-13f3-43a1-b1f3-bfe6b401e827/volumes" Jul 13 07:19:13.640275 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:13.640262 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee" path="/var/lib/kubelet/pods/dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee/volumes" Jul 13 07:19:13.640818 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:13.640796 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mxcjw\" is forbidden: User \"system:node:ip-10-0-141-197.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-197.ec2.internal' and this object" podUID="dfedf46e-8e2c-4ed1-998d-1e22bf8d60ee" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mxcjw" Jul 13 07:19:13.964779 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:13.964738 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:14.091180 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:14.091131 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:18.655111 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:18.655076 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:18.745680 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:18.745632 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:22.434329 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:22.434285 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:22.538265 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:22.538230 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:24.479182 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:24.479149 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk" Jul 13 07:19:24.479618 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:24.479218 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t" Jul 13 07:19:24.553275 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:24.553241 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t"] Jul 13 07:19:24.553491 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:24.553467 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t" podUID="4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce" containerName="manager" containerID="cri-o://12d9d24fc402e2c9ec736e0d4402e2c0053f31c79c52e22d9ac0bd8bca7be82e" gracePeriod=10 Jul 13 07:19:24.817488 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:24.817457 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t" Jul 13 07:19:24.860457 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:24.860433 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce-extensions-socket-volume\") pod \"4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce\" (UID: \"4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce\") " Jul 13 07:19:24.860605 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:24.860504 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzsqz\" (UniqueName: \"kubernetes.io/projected/4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce-kube-api-access-fzsqz\") pod \"4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce\" (UID: \"4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce\") " Jul 13 07:19:24.860902 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:24.860880 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce" (UID: "4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:19:24.862527 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:24.862507 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce-kube-api-access-fzsqz" (OuterVolumeSpecName: "kube-api-access-fzsqz") pod "4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce" (UID: "4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce"). InnerVolumeSpecName "kube-api-access-fzsqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:19:24.961127 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:24.961038 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzsqz\" (UniqueName: \"kubernetes.io/projected/4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce-kube-api-access-fzsqz\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:19:24.961127 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:24.961080 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce-extensions-socket-volume\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:19:25.540704 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:25.540667 2565 generic.go:356] "Generic (PLEG): container finished" podID="4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce" containerID="12d9d24fc402e2c9ec736e0d4402e2c0053f31c79c52e22d9ac0bd8bca7be82e" exitCode=0 Jul 13 07:19:25.541108 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:25.540711 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t" Jul 13 07:19:25.541108 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:25.540754 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t" event={"ID":"4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce","Type":"ContainerDied","Data":"12d9d24fc402e2c9ec736e0d4402e2c0053f31c79c52e22d9ac0bd8bca7be82e"} Jul 13 07:19:25.541108 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:25.540811 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t" event={"ID":"4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce","Type":"ContainerDied","Data":"d85abb207e1f1812906e5e826e8f4144607b34b7d888cf8533c8b4f3e1803673"} Jul 13 07:19:25.541108 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:25.540835 2565 scope.go:117] "RemoveContainer" containerID="12d9d24fc402e2c9ec736e0d4402e2c0053f31c79c52e22d9ac0bd8bca7be82e" Jul 13 07:19:25.550047 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:25.550023 2565 scope.go:117] "RemoveContainer" containerID="12d9d24fc402e2c9ec736e0d4402e2c0053f31c79c52e22d9ac0bd8bca7be82e" Jul 13 07:19:25.550338 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:19:25.550305 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12d9d24fc402e2c9ec736e0d4402e2c0053f31c79c52e22d9ac0bd8bca7be82e\": container with ID starting with 12d9d24fc402e2c9ec736e0d4402e2c0053f31c79c52e22d9ac0bd8bca7be82e not found: ID does not exist" containerID="12d9d24fc402e2c9ec736e0d4402e2c0053f31c79c52e22d9ac0bd8bca7be82e" Jul 13 07:19:25.550410 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:25.550347 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12d9d24fc402e2c9ec736e0d4402e2c0053f31c79c52e22d9ac0bd8bca7be82e"} err="failed to get container status \"12d9d24fc402e2c9ec736e0d4402e2c0053f31c79c52e22d9ac0bd8bca7be82e\": rpc error: code = NotFound desc = could not find container \"12d9d24fc402e2c9ec736e0d4402e2c0053f31c79c52e22d9ac0bd8bca7be82e\": container with ID starting with 12d9d24fc402e2c9ec736e0d4402e2c0053f31c79c52e22d9ac0bd8bca7be82e not found: ID does not exist" Jul 13 07:19:25.562355 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:25.562310 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t"] Jul 13 07:19:25.570891 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:25.570864 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nff2t"] Jul 13 07:19:25.639772 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:25.639739 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce" path="/var/lib/kubelet/pods/4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce/volumes" Jul 13 07:19:31.146567 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:31.146527 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:31.253124 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:31.253084 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:33.675286 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:33.675254 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:33.774383 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:33.774352 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:38.345133 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:38.345094 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:38.450517 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:38.450473 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:40.860474 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:40.860438 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf"] Jul 13 07:19:40.860847 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:40.860747 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce" containerName="manager" Jul 13 07:19:40.860847 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:40.860759 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce" containerName="manager" Jul 13 07:19:40.860847 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:40.860819 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4979fc9d-fdfd-4f3e-9a6f-7a49ffc0c4ce" containerName="manager" Jul 13 07:19:40.866415 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:40.866392 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:40.869222 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:40.869203 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-mvbsb\"" Jul 13 07:19:40.881107 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:40.881083 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf"] Jul 13 07:19:40.892544 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:40.892517 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:40.996940 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:40.996904 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:40.997133 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:40.996951 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:40.997133 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:40.996978 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:40.997133 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:40.997028 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdgn6\" (UniqueName: \"kubernetes.io/projected/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-kube-api-access-rdgn6\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:40.997133 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:40.997113 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:40.997295 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:40.997158 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:40.997295 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:40.997180 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:40.997295 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:40.997205 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:40.997295 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:40.997253 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:41.048931 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.048887 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:41.098304 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.098266 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:41.098473 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.098356 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:41.098473 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.098383 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:41.098473 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.098415 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:41.098473 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.098451 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:41.098698 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.098482 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:41.098698 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.098517 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:41.098698 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.098541 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:41.098698 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.098603 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdgn6\" (UniqueName: \"kubernetes.io/projected/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-kube-api-access-rdgn6\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:41.098910 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.098706 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:41.098910 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.098775 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:41.099016 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.098937 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:41.099016 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.098974 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:41.099190 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.099166 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:41.100705 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.100675 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:41.101084 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.101061 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:41.106498 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.106477 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:41.107023 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.107003 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdgn6\" (UniqueName: \"kubernetes.io/projected/5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021-kube-api-access-rdgn6\") pod \"maas-default-gateway-openshift-default-56654dcf7-w9qjf\" (UID: \"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:41.176621 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.176559 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:41.313814 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.313791 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf"] Jul 13 07:19:41.315629 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:19:41.315598 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ddc0ff9_6d4e_4b00_ba2e_79887b5d0021.slice/crio-3e6e1c9afe5b86985f6a0a4c060f5a501e483a063764d157c1a0d1f626699c92 WatchSource:0}: Error finding container 3e6e1c9afe5b86985f6a0a4c060f5a501e483a063764d157c1a0d1f626699c92: Status 404 returned error can't find the container with id 3e6e1c9afe5b86985f6a0a4c060f5a501e483a063764d157c1a0d1f626699c92 Jul 13 07:19:41.317659 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.317624 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:19:41.317734 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.317704 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:19:41.317787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.317771 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:19:41.619260 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.619221 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" event={"ID":"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021","Type":"ContainerStarted","Data":"ca1534fdf99efd7c0357fc06e46983ee534997b5c6a82b49ebcb304d42271bb6"} Jul 13 07:19:41.619462 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.619280 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" event={"ID":"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021","Type":"ContainerStarted","Data":"3e6e1c9afe5b86985f6a0a4c060f5a501e483a063764d157c1a0d1f626699c92"} Jul 13 07:19:41.642498 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:41.642448 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" podStartSLOduration=1.642433008 podStartE2EDuration="1.642433008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:19:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:19:41.640007585 +0000 UTC m=+458.562259759" watchObservedRunningTime="2026-07-13 07:19:41.642433008 +0000 UTC m=+458.564685180" Jul 13 07:19:42.177469 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:42.177437 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:42.182113 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:42.182089 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:42.546688 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:42.546635 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:42.624882 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:42.624857 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:42.625823 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:42.625800 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:19:42.647655 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:42.647612 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:42.747118 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:42.747075 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:42.852956 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:42.852865 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:43.429929 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:43.429895 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-h2zt2"] Jul 13 07:19:43.432530 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:43.432512 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-h2zt2" Jul 13 07:19:43.435064 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:43.435042 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5ln28\"" Jul 13 07:19:43.437829 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:43.437807 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-h2zt2"] Jul 13 07:19:43.456028 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:43.455958 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:43.517686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:43.517658 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgbsg\" (UniqueName: \"kubernetes.io/projected/86d8366a-0fec-47df-8a16-0c522ebfc0de-kube-api-access-hgbsg\") pod \"authorino-58cd955675-h2zt2\" (UID: \"86d8366a-0fec-47df-8a16-0c522ebfc0de\") " pod="kuadrant-system/authorino-58cd955675-h2zt2" Jul 13 07:19:43.544684 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:43.544658 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:43.618417 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:43.618387 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgbsg\" (UniqueName: \"kubernetes.io/projected/86d8366a-0fec-47df-8a16-0c522ebfc0de-kube-api-access-hgbsg\") pod \"authorino-58cd955675-h2zt2\" (UID: \"86d8366a-0fec-47df-8a16-0c522ebfc0de\") " pod="kuadrant-system/authorino-58cd955675-h2zt2" Jul 13 07:19:43.626747 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:43.626717 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgbsg\" (UniqueName: \"kubernetes.io/projected/86d8366a-0fec-47df-8a16-0c522ebfc0de-kube-api-access-hgbsg\") pod \"authorino-58cd955675-h2zt2\" (UID: \"86d8366a-0fec-47df-8a16-0c522ebfc0de\") " pod="kuadrant-system/authorino-58cd955675-h2zt2" Jul 13 07:19:43.742333 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:43.742278 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-h2zt2" Jul 13 07:19:43.865898 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:43.865863 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-h2zt2"] Jul 13 07:19:43.868586 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:19:43.868558 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86d8366a_0fec_47df_8a16_0c522ebfc0de.slice/crio-e3018168d6f5f45c9a7d5e901122e8ce245428fdc135e0493c0764b599376a02 WatchSource:0}: Error finding container e3018168d6f5f45c9a7d5e901122e8ce245428fdc135e0493c0764b599376a02: Status 404 returned error can't find the container with id e3018168d6f5f45c9a7d5e901122e8ce245428fdc135e0493c0764b599376a02 Jul 13 07:19:44.639506 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:44.639474 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-h2zt2" event={"ID":"86d8366a-0fec-47df-8a16-0c522ebfc0de","Type":"ContainerStarted","Data":"e3018168d6f5f45c9a7d5e901122e8ce245428fdc135e0493c0764b599376a02"} Jul 13 07:19:47.655379 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:47.655341 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-h2zt2" event={"ID":"86d8366a-0fec-47df-8a16-0c522ebfc0de","Type":"ContainerStarted","Data":"f8048be3197d522b30d63f061990518e4f298ff7111fb302fe5145f34440c224"} Jul 13 07:19:47.671764 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:47.671719 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-h2zt2" podStartSLOduration=1.507062859 podStartE2EDuration="4.671703495s" totalImagesPullingTime="3.164640636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:19:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:19:47.669415337 +0000 UTC m=+464.591667510" watchObservedRunningTime="2026-07-13 07:19:47.671703495 +0000 UTC m=+464.593955668" Jul 13 07:19:47.717882 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:47.717853 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-h2zt2"] Jul 13 07:19:48.031367 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:48.031311 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:48.032287 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:48.032264 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-88f77"] Jul 13 07:19:48.034832 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:48.034811 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-88f77" Jul 13 07:19:48.037486 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:48.037467 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-6n99k\"" Jul 13 07:19:48.037586 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:48.037509 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 13 07:19:48.047285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:48.047264 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-88f77"] Jul 13 07:19:48.128628 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:48.128588 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-88f77"] Jul 13 07:19:48.159692 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:48.159666 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/daec4c3f-e0e4-428e-ac40-45a9bedda218-config-file\") pod \"limitador-limitador-64c94fd64f-88f77\" (UID: \"daec4c3f-e0e4-428e-ac40-45a9bedda218\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-88f77" Jul 13 07:19:48.159826 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:48.159710 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dss2d\" (UniqueName: \"kubernetes.io/projected/daec4c3f-e0e4-428e-ac40-45a9bedda218-kube-api-access-dss2d\") pod \"limitador-limitador-64c94fd64f-88f77\" (UID: \"daec4c3f-e0e4-428e-ac40-45a9bedda218\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-88f77" Jul 13 07:19:48.260998 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:48.260966 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dss2d\" (UniqueName: \"kubernetes.io/projected/daec4c3f-e0e4-428e-ac40-45a9bedda218-kube-api-access-dss2d\") pod \"limitador-limitador-64c94fd64f-88f77\" (UID: \"daec4c3f-e0e4-428e-ac40-45a9bedda218\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-88f77" Jul 13 07:19:48.261159 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:48.261062 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/daec4c3f-e0e4-428e-ac40-45a9bedda218-config-file\") pod \"limitador-limitador-64c94fd64f-88f77\" (UID: \"daec4c3f-e0e4-428e-ac40-45a9bedda218\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-88f77" Jul 13 07:19:48.261714 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:48.261689 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/daec4c3f-e0e4-428e-ac40-45a9bedda218-config-file\") pod \"limitador-limitador-64c94fd64f-88f77\" (UID: \"daec4c3f-e0e4-428e-ac40-45a9bedda218\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-88f77" Jul 13 07:19:48.268846 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:48.268813 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dss2d\" (UniqueName: \"kubernetes.io/projected/daec4c3f-e0e4-428e-ac40-45a9bedda218-kube-api-access-dss2d\") pod \"limitador-limitador-64c94fd64f-88f77\" (UID: \"daec4c3f-e0e4-428e-ac40-45a9bedda218\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-88f77" Jul 13 07:19:48.345079 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:48.345009 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-88f77" Jul 13 07:19:48.475417 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:48.475388 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-88f77"] Jul 13 07:19:48.477455 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:19:48.477426 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaec4c3f_e0e4_428e_ac40_45a9bedda218.slice/crio-0b1543d97fc8e2081b3d465f503258701381acf05a42830726dec269cfd85895 WatchSource:0}: Error finding container 0b1543d97fc8e2081b3d465f503258701381acf05a42830726dec269cfd85895: Status 404 returned error can't find the container with id 0b1543d97fc8e2081b3d465f503258701381acf05a42830726dec269cfd85895 Jul 13 07:19:48.661450 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:48.661375 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-88f77" event={"ID":"daec4c3f-e0e4-428e-ac40-45a9bedda218","Type":"ContainerStarted","Data":"0b1543d97fc8e2081b3d465f503258701381acf05a42830726dec269cfd85895"} Jul 13 07:19:49.667494 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:49.667454 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-h2zt2" podUID="86d8366a-0fec-47df-8a16-0c522ebfc0de" containerName="authorino" containerID="cri-o://f8048be3197d522b30d63f061990518e4f298ff7111fb302fe5145f34440c224" gracePeriod=30 Jul 13 07:19:50.675831 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:50.675799 2565 generic.go:356] "Generic (PLEG): container finished" podID="86d8366a-0fec-47df-8a16-0c522ebfc0de" containerID="f8048be3197d522b30d63f061990518e4f298ff7111fb302fe5145f34440c224" exitCode=0 Jul 13 07:19:50.676192 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:50.675845 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-h2zt2" event={"ID":"86d8366a-0fec-47df-8a16-0c522ebfc0de","Type":"ContainerDied","Data":"f8048be3197d522b30d63f061990518e4f298ff7111fb302fe5145f34440c224"} Jul 13 07:19:50.845918 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:50.845891 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-h2zt2" Jul 13 07:19:50.987399 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:50.987361 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgbsg\" (UniqueName: \"kubernetes.io/projected/86d8366a-0fec-47df-8a16-0c522ebfc0de-kube-api-access-hgbsg\") pod \"86d8366a-0fec-47df-8a16-0c522ebfc0de\" (UID: \"86d8366a-0fec-47df-8a16-0c522ebfc0de\") " Jul 13 07:19:50.989729 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:50.989694 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86d8366a-0fec-47df-8a16-0c522ebfc0de-kube-api-access-hgbsg" (OuterVolumeSpecName: "kube-api-access-hgbsg") pod "86d8366a-0fec-47df-8a16-0c522ebfc0de" (UID: "86d8366a-0fec-47df-8a16-0c522ebfc0de"). InnerVolumeSpecName "kube-api-access-hgbsg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:19:51.088674 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:51.088626 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgbsg\" (UniqueName: \"kubernetes.io/projected/86d8366a-0fec-47df-8a16-0c522ebfc0de-kube-api-access-hgbsg\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:19:51.554664 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:51.554632 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:51.655231 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:51.655192 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:51.681807 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:51.681775 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-88f77" event={"ID":"daec4c3f-e0e4-428e-ac40-45a9bedda218","Type":"ContainerStarted","Data":"cf295b801b33c7d19d1c46a461d55451b582b2f58974c4169021913867fec86c"} Jul 13 07:19:51.682212 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:51.681830 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-88f77" Jul 13 07:19:51.682944 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:51.682926 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-h2zt2" Jul 13 07:19:51.683055 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:51.682947 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-h2zt2" event={"ID":"86d8366a-0fec-47df-8a16-0c522ebfc0de","Type":"ContainerDied","Data":"e3018168d6f5f45c9a7d5e901122e8ce245428fdc135e0493c0764b599376a02"} Jul 13 07:19:51.683055 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:51.682990 2565 scope.go:117] "RemoveContainer" containerID="f8048be3197d522b30d63f061990518e4f298ff7111fb302fe5145f34440c224" Jul 13 07:19:51.700126 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:51.700086 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-88f77" podStartSLOduration=1.122330497 podStartE2EDuration="3.700073353s" totalImagesPullingTime="2.577742856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:19:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:19:51.697959891 +0000 UTC m=+468.620212065" watchObservedRunningTime="2026-07-13 07:19:51.700073353 +0000 UTC m=+468.622325525" Jul 13 07:19:51.711381 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:51.711355 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-h2zt2"] Jul 13 07:19:51.715569 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:51.715547 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-h2zt2"] Jul 13 07:19:53.639015 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:53.638981 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86d8366a-0fec-47df-8a16-0c522ebfc0de" path="/var/lib/kubelet/pods/86d8366a-0fec-47df-8a16-0c522ebfc0de/volumes" Jul 13 07:19:53.999612 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:53.999585 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:54.052949 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:54.052923 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:58.751946 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:58.751910 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:58.857105 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:58.857072 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:59.529524 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:59.529493 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:19:59.583252 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:19:59.583218 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:20:02.690497 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:02.690470 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-88f77" Jul 13 07:20:02.753557 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:02.753528 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-88f77"] Jul 13 07:20:02.753715 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:02.753696 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-88f77" podUID="daec4c3f-e0e4-428e-ac40-45a9bedda218" containerName="limitador" containerID="cri-o://cf295b801b33c7d19d1c46a461d55451b582b2f58974c4169021913867fec86c" gracePeriod=30 Jul 13 07:20:03.701527 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:03.701504 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-88f77" Jul 13 07:20:03.746217 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:03.746192 2565 generic.go:356] "Generic (PLEG): container finished" podID="daec4c3f-e0e4-428e-ac40-45a9bedda218" containerID="cf295b801b33c7d19d1c46a461d55451b582b2f58974c4169021913867fec86c" exitCode=0 Jul 13 07:20:03.746359 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:03.746233 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-88f77" Jul 13 07:20:03.746359 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:03.746231 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-88f77" event={"ID":"daec4c3f-e0e4-428e-ac40-45a9bedda218","Type":"ContainerDied","Data":"cf295b801b33c7d19d1c46a461d55451b582b2f58974c4169021913867fec86c"} Jul 13 07:20:03.746439 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:03.746361 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-88f77" event={"ID":"daec4c3f-e0e4-428e-ac40-45a9bedda218","Type":"ContainerDied","Data":"0b1543d97fc8e2081b3d465f503258701381acf05a42830726dec269cfd85895"} Jul 13 07:20:03.746439 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:03.746396 2565 scope.go:117] "RemoveContainer" containerID="cf295b801b33c7d19d1c46a461d55451b582b2f58974c4169021913867fec86c" Jul 13 07:20:03.754487 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:03.754245 2565 scope.go:117] "RemoveContainer" containerID="cf295b801b33c7d19d1c46a461d55451b582b2f58974c4169021913867fec86c" Jul 13 07:20:03.754571 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:20:03.754553 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf295b801b33c7d19d1c46a461d55451b582b2f58974c4169021913867fec86c\": container with ID starting with cf295b801b33c7d19d1c46a461d55451b582b2f58974c4169021913867fec86c not found: ID does not exist" containerID="cf295b801b33c7d19d1c46a461d55451b582b2f58974c4169021913867fec86c" Jul 13 07:20:03.754612 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:03.754584 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf295b801b33c7d19d1c46a461d55451b582b2f58974c4169021913867fec86c"} err="failed to get container status \"cf295b801b33c7d19d1c46a461d55451b582b2f58974c4169021913867fec86c\": rpc error: code = NotFound desc = could not find container \"cf295b801b33c7d19d1c46a461d55451b582b2f58974c4169021913867fec86c\": container with ID starting with cf295b801b33c7d19d1c46a461d55451b582b2f58974c4169021913867fec86c not found: ID does not exist" Jul 13 07:20:03.778052 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:03.778035 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/daec4c3f-e0e4-428e-ac40-45a9bedda218-config-file\") pod \"daec4c3f-e0e4-428e-ac40-45a9bedda218\" (UID: \"daec4c3f-e0e4-428e-ac40-45a9bedda218\") " Jul 13 07:20:03.778131 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:03.778123 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dss2d\" (UniqueName: \"kubernetes.io/projected/daec4c3f-e0e4-428e-ac40-45a9bedda218-kube-api-access-dss2d\") pod \"daec4c3f-e0e4-428e-ac40-45a9bedda218\" (UID: \"daec4c3f-e0e4-428e-ac40-45a9bedda218\") " Jul 13 07:20:03.778382 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:03.778360 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daec4c3f-e0e4-428e-ac40-45a9bedda218-config-file" (OuterVolumeSpecName: "config-file") pod "daec4c3f-e0e4-428e-ac40-45a9bedda218" (UID: "daec4c3f-e0e4-428e-ac40-45a9bedda218"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:20:03.779957 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:03.779931 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daec4c3f-e0e4-428e-ac40-45a9bedda218-kube-api-access-dss2d" (OuterVolumeSpecName: "kube-api-access-dss2d") pod "daec4c3f-e0e4-428e-ac40-45a9bedda218" (UID: "daec4c3f-e0e4-428e-ac40-45a9bedda218"). InnerVolumeSpecName "kube-api-access-dss2d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:20:03.879240 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:03.879210 2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/daec4c3f-e0e4-428e-ac40-45a9bedda218-config-file\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:20:03.879240 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:03.879231 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dss2d\" (UniqueName: \"kubernetes.io/projected/daec4c3f-e0e4-428e-ac40-45a9bedda218-kube-api-access-dss2d\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:20:04.072760 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.072734 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-88f77"] Jul 13 07:20:04.084096 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.084076 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-88f77"] Jul 13 07:20:04.094968 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.094946 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-bvtqp"] Jul 13 07:20:04.095252 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.095240 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daec4c3f-e0e4-428e-ac40-45a9bedda218" containerName="limitador" Jul 13 07:20:04.095336 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.095253 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="daec4c3f-e0e4-428e-ac40-45a9bedda218" containerName="limitador" Jul 13 07:20:04.095336 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.095264 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d8366a-0fec-47df-8a16-0c522ebfc0de" containerName="authorino" Jul 13 07:20:04.095336 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.095270 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d8366a-0fec-47df-8a16-0c522ebfc0de" containerName="authorino" Jul 13 07:20:04.095506 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.095339 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="86d8366a-0fec-47df-8a16-0c522ebfc0de" containerName="authorino" Jul 13 07:20:04.095506 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.095352 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="daec4c3f-e0e4-428e-ac40-45a9bedda218" containerName="limitador" Jul 13 07:20:04.098283 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.098266 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-bvtqp" Jul 13 07:20:04.100930 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.100912 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 13 07:20:04.101030 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.100951 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qj7dt\"" Jul 13 07:20:04.107183 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.107122 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-bvtqp"] Jul 13 07:20:04.126813 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.126783 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:20:04.181856 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.181830 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbjct\" (UniqueName: \"kubernetes.io/projected/4888ae0f-0a08-4695-ac70-b7ec8236ae17-kube-api-access-nbjct\") pod \"postgres-69fb4594cf-bvtqp\" (UID: \"4888ae0f-0a08-4695-ac70-b7ec8236ae17\") " pod="opendatahub/postgres-69fb4594cf-bvtqp" Jul 13 07:20:04.181950 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.181885 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4888ae0f-0a08-4695-ac70-b7ec8236ae17-data\") pod \"postgres-69fb4594cf-bvtqp\" (UID: \"4888ae0f-0a08-4695-ac70-b7ec8236ae17\") " pod="opendatahub/postgres-69fb4594cf-bvtqp" Jul 13 07:20:04.282200 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.282175 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbjct\" (UniqueName: \"kubernetes.io/projected/4888ae0f-0a08-4695-ac70-b7ec8236ae17-kube-api-access-nbjct\") pod \"postgres-69fb4594cf-bvtqp\" (UID: \"4888ae0f-0a08-4695-ac70-b7ec8236ae17\") " pod="opendatahub/postgres-69fb4594cf-bvtqp" Jul 13 07:20:04.282356 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.282225 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4888ae0f-0a08-4695-ac70-b7ec8236ae17-data\") pod \"postgres-69fb4594cf-bvtqp\" (UID: \"4888ae0f-0a08-4695-ac70-b7ec8236ae17\") " pod="opendatahub/postgres-69fb4594cf-bvtqp" Jul 13 07:20:04.282553 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.282536 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4888ae0f-0a08-4695-ac70-b7ec8236ae17-data\") pod \"postgres-69fb4594cf-bvtqp\" (UID: \"4888ae0f-0a08-4695-ac70-b7ec8236ae17\") " pod="opendatahub/postgres-69fb4594cf-bvtqp" Jul 13 07:20:04.292713 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.292693 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbjct\" (UniqueName: \"kubernetes.io/projected/4888ae0f-0a08-4695-ac70-b7ec8236ae17-kube-api-access-nbjct\") pod \"postgres-69fb4594cf-bvtqp\" (UID: \"4888ae0f-0a08-4695-ac70-b7ec8236ae17\") " pod="opendatahub/postgres-69fb4594cf-bvtqp" Jul 13 07:20:04.410235 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.410182 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-bvtqp" Jul 13 07:20:04.537302 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.537279 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-bvtqp"] Jul 13 07:20:04.539300 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:20:04.539266 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4888ae0f_0a08_4695_ac70_b7ec8236ae17.slice/crio-43442474292c5bfa24552549160f28ba3359dbd61357e316d6db154d00adac36 WatchSource:0}: Error finding container 43442474292c5bfa24552549160f28ba3359dbd61357e316d6db154d00adac36: Status 404 returned error can't find the container with id 43442474292c5bfa24552549160f28ba3359dbd61357e316d6db154d00adac36 Jul 13 07:20:04.751936 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:04.751906 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-bvtqp" event={"ID":"4888ae0f-0a08-4695-ac70-b7ec8236ae17","Type":"ContainerStarted","Data":"43442474292c5bfa24552549160f28ba3359dbd61357e316d6db154d00adac36"} Jul 13 07:20:05.641451 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:05.641417 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daec4c3f-e0e4-428e-ac40-45a9bedda218" path="/var/lib/kubelet/pods/daec4c3f-e0e4-428e-ac40-45a9bedda218/volumes" Jul 13 07:20:09.785719 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:09.785680 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-bvtqp" event={"ID":"4888ae0f-0a08-4695-ac70-b7ec8236ae17","Type":"ContainerStarted","Data":"93ed9c10e33622e2433642ad4aca1eaf04a613e21855fd3be002d1c40d5a64cf"} Jul 13 07:20:09.786211 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:09.785808 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-bvtqp" Jul 13 07:20:09.802906 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:09.802856 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-bvtqp" podStartSLOduration=1.279748658 podStartE2EDuration="5.802842512s" totalImagesPullingTime="4.523093854s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:20:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:20:09.80099227 +0000 UTC m=+486.723244443" watchObservedRunningTime="2026-07-13 07:20:09.802842512 +0000 UTC m=+486.725094684" Jul 13 07:20:15.821890 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:15.821864 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-bvtqp" Jul 13 07:20:16.113816 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.113718 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:20:16.333601 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.333569 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jnwrj"] Jul 13 07:20:16.339876 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.339850 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jnwrj" Jul 13 07:20:16.342163 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.342139 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jnwrj"] Jul 13 07:20:16.342286 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.342263 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5ln28\"" Jul 13 07:20:16.382737 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.382665 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9jxg\" (UniqueName: \"kubernetes.io/projected/0925661e-0a63-45f0-9d4b-4da2f5681c48-kube-api-access-r9jxg\") pod \"authorino-5d4b67c446-jnwrj\" (UID: \"0925661e-0a63-45f0-9d4b-4da2f5681c48\") " pod="kuadrant-system/authorino-5d4b67c446-jnwrj" Jul 13 07:20:16.483287 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.483255 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9jxg\" (UniqueName: \"kubernetes.io/projected/0925661e-0a63-45f0-9d4b-4da2f5681c48-kube-api-access-r9jxg\") pod \"authorino-5d4b67c446-jnwrj\" (UID: \"0925661e-0a63-45f0-9d4b-4da2f5681c48\") " pod="kuadrant-system/authorino-5d4b67c446-jnwrj" Jul 13 07:20:16.491063 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.491033 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9jxg\" (UniqueName: \"kubernetes.io/projected/0925661e-0a63-45f0-9d4b-4da2f5681c48-kube-api-access-r9jxg\") pod \"authorino-5d4b67c446-jnwrj\" (UID: \"0925661e-0a63-45f0-9d4b-4da2f5681c48\") " pod="kuadrant-system/authorino-5d4b67c446-jnwrj" Jul 13 07:20:16.553710 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.553684 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jnwrj"] Jul 13 07:20:16.553899 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.553888 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jnwrj" Jul 13 07:20:16.555995 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.555966 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:20:16.579724 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.579699 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-cbc578b48-j6pcp"] Jul 13 07:20:16.588462 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.588439 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cbc578b48-j6pcp" Jul 13 07:20:16.590360 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.590331 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-cbc578b48-j6pcp"] Jul 13 07:20:16.685998 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.685970 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmbrs\" (UniqueName: \"kubernetes.io/projected/e12bb3d8-0334-4653-aeb9-727488552173-kube-api-access-fmbrs\") pod \"authorino-cbc578b48-j6pcp\" (UID: \"e12bb3d8-0334-4653-aeb9-727488552173\") " pod="kuadrant-system/authorino-cbc578b48-j6pcp" Jul 13 07:20:16.691369 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.691347 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jnwrj"] Jul 13 07:20:16.693188 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:20:16.693164 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0925661e_0a63_45f0_9d4b_4da2f5681c48.slice/crio-8d78c92182b7887bcc22888910932b00c0fc7250d3deb212497eb3d4c9ddd81c WatchSource:0}: Error finding container 8d78c92182b7887bcc22888910932b00c0fc7250d3deb212497eb3d4c9ddd81c: Status 404 returned error can't find the container with id 8d78c92182b7887bcc22888910932b00c0fc7250d3deb212497eb3d4c9ddd81c Jul 13 07:20:16.786680 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.786656 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmbrs\" (UniqueName: \"kubernetes.io/projected/e12bb3d8-0334-4653-aeb9-727488552173-kube-api-access-fmbrs\") pod \"authorino-cbc578b48-j6pcp\" (UID: \"e12bb3d8-0334-4653-aeb9-727488552173\") " pod="kuadrant-system/authorino-cbc578b48-j6pcp" Jul 13 07:20:16.794808 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.794789 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmbrs\" (UniqueName: \"kubernetes.io/projected/e12bb3d8-0334-4653-aeb9-727488552173-kube-api-access-fmbrs\") pod \"authorino-cbc578b48-j6pcp\" (UID: \"e12bb3d8-0334-4653-aeb9-727488552173\") " pod="kuadrant-system/authorino-cbc578b48-j6pcp" Jul 13 07:20:16.822736 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.822711 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-jnwrj" event={"ID":"0925661e-0a63-45f0-9d4b-4da2f5681c48","Type":"ContainerStarted","Data":"8d78c92182b7887bcc22888910932b00c0fc7250d3deb212497eb3d4c9ddd81c"} Jul 13 07:20:16.826478 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.826458 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cbc578b48-j6pcp"] Jul 13 07:20:16.826731 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.826717 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cbc578b48-j6pcp" Jul 13 07:20:16.861174 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.861150 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-74cccb8648-qmv6g"] Jul 13 07:20:16.866109 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.866083 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74cccb8648-qmv6g" Jul 13 07:20:16.868805 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.868783 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 13 07:20:16.877679 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.877626 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74cccb8648-qmv6g"] Jul 13 07:20:16.888009 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.887982 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr7pr\" (UniqueName: \"kubernetes.io/projected/a39859ff-26ec-4717-951e-8830ea546da4-kube-api-access-dr7pr\") pod \"authorino-74cccb8648-qmv6g\" (UID: \"a39859ff-26ec-4717-951e-8830ea546da4\") " pod="kuadrant-system/authorino-74cccb8648-qmv6g" Jul 13 07:20:16.888142 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.888119 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a39859ff-26ec-4717-951e-8830ea546da4-tls-cert\") pod \"authorino-74cccb8648-qmv6g\" (UID: \"a39859ff-26ec-4717-951e-8830ea546da4\") " pod="kuadrant-system/authorino-74cccb8648-qmv6g" Jul 13 07:20:16.959451 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.959427 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cbc578b48-j6pcp"] Jul 13 07:20:16.960999 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:20:16.960976 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode12bb3d8_0334_4653_aeb9_727488552173.slice/crio-d9d1b1acd77dd9cbbd60723dde71d1ae4ef7ef9a0dadb673ef936dbf12a90183 WatchSource:0}: Error finding container d9d1b1acd77dd9cbbd60723dde71d1ae4ef7ef9a0dadb673ef936dbf12a90183: Status 404 returned error can't find the container with id d9d1b1acd77dd9cbbd60723dde71d1ae4ef7ef9a0dadb673ef936dbf12a90183 Jul 13 07:20:16.989211 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.989183 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a39859ff-26ec-4717-951e-8830ea546da4-tls-cert\") pod \"authorino-74cccb8648-qmv6g\" (UID: \"a39859ff-26ec-4717-951e-8830ea546da4\") " pod="kuadrant-system/authorino-74cccb8648-qmv6g" Jul 13 07:20:16.989305 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.989228 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr7pr\" (UniqueName: \"kubernetes.io/projected/a39859ff-26ec-4717-951e-8830ea546da4-kube-api-access-dr7pr\") pod \"authorino-74cccb8648-qmv6g\" (UID: \"a39859ff-26ec-4717-951e-8830ea546da4\") " pod="kuadrant-system/authorino-74cccb8648-qmv6g" Jul 13 07:20:16.991693 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.991672 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a39859ff-26ec-4717-951e-8830ea546da4-tls-cert\") pod \"authorino-74cccb8648-qmv6g\" (UID: \"a39859ff-26ec-4717-951e-8830ea546da4\") " pod="kuadrant-system/authorino-74cccb8648-qmv6g" Jul 13 07:20:16.997299 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:16.997275 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr7pr\" (UniqueName: \"kubernetes.io/projected/a39859ff-26ec-4717-951e-8830ea546da4-kube-api-access-dr7pr\") pod \"authorino-74cccb8648-qmv6g\" (UID: \"a39859ff-26ec-4717-951e-8830ea546da4\") " pod="kuadrant-system/authorino-74cccb8648-qmv6g" Jul 13 07:20:17.178414 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:17.178393 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74cccb8648-qmv6g" Jul 13 07:20:17.352976 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:17.352952 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74cccb8648-qmv6g"] Jul 13 07:20:17.354491 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:20:17.354459 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda39859ff_26ec_4717_951e_8830ea546da4.slice/crio-9c16d34d893fe7318d9957eb7dcc698adc81d0b68d8a25a55d11ab473423652d WatchSource:0}: Error finding container 9c16d34d893fe7318d9957eb7dcc698adc81d0b68d8a25a55d11ab473423652d: Status 404 returned error can't find the container with id 9c16d34d893fe7318d9957eb7dcc698adc81d0b68d8a25a55d11ab473423652d Jul 13 07:20:17.829602 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:17.829559 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-jnwrj" event={"ID":"0925661e-0a63-45f0-9d4b-4da2f5681c48","Type":"ContainerStarted","Data":"5e84bf8f2954b88ae5cd543c0c7cabcefcb4ee4ed2b693515a939eb9d6153807"} Jul 13 07:20:17.830024 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:17.829602 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-jnwrj" podUID="0925661e-0a63-45f0-9d4b-4da2f5681c48" containerName="authorino" containerID="cri-o://5e84bf8f2954b88ae5cd543c0c7cabcefcb4ee4ed2b693515a939eb9d6153807" gracePeriod=30 Jul 13 07:20:17.830923 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:17.830896 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74cccb8648-qmv6g" event={"ID":"a39859ff-26ec-4717-951e-8830ea546da4","Type":"ContainerStarted","Data":"9c16d34d893fe7318d9957eb7dcc698adc81d0b68d8a25a55d11ab473423652d"} Jul 13 07:20:17.832438 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:17.832389 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cbc578b48-j6pcp" event={"ID":"e12bb3d8-0334-4653-aeb9-727488552173","Type":"ContainerStarted","Data":"d2b8fb122ca4b36afecc255115fda62422f7f26db3d566ff03fa7e7d3dea593f"} Jul 13 07:20:17.832438 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:17.832436 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cbc578b48-j6pcp" event={"ID":"e12bb3d8-0334-4653-aeb9-727488552173","Type":"ContainerStarted","Data":"d9d1b1acd77dd9cbbd60723dde71d1ae4ef7ef9a0dadb673ef936dbf12a90183"} Jul 13 07:20:17.832615 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:17.832539 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-cbc578b48-j6pcp" podUID="e12bb3d8-0334-4653-aeb9-727488552173" containerName="authorino" containerID="cri-o://d2b8fb122ca4b36afecc255115fda62422f7f26db3d566ff03fa7e7d3dea593f" gracePeriod=30 Jul 13 07:20:17.845679 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:17.845639 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-jnwrj" podStartSLOduration=1.404575312 podStartE2EDuration="1.845625275s" totalImagesPullingTime="441.049963ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:20:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:20:17.844576827 +0000 UTC m=+494.766829000" watchObservedRunningTime="2026-07-13 07:20:17.845625275 +0000 UTC m=+494.767877448" Jul 13 07:20:17.860721 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:17.860679 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-cbc578b48-j6pcp" podStartSLOduration=1.496025383 podStartE2EDuration="1.860666644s" totalImagesPullingTime="364.641261ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:20:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:20:17.859645889 +0000 UTC m=+494.781898063" watchObservedRunningTime="2026-07-13 07:20:17.860666644 +0000 UTC m=+494.782918854" Jul 13 07:20:18.113346 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.113304 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jnwrj" Jul 13 07:20:18.144216 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.144190 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cbc578b48-j6pcp" Jul 13 07:20:18.200505 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.200481 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmbrs\" (UniqueName: \"kubernetes.io/projected/e12bb3d8-0334-4653-aeb9-727488552173-kube-api-access-fmbrs\") pod \"e12bb3d8-0334-4653-aeb9-727488552173\" (UID: \"e12bb3d8-0334-4653-aeb9-727488552173\") " Jul 13 07:20:18.200608 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.200543 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r9jxg\" (UniqueName: \"kubernetes.io/projected/0925661e-0a63-45f0-9d4b-4da2f5681c48-kube-api-access-r9jxg\") pod \"0925661e-0a63-45f0-9d4b-4da2f5681c48\" (UID: \"0925661e-0a63-45f0-9d4b-4da2f5681c48\") " Jul 13 07:20:18.202553 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.202524 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0925661e-0a63-45f0-9d4b-4da2f5681c48-kube-api-access-r9jxg" (OuterVolumeSpecName: "kube-api-access-r9jxg") pod "0925661e-0a63-45f0-9d4b-4da2f5681c48" (UID: "0925661e-0a63-45f0-9d4b-4da2f5681c48"). InnerVolumeSpecName "kube-api-access-r9jxg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:20:18.202650 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.202605 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e12bb3d8-0334-4653-aeb9-727488552173-kube-api-access-fmbrs" (OuterVolumeSpecName: "kube-api-access-fmbrs") pod "e12bb3d8-0334-4653-aeb9-727488552173" (UID: "e12bb3d8-0334-4653-aeb9-727488552173"). InnerVolumeSpecName "kube-api-access-fmbrs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:20:18.301275 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.301252 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmbrs\" (UniqueName: \"kubernetes.io/projected/e12bb3d8-0334-4653-aeb9-727488552173-kube-api-access-fmbrs\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:20:18.301275 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.301273 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r9jxg\" (UniqueName: \"kubernetes.io/projected/0925661e-0a63-45f0-9d4b-4da2f5681c48-kube-api-access-r9jxg\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:20:18.838732 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.838645 2565 generic.go:356] "Generic (PLEG): container finished" podID="0925661e-0a63-45f0-9d4b-4da2f5681c48" containerID="5e84bf8f2954b88ae5cd543c0c7cabcefcb4ee4ed2b693515a939eb9d6153807" exitCode=0 Jul 13 07:20:18.838732 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.838703 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jnwrj" Jul 13 07:20:18.838732 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.838708 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-jnwrj" event={"ID":"0925661e-0a63-45f0-9d4b-4da2f5681c48","Type":"ContainerDied","Data":"5e84bf8f2954b88ae5cd543c0c7cabcefcb4ee4ed2b693515a939eb9d6153807"} Jul 13 07:20:18.839244 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.838752 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-jnwrj" event={"ID":"0925661e-0a63-45f0-9d4b-4da2f5681c48","Type":"ContainerDied","Data":"8d78c92182b7887bcc22888910932b00c0fc7250d3deb212497eb3d4c9ddd81c"} Jul 13 07:20:18.839244 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.838769 2565 scope.go:117] "RemoveContainer" containerID="5e84bf8f2954b88ae5cd543c0c7cabcefcb4ee4ed2b693515a939eb9d6153807" Jul 13 07:20:18.840499 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.840349 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74cccb8648-qmv6g" event={"ID":"a39859ff-26ec-4717-951e-8830ea546da4","Type":"ContainerStarted","Data":"c697e777b485c6aba8107830c6b2bf0ad0cc5182245bf47fb7481f84f62bf3a8"} Jul 13 07:20:18.841719 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.841694 2565 generic.go:356] "Generic (PLEG): container finished" podID="e12bb3d8-0334-4653-aeb9-727488552173" containerID="d2b8fb122ca4b36afecc255115fda62422f7f26db3d566ff03fa7e7d3dea593f" exitCode=0 Jul 13 07:20:18.841862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.841722 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-cbc578b48-j6pcp" Jul 13 07:20:18.841862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.841753 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cbc578b48-j6pcp" event={"ID":"e12bb3d8-0334-4653-aeb9-727488552173","Type":"ContainerDied","Data":"d2b8fb122ca4b36afecc255115fda62422f7f26db3d566ff03fa7e7d3dea593f"} Jul 13 07:20:18.841862 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.841791 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-cbc578b48-j6pcp" event={"ID":"e12bb3d8-0334-4653-aeb9-727488552173","Type":"ContainerDied","Data":"d9d1b1acd77dd9cbbd60723dde71d1ae4ef7ef9a0dadb673ef936dbf12a90183"} Jul 13 07:20:18.848025 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.847966 2565 scope.go:117] "RemoveContainer" containerID="5e84bf8f2954b88ae5cd543c0c7cabcefcb4ee4ed2b693515a939eb9d6153807" Jul 13 07:20:18.848388 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:20:18.848354 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e84bf8f2954b88ae5cd543c0c7cabcefcb4ee4ed2b693515a939eb9d6153807\": container with ID starting with 5e84bf8f2954b88ae5cd543c0c7cabcefcb4ee4ed2b693515a939eb9d6153807 not found: ID does not exist" containerID="5e84bf8f2954b88ae5cd543c0c7cabcefcb4ee4ed2b693515a939eb9d6153807" Jul 13 07:20:18.848508 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.848393 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e84bf8f2954b88ae5cd543c0c7cabcefcb4ee4ed2b693515a939eb9d6153807"} err="failed to get container status \"5e84bf8f2954b88ae5cd543c0c7cabcefcb4ee4ed2b693515a939eb9d6153807\": rpc error: code = NotFound desc = could not find container \"5e84bf8f2954b88ae5cd543c0c7cabcefcb4ee4ed2b693515a939eb9d6153807\": container with ID starting with 5e84bf8f2954b88ae5cd543c0c7cabcefcb4ee4ed2b693515a939eb9d6153807 not found: ID does not exist" Jul 13 07:20:18.848508 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.848417 2565 scope.go:117] "RemoveContainer" containerID="d2b8fb122ca4b36afecc255115fda62422f7f26db3d566ff03fa7e7d3dea593f" Jul 13 07:20:18.859980 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.859962 2565 scope.go:117] "RemoveContainer" containerID="d2b8fb122ca4b36afecc255115fda62422f7f26db3d566ff03fa7e7d3dea593f" Jul 13 07:20:18.860256 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:20:18.860236 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2b8fb122ca4b36afecc255115fda62422f7f26db3d566ff03fa7e7d3dea593f\": container with ID starting with d2b8fb122ca4b36afecc255115fda62422f7f26db3d566ff03fa7e7d3dea593f not found: ID does not exist" containerID="d2b8fb122ca4b36afecc255115fda62422f7f26db3d566ff03fa7e7d3dea593f" Jul 13 07:20:18.860332 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.860266 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2b8fb122ca4b36afecc255115fda62422f7f26db3d566ff03fa7e7d3dea593f"} err="failed to get container status \"d2b8fb122ca4b36afecc255115fda62422f7f26db3d566ff03fa7e7d3dea593f\": rpc error: code = NotFound desc = could not find container \"d2b8fb122ca4b36afecc255115fda62422f7f26db3d566ff03fa7e7d3dea593f\": container with ID starting with d2b8fb122ca4b36afecc255115fda62422f7f26db3d566ff03fa7e7d3dea593f not found: ID does not exist" Jul 13 07:20:18.864405 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.864361 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-74cccb8648-qmv6g" podStartSLOduration=2.331342985 podStartE2EDuration="2.864349066s" totalImagesPullingTime="533.006081ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:20:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:20:18.862040352 +0000 UTC m=+495.784292525" watchObservedRunningTime="2026-07-13 07:20:18.864349066 +0000 UTC m=+495.786601239" Jul 13 07:20:18.878112 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.878086 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jnwrj"] Jul 13 07:20:18.880278 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.880258 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jnwrj"] Jul 13 07:20:18.893655 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.893630 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-cbc578b48-j6pcp"] Jul 13 07:20:18.895753 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:18.895729 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-cbc578b48-j6pcp"] Jul 13 07:20:19.639541 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:19.639509 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0925661e-0a63-45f0-9d4b-4da2f5681c48" path="/var/lib/kubelet/pods/0925661e-0a63-45f0-9d4b-4da2f5681c48/volumes" Jul 13 07:20:19.639908 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:19.639887 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e12bb3d8-0334-4653-aeb9-727488552173" path="/var/lib/kubelet/pods/e12bb3d8-0334-4653-aeb9-727488552173/volumes" Jul 13 07:20:23.093691 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:23.093657 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:20:23.192262 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:23.192226 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:20:23.266889 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:23.266860 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:20:23.624914 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:23.624883 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:20:26.553905 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:26.553868 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:20:26.645647 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:26.645611 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:20:58.855960 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:58.855870 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:20:59.369631 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:59.369594 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:20:59.608207 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:59.608172 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:20:59.784608 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:59.784571 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:20:59.870604 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:59.870568 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:20:59.893977 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:59.893948 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-598sx"] Jul 13 07:20:59.894291 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:59.894279 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0925661e-0a63-45f0-9d4b-4da2f5681c48" containerName="authorino" Jul 13 07:20:59.894401 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:59.894292 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0925661e-0a63-45f0-9d4b-4da2f5681c48" containerName="authorino" Jul 13 07:20:59.894401 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:59.894324 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e12bb3d8-0334-4653-aeb9-727488552173" containerName="authorino" Jul 13 07:20:59.894401 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:59.894330 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e12bb3d8-0334-4653-aeb9-727488552173" containerName="authorino" Jul 13 07:20:59.894401 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:59.894393 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0925661e-0a63-45f0-9d4b-4da2f5681c48" containerName="authorino" Jul 13 07:20:59.894585 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:59.894405 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e12bb3d8-0334-4653-aeb9-727488552173" containerName="authorino" Jul 13 07:20:59.897306 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:59.897287 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-598sx" Jul 13 07:20:59.899773 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:59.899743 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 13 07:20:59.899895 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:59.899789 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vp5kd\"" Jul 13 07:20:59.907493 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:59.907470 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-598sx"] Jul 13 07:20:59.923289 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:59.923263 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-k8dm5"] Jul 13 07:20:59.926297 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:59.926282 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-k8dm5" Jul 13 07:20:59.937747 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:20:59.937723 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-k8dm5"] Jul 13 07:21:00.001073 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:00.001037 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d266065b-5053-4702-965a-cfb5aa944018-plugins-config-volume\") pod \"payload-processing-58f86c7798-k8dm5\" (UID: \"d266065b-5053-4702-965a-cfb5aa944018\") " pod="openshift-ingress/payload-processing-58f86c7798-k8dm5" Jul 13 07:21:00.001073 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:00.001077 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6ggb\" (UniqueName: \"kubernetes.io/projected/d266065b-5053-4702-965a-cfb5aa944018-kube-api-access-w6ggb\") pod \"payload-processing-58f86c7798-k8dm5\" (UID: \"d266065b-5053-4702-965a-cfb5aa944018\") " pod="openshift-ingress/payload-processing-58f86c7798-k8dm5" Jul 13 07:21:00.001351 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:00.001116 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1669fd3c-1f63-460c-b386-b528ea3d0ff5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-598sx\" (UID: \"1669fd3c-1f63-460c-b386-b528ea3d0ff5\") " pod="openshift-ingress/payload-pre-processing-7964457696-598sx" Jul 13 07:21:00.001351 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:00.001202 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9nh9\" (UniqueName: \"kubernetes.io/projected/1669fd3c-1f63-460c-b386-b528ea3d0ff5-kube-api-access-h9nh9\") pod \"payload-pre-processing-7964457696-598sx\" (UID: \"1669fd3c-1f63-460c-b386-b528ea3d0ff5\") " pod="openshift-ingress/payload-pre-processing-7964457696-598sx" Jul 13 07:21:00.102582 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:00.102496 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9nh9\" (UniqueName: \"kubernetes.io/projected/1669fd3c-1f63-460c-b386-b528ea3d0ff5-kube-api-access-h9nh9\") pod \"payload-pre-processing-7964457696-598sx\" (UID: \"1669fd3c-1f63-460c-b386-b528ea3d0ff5\") " pod="openshift-ingress/payload-pre-processing-7964457696-598sx" Jul 13 07:21:00.102582 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:00.102557 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d266065b-5053-4702-965a-cfb5aa944018-plugins-config-volume\") pod \"payload-processing-58f86c7798-k8dm5\" (UID: \"d266065b-5053-4702-965a-cfb5aa944018\") " pod="openshift-ingress/payload-processing-58f86c7798-k8dm5" Jul 13 07:21:00.102582 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:00.102583 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6ggb\" (UniqueName: \"kubernetes.io/projected/d266065b-5053-4702-965a-cfb5aa944018-kube-api-access-w6ggb\") pod \"payload-processing-58f86c7798-k8dm5\" (UID: \"d266065b-5053-4702-965a-cfb5aa944018\") " pod="openshift-ingress/payload-processing-58f86c7798-k8dm5" Jul 13 07:21:00.102857 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:00.102626 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1669fd3c-1f63-460c-b386-b528ea3d0ff5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-598sx\" (UID: \"1669fd3c-1f63-460c-b386-b528ea3d0ff5\") " pod="openshift-ingress/payload-pre-processing-7964457696-598sx" Jul 13 07:21:00.103570 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:00.103546 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1669fd3c-1f63-460c-b386-b528ea3d0ff5-plugins-config-volume\") pod \"payload-pre-processing-7964457696-598sx\" (UID: \"1669fd3c-1f63-460c-b386-b528ea3d0ff5\") " pod="openshift-ingress/payload-pre-processing-7964457696-598sx" Jul 13 07:21:00.103634 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:00.103546 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d266065b-5053-4702-965a-cfb5aa944018-plugins-config-volume\") pod \"payload-processing-58f86c7798-k8dm5\" (UID: \"d266065b-5053-4702-965a-cfb5aa944018\") " pod="openshift-ingress/payload-processing-58f86c7798-k8dm5" Jul 13 07:21:00.113826 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:00.113800 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9nh9\" (UniqueName: \"kubernetes.io/projected/1669fd3c-1f63-460c-b386-b528ea3d0ff5-kube-api-access-h9nh9\") pod \"payload-pre-processing-7964457696-598sx\" (UID: \"1669fd3c-1f63-460c-b386-b528ea3d0ff5\") " pod="openshift-ingress/payload-pre-processing-7964457696-598sx" Jul 13 07:21:00.113932 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:00.113895 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6ggb\" (UniqueName: \"kubernetes.io/projected/d266065b-5053-4702-965a-cfb5aa944018-kube-api-access-w6ggb\") pod \"payload-processing-58f86c7798-k8dm5\" (UID: \"d266065b-5053-4702-965a-cfb5aa944018\") " pod="openshift-ingress/payload-processing-58f86c7798-k8dm5" Jul 13 07:21:00.208941 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:00.208906 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-598sx" Jul 13 07:21:00.235382 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:00.235291 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-k8dm5" Jul 13 07:21:00.357124 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:00.357095 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-598sx"] Jul 13 07:21:00.360250 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:21:00.360222 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1669fd3c_1f63_460c_b386_b528ea3d0ff5.slice/crio-125f22e71eab79bd57113d49f2b48ab6b647e59911a168d13ae00eee37269f3c WatchSource:0}: Error finding container 125f22e71eab79bd57113d49f2b48ab6b647e59911a168d13ae00eee37269f3c: Status 404 returned error can't find the container with id 125f22e71eab79bd57113d49f2b48ab6b647e59911a168d13ae00eee37269f3c Jul 13 07:21:00.383709 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:00.383632 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-k8dm5"] Jul 13 07:21:00.385757 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:21:00.385733 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd266065b_5053_4702_965a_cfb5aa944018.slice/crio-e15b3866b9cabfa0015ee0fc4530bff05dd8c2a6b01054eba3ca7ebd32949698 WatchSource:0}: Error finding container e15b3866b9cabfa0015ee0fc4530bff05dd8c2a6b01054eba3ca7ebd32949698: Status 404 returned error can't find the container with id e15b3866b9cabfa0015ee0fc4530bff05dd8c2a6b01054eba3ca7ebd32949698 Jul 13 07:21:01.058995 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:01.058958 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-k8dm5" event={"ID":"d266065b-5053-4702-965a-cfb5aa944018","Type":"ContainerStarted","Data":"e15b3866b9cabfa0015ee0fc4530bff05dd8c2a6b01054eba3ca7ebd32949698"} Jul 13 07:21:01.084714 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:01.084611 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-598sx" event={"ID":"1669fd3c-1f63-460c-b386-b528ea3d0ff5","Type":"ContainerStarted","Data":"125f22e71eab79bd57113d49f2b48ab6b647e59911a168d13ae00eee37269f3c"} Jul 13 07:21:02.094870 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:02.094826 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-k8dm5" event={"ID":"d266065b-5053-4702-965a-cfb5aa944018","Type":"ContainerStarted","Data":"04cf1b21da117c77d344fc4bbc83eca28af69312943858cafcda5f126f3253a6"} Jul 13 07:21:02.095273 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:02.094898 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-k8dm5" Jul 13 07:21:02.096416 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:02.096388 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-598sx" event={"ID":"1669fd3c-1f63-460c-b386-b528ea3d0ff5","Type":"ContainerStarted","Data":"11e788c0c2999597dfd3d9a659fb1dfb7abe3e6619d457ae578493c6ff923950"} Jul 13 07:21:02.096524 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:02.096467 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-598sx" Jul 13 07:21:02.112196 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:02.112126 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-k8dm5" podStartSLOduration=1.49953322 podStartE2EDuration="3.112111181s" totalImagesPullingTime="1.612577961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:20:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:21:02.109757237 +0000 UTC m=+539.032009411" watchObservedRunningTime="2026-07-13 07:21:02.112111181 +0000 UTC m=+539.034363369" Jul 13 07:21:02.124949 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:02.124911 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-598sx" podStartSLOduration=1.490103009 podStartE2EDuration="3.124896403s" totalImagesPullingTime="1.634793394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:20:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:21:02.124015153 +0000 UTC m=+539.046267326" watchObservedRunningTime="2026-07-13 07:21:02.124896403 +0000 UTC m=+539.047148604" Jul 13 07:21:08.131905 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:08.131871 2565 generic.go:356] "Generic (PLEG): container finished" podID="5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021" containerID="ca1534fdf99efd7c0357fc06e46983ee534997b5c6a82b49ebcb304d42271bb6" exitCode=0 Jul 13 07:21:08.132354 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:08.131950 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" event={"ID":"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021","Type":"ContainerDied","Data":"ca1534fdf99efd7c0357fc06e46983ee534997b5c6a82b49ebcb304d42271bb6"} Jul 13 07:21:08.132489 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:08.132459 2565 scope.go:117] "RemoveContainer" containerID="ca1534fdf99efd7c0357fc06e46983ee534997b5c6a82b49ebcb304d42271bb6" Jul 13 07:21:08.133466 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:08.133436 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:21:08.133578 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:08.133504 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:21:08.133578 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:08.133535 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:21:09.138802 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:09.138761 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" event={"ID":"5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021","Type":"ContainerStarted","Data":"0f1c28814ccd160d728aeffce1b79647769b211d698f47cfb182d3f6292ecfd3"} Jul 13 07:21:09.177185 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:09.177140 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:21:09.178596 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:09.178254 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-w9qjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 13 07:21:09.178596 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:09.178343 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" podUID="5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 13 07:21:09.915613 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:09.915572 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:21:10.015420 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:10.015378 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:21:10.177238 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:10.177146 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-w9qjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 13 07:21:10.178576 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:10.178540 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" podUID="5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 13 07:21:11.178380 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:11.177887 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-w9qjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 13 07:21:11.178380 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:11.177950 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" podUID="5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 13 07:21:12.177847 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:12.177808 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-w9qjf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 13 07:21:12.178146 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:12.178114 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" podUID="5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 13 07:21:12.625749 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:12.625707 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:21:13.103708 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:13.103664 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-7964457696-598sx" podUID="1669fd3c-1f63-460c-b386-b528ea3d0ff5" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.46:9004: connect: connection refused" Jul 13 07:21:13.104327 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:13.104294 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-k8dm5" Jul 13 07:21:13.181545 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:13.181512 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:21:13.182425 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:13.182405 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-w9qjf" Jul 13 07:21:19.356199 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:19.356159 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:21:23.102466 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:23.102434 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-598sx" Jul 13 07:21:23.846170 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:23.846132 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:21:23.910334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:23.910292 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:21:26.591234 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:26.591197 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:21:27.718123 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.718090 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm"] Jul 13 07:21:27.721066 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.721043 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:27.724740 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.724619 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 13 07:21:27.724740 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.724646 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kvj25\"" Jul 13 07:21:27.724740 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.724661 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 13 07:21:27.724740 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.724728 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 13 07:21:27.732686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.732664 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm"] Jul 13 07:21:27.753702 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.753664 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bdaae6a-827f-4f8c-9ab2-9ca287e80c52-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dqxzm\" (UID: \"2bdaae6a-827f-4f8c-9ab2-9ca287e80c52\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:27.753853 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.753775 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bdaae6a-827f-4f8c-9ab2-9ca287e80c52-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dqxzm\" (UID: \"2bdaae6a-827f-4f8c-9ab2-9ca287e80c52\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:27.753853 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.753807 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bdaae6a-827f-4f8c-9ab2-9ca287e80c52-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dqxzm\" (UID: \"2bdaae6a-827f-4f8c-9ab2-9ca287e80c52\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:27.753853 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.753833 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bdaae6a-827f-4f8c-9ab2-9ca287e80c52-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dqxzm\" (UID: \"2bdaae6a-827f-4f8c-9ab2-9ca287e80c52\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:27.753993 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.753856 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbnk6\" (UniqueName: \"kubernetes.io/projected/2bdaae6a-827f-4f8c-9ab2-9ca287e80c52-kube-api-access-hbnk6\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dqxzm\" (UID: \"2bdaae6a-827f-4f8c-9ab2-9ca287e80c52\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:27.753993 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.753914 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bdaae6a-827f-4f8c-9ab2-9ca287e80c52-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dqxzm\" (UID: \"2bdaae6a-827f-4f8c-9ab2-9ca287e80c52\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:27.756921 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.756892 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:21:27.855145 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.855110 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bdaae6a-827f-4f8c-9ab2-9ca287e80c52-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dqxzm\" (UID: \"2bdaae6a-827f-4f8c-9ab2-9ca287e80c52\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:27.855145 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.855145 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbnk6\" (UniqueName: \"kubernetes.io/projected/2bdaae6a-827f-4f8c-9ab2-9ca287e80c52-kube-api-access-hbnk6\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dqxzm\" (UID: \"2bdaae6a-827f-4f8c-9ab2-9ca287e80c52\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:27.855420 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.855166 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bdaae6a-827f-4f8c-9ab2-9ca287e80c52-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dqxzm\" (UID: \"2bdaae6a-827f-4f8c-9ab2-9ca287e80c52\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:27.855420 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.855217 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bdaae6a-827f-4f8c-9ab2-9ca287e80c52-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dqxzm\" (UID: \"2bdaae6a-827f-4f8c-9ab2-9ca287e80c52\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:27.855420 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.855286 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bdaae6a-827f-4f8c-9ab2-9ca287e80c52-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dqxzm\" (UID: \"2bdaae6a-827f-4f8c-9ab2-9ca287e80c52\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:27.855420 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.855310 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bdaae6a-827f-4f8c-9ab2-9ca287e80c52-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dqxzm\" (UID: \"2bdaae6a-827f-4f8c-9ab2-9ca287e80c52\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:27.855666 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.855572 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2bdaae6a-827f-4f8c-9ab2-9ca287e80c52-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dqxzm\" (UID: \"2bdaae6a-827f-4f8c-9ab2-9ca287e80c52\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:27.855718 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.855659 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2bdaae6a-827f-4f8c-9ab2-9ca287e80c52-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dqxzm\" (UID: \"2bdaae6a-827f-4f8c-9ab2-9ca287e80c52\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:27.855718 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.855674 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2bdaae6a-827f-4f8c-9ab2-9ca287e80c52-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dqxzm\" (UID: \"2bdaae6a-827f-4f8c-9ab2-9ca287e80c52\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:27.857751 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.857726 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2bdaae6a-827f-4f8c-9ab2-9ca287e80c52-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dqxzm\" (UID: \"2bdaae6a-827f-4f8c-9ab2-9ca287e80c52\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:27.857967 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.857948 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2bdaae6a-827f-4f8c-9ab2-9ca287e80c52-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dqxzm\" (UID: \"2bdaae6a-827f-4f8c-9ab2-9ca287e80c52\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:27.863176 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:27.863145 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbnk6\" (UniqueName: \"kubernetes.io/projected/2bdaae6a-827f-4f8c-9ab2-9ca287e80c52-kube-api-access-hbnk6\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dqxzm\" (UID: \"2bdaae6a-827f-4f8c-9ab2-9ca287e80c52\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:28.034664 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:28.034617 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:28.175149 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:28.175120 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm"] Jul 13 07:21:28.177233 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:21:28.177201 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bdaae6a_827f_4f8c_9ab2_9ca287e80c52.slice/crio-6f9fa68c525db3324e2c4e4ede16afe1656a1342e5776315dfa525473df32b5f WatchSource:0}: Error finding container 6f9fa68c525db3324e2c4e4ede16afe1656a1342e5776315dfa525473df32b5f: Status 404 returned error can't find the container with id 6f9fa68c525db3324e2c4e4ede16afe1656a1342e5776315dfa525473df32b5f Jul 13 07:21:28.236408 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:28.236369 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" event={"ID":"2bdaae6a-827f-4f8c-9ab2-9ca287e80c52","Type":"ContainerStarted","Data":"6f9fa68c525db3324e2c4e4ede16afe1656a1342e5776315dfa525473df32b5f"} Jul 13 07:21:30.250081 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:30.250041 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" event={"ID":"2bdaae6a-827f-4f8c-9ab2-9ca287e80c52","Type":"ContainerStarted","Data":"c539ae17a605b0c83eab39771e39fc25cbb71a181914d79c37897abc560d116a"} Jul 13 07:21:30.269246 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:30.269190 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" podStartSLOduration=2.079780643 podStartE2EDuration="3.269174686s" totalImagesPullingTime="1.189394043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:21:30.266311649 +0000 UTC m=+567.188563823" watchObservedRunningTime="2026-07-13 07:21:30.269174686 +0000 UTC m=+567.191426952" Jul 13 07:21:38.035068 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:38.035026 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:38.035614 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:38.035097 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:38.047649 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:38.047621 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:38.302758 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:38.302650 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dqxzm" Jul 13 07:21:39.385998 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:39.385963 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:21:39.487031 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:39.486985 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:21:45.154103 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:45.154050 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:21:50.745647 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:50.745610 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:21:54.816174 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:54.816136 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2"] Jul 13 07:21:54.819600 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:54.819574 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:21:54.822157 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:54.822130 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 13 07:21:54.831032 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:54.831006 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2"] Jul 13 07:21:54.843841 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:54.843809 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:21:54.905029 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:54.905000 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2759d8a8-f717-4800-b843-a39ca2ab2216-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxb2\" (UID: \"2759d8a8-f717-4800-b843-a39ca2ab2216\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:21:54.905029 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:54.905040 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2759d8a8-f717-4800-b843-a39ca2ab2216-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxb2\" (UID: \"2759d8a8-f717-4800-b843-a39ca2ab2216\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:21:54.905247 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:54.905069 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2759d8a8-f717-4800-b843-a39ca2ab2216-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxb2\" (UID: \"2759d8a8-f717-4800-b843-a39ca2ab2216\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:21:54.905247 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:54.905145 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbmd8\" (UniqueName: \"kubernetes.io/projected/2759d8a8-f717-4800-b843-a39ca2ab2216-kube-api-access-mbmd8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxb2\" (UID: \"2759d8a8-f717-4800-b843-a39ca2ab2216\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:21:54.905247 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:54.905189 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2759d8a8-f717-4800-b843-a39ca2ab2216-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxb2\" (UID: \"2759d8a8-f717-4800-b843-a39ca2ab2216\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:21:54.905400 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:54.905258 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2759d8a8-f717-4800-b843-a39ca2ab2216-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxb2\" (UID: \"2759d8a8-f717-4800-b843-a39ca2ab2216\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:21:55.005973 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:55.005934 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2759d8a8-f717-4800-b843-a39ca2ab2216-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxb2\" (UID: \"2759d8a8-f717-4800-b843-a39ca2ab2216\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:21:55.006177 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:55.006010 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2759d8a8-f717-4800-b843-a39ca2ab2216-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxb2\" (UID: \"2759d8a8-f717-4800-b843-a39ca2ab2216\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:21:55.006177 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:55.006041 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2759d8a8-f717-4800-b843-a39ca2ab2216-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxb2\" (UID: \"2759d8a8-f717-4800-b843-a39ca2ab2216\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:21:55.006177 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:55.006061 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2759d8a8-f717-4800-b843-a39ca2ab2216-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxb2\" (UID: \"2759d8a8-f717-4800-b843-a39ca2ab2216\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:21:55.006177 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:55.006100 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbmd8\" (UniqueName: \"kubernetes.io/projected/2759d8a8-f717-4800-b843-a39ca2ab2216-kube-api-access-mbmd8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxb2\" (UID: \"2759d8a8-f717-4800-b843-a39ca2ab2216\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:21:55.006177 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:55.006139 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2759d8a8-f717-4800-b843-a39ca2ab2216-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxb2\" (UID: \"2759d8a8-f717-4800-b843-a39ca2ab2216\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:21:55.006481 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:55.006464 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2759d8a8-f717-4800-b843-a39ca2ab2216-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxb2\" (UID: \"2759d8a8-f717-4800-b843-a39ca2ab2216\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:21:55.006538 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:55.006501 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2759d8a8-f717-4800-b843-a39ca2ab2216-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxb2\" (UID: \"2759d8a8-f717-4800-b843-a39ca2ab2216\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:21:55.006580 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:55.006554 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2759d8a8-f717-4800-b843-a39ca2ab2216-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxb2\" (UID: \"2759d8a8-f717-4800-b843-a39ca2ab2216\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:21:55.008441 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:55.008418 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2759d8a8-f717-4800-b843-a39ca2ab2216-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxb2\" (UID: \"2759d8a8-f717-4800-b843-a39ca2ab2216\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:21:55.008692 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:55.008674 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2759d8a8-f717-4800-b843-a39ca2ab2216-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxb2\" (UID: \"2759d8a8-f717-4800-b843-a39ca2ab2216\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:21:55.014808 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:55.014787 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbmd8\" (UniqueName: \"kubernetes.io/projected/2759d8a8-f717-4800-b843-a39ca2ab2216-kube-api-access-mbmd8\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dvxb2\" (UID: \"2759d8a8-f717-4800-b843-a39ca2ab2216\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:21:55.131554 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:55.131464 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:21:55.269004 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:55.268977 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2"] Jul 13 07:21:55.271533 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:21:55.271501 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2759d8a8_f717_4800_b843_a39ca2ab2216.slice/crio-ca26a6ac3c441ebfc1812903d4e41f8a6a29e6ca9d9b11da5e9404d5c99b51e9 WatchSource:0}: Error finding container ca26a6ac3c441ebfc1812903d4e41f8a6a29e6ca9d9b11da5e9404d5c99b51e9: Status 404 returned error can't find the container with id ca26a6ac3c441ebfc1812903d4e41f8a6a29e6ca9d9b11da5e9404d5c99b51e9 Jul 13 07:21:55.380836 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:55.380799 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" event={"ID":"2759d8a8-f717-4800-b843-a39ca2ab2216","Type":"ContainerStarted","Data":"ca26a6ac3c441ebfc1812903d4e41f8a6a29e6ca9d9b11da5e9404d5c99b51e9"} Jul 13 07:21:56.388371 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:56.388309 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" event={"ID":"2759d8a8-f717-4800-b843-a39ca2ab2216","Type":"ContainerStarted","Data":"2badd11f76e8a3c00cbb01ae31a3f1a806f74aa90def35d20c724cffe1c94511"} Jul 13 07:21:56.409619 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:21:56.409563 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" podStartSLOduration=2.194754119 podStartE2EDuration="2.409545399s" totalImagesPullingTime="214.79128ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:21:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:21:56.40711647 +0000 UTC m=+593.329368642" watchObservedRunningTime="2026-07-13 07:21:56.409545399 +0000 UTC m=+593.331797573" Jul 13 07:22:00.472309 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:22:00.472271 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:22:03.864205 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:22:03.864166 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:22:05.132014 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:22:05.131962 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:22:05.132452 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:22:05.132041 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:22:05.144678 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:22:05.144653 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:22:05.449922 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:22:05.449833 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dvxb2" Jul 13 07:23:10.325525 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:10.325494 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b98bdbfc-c9f8z"] Jul 13 07:23:10.328863 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:10.328845 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b98bdbfc-c9f8z" Jul 13 07:23:10.336716 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:10.336690 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b98bdbfc-c9f8z"] Jul 13 07:23:10.428171 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:10.428145 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx267\" (UniqueName: \"kubernetes.io/projected/e5c6d326-3be0-4439-9977-5d2ca817f9ec-kube-api-access-sx267\") pod \"authorino-6b98bdbfc-c9f8z\" (UID: \"e5c6d326-3be0-4439-9977-5d2ca817f9ec\") " pod="kuadrant-system/authorino-6b98bdbfc-c9f8z" Jul 13 07:23:10.428339 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:10.428200 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5c6d326-3be0-4439-9977-5d2ca817f9ec-tls-cert\") pod \"authorino-6b98bdbfc-c9f8z\" (UID: \"e5c6d326-3be0-4439-9977-5d2ca817f9ec\") " pod="kuadrant-system/authorino-6b98bdbfc-c9f8z" Jul 13 07:23:10.529058 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:10.529031 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx267\" (UniqueName: \"kubernetes.io/projected/e5c6d326-3be0-4439-9977-5d2ca817f9ec-kube-api-access-sx267\") pod \"authorino-6b98bdbfc-c9f8z\" (UID: \"e5c6d326-3be0-4439-9977-5d2ca817f9ec\") " pod="kuadrant-system/authorino-6b98bdbfc-c9f8z" Jul 13 07:23:10.529169 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:10.529082 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5c6d326-3be0-4439-9977-5d2ca817f9ec-tls-cert\") pod \"authorino-6b98bdbfc-c9f8z\" (UID: \"e5c6d326-3be0-4439-9977-5d2ca817f9ec\") " pod="kuadrant-system/authorino-6b98bdbfc-c9f8z" Jul 13 07:23:10.531404 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:10.531379 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5c6d326-3be0-4439-9977-5d2ca817f9ec-tls-cert\") pod \"authorino-6b98bdbfc-c9f8z\" (UID: \"e5c6d326-3be0-4439-9977-5d2ca817f9ec\") " pod="kuadrant-system/authorino-6b98bdbfc-c9f8z" Jul 13 07:23:10.536556 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:10.536537 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx267\" (UniqueName: \"kubernetes.io/projected/e5c6d326-3be0-4439-9977-5d2ca817f9ec-kube-api-access-sx267\") pod \"authorino-6b98bdbfc-c9f8z\" (UID: \"e5c6d326-3be0-4439-9977-5d2ca817f9ec\") " pod="kuadrant-system/authorino-6b98bdbfc-c9f8z" Jul 13 07:23:10.638803 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:10.638750 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b98bdbfc-c9f8z" Jul 13 07:23:10.766979 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:10.766956 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b98bdbfc-c9f8z"] Jul 13 07:23:10.768815 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:23:10.768791 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5c6d326_3be0_4439_9977_5d2ca817f9ec.slice/crio-ce528d0c4c6086f319a9b5d3ade7af6fa812eee52f4e58a207c00b9dff5976b1 WatchSource:0}: Error finding container ce528d0c4c6086f319a9b5d3ade7af6fa812eee52f4e58a207c00b9dff5976b1: Status 404 returned error can't find the container with id ce528d0c4c6086f319a9b5d3ade7af6fa812eee52f4e58a207c00b9dff5976b1 Jul 13 07:23:10.770041 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:10.770025 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 07:23:11.773372 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:11.773310 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b98bdbfc-c9f8z" event={"ID":"e5c6d326-3be0-4439-9977-5d2ca817f9ec","Type":"ContainerStarted","Data":"2b740be5cf746ac574f76168b626918cd65fc39c4492bcf44d2e85a3af9ca97d"} Jul 13 07:23:11.773744 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:11.773384 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b98bdbfc-c9f8z" event={"ID":"e5c6d326-3be0-4439-9977-5d2ca817f9ec","Type":"ContainerStarted","Data":"ce528d0c4c6086f319a9b5d3ade7af6fa812eee52f4e58a207c00b9dff5976b1"} Jul 13 07:23:11.791377 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:11.790434 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6b98bdbfc-c9f8z" podStartSLOduration=1.367580489 podStartE2EDuration="1.790413801s" totalImagesPullingTime="422.833312ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:23:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:23:11.788769969 +0000 UTC m=+668.711022148" watchObservedRunningTime="2026-07-13 07:23:11.790413801 +0000 UTC m=+668.712665975" Jul 13 07:23:11.827572 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:11.827462 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74cccb8648-qmv6g"] Jul 13 07:23:11.828044 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:11.827713 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-74cccb8648-qmv6g" podUID="a39859ff-26ec-4717-951e-8830ea546da4" containerName="authorino" containerID="cri-o://c697e777b485c6aba8107830c6b2bf0ad0cc5182245bf47fb7481f84f62bf3a8" gracePeriod=30 Jul 13 07:23:12.094390 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:12.094362 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74cccb8648-qmv6g" Jul 13 07:23:12.245799 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:12.245763 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dr7pr\" (UniqueName: \"kubernetes.io/projected/a39859ff-26ec-4717-951e-8830ea546da4-kube-api-access-dr7pr\") pod \"a39859ff-26ec-4717-951e-8830ea546da4\" (UID: \"a39859ff-26ec-4717-951e-8830ea546da4\") " Jul 13 07:23:12.245986 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:12.245850 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a39859ff-26ec-4717-951e-8830ea546da4-tls-cert\") pod \"a39859ff-26ec-4717-951e-8830ea546da4\" (UID: \"a39859ff-26ec-4717-951e-8830ea546da4\") " Jul 13 07:23:12.247984 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:12.247951 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a39859ff-26ec-4717-951e-8830ea546da4-kube-api-access-dr7pr" (OuterVolumeSpecName: "kube-api-access-dr7pr") pod "a39859ff-26ec-4717-951e-8830ea546da4" (UID: "a39859ff-26ec-4717-951e-8830ea546da4"). InnerVolumeSpecName "kube-api-access-dr7pr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:23:12.257738 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:12.257711 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a39859ff-26ec-4717-951e-8830ea546da4-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a39859ff-26ec-4717-951e-8830ea546da4" (UID: "a39859ff-26ec-4717-951e-8830ea546da4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 13 07:23:12.334832 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:12.334742 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:23:12.346728 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:12.346694 2565 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a39859ff-26ec-4717-951e-8830ea546da4-tls-cert\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:23:12.346728 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:12.346728 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dr7pr\" (UniqueName: \"kubernetes.io/projected/a39859ff-26ec-4717-951e-8830ea546da4-kube-api-access-dr7pr\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:23:12.426844 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:12.426809 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:23:12.779837 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:12.779800 2565 generic.go:356] "Generic (PLEG): container finished" podID="a39859ff-26ec-4717-951e-8830ea546da4" containerID="c697e777b485c6aba8107830c6b2bf0ad0cc5182245bf47fb7481f84f62bf3a8" exitCode=0 Jul 13 07:23:12.780231 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:12.779885 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74cccb8648-qmv6g" Jul 13 07:23:12.780231 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:12.779891 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74cccb8648-qmv6g" event={"ID":"a39859ff-26ec-4717-951e-8830ea546da4","Type":"ContainerDied","Data":"c697e777b485c6aba8107830c6b2bf0ad0cc5182245bf47fb7481f84f62bf3a8"} Jul 13 07:23:12.780231 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:12.780007 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74cccb8648-qmv6g" event={"ID":"a39859ff-26ec-4717-951e-8830ea546da4","Type":"ContainerDied","Data":"9c16d34d893fe7318d9957eb7dcc698adc81d0b68d8a25a55d11ab473423652d"} Jul 13 07:23:12.780231 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:12.780031 2565 scope.go:117] "RemoveContainer" containerID="c697e777b485c6aba8107830c6b2bf0ad0cc5182245bf47fb7481f84f62bf3a8" Jul 13 07:23:12.789581 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:12.789555 2565 scope.go:117] "RemoveContainer" containerID="c697e777b485c6aba8107830c6b2bf0ad0cc5182245bf47fb7481f84f62bf3a8" Jul 13 07:23:12.789897 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:23:12.789875 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c697e777b485c6aba8107830c6b2bf0ad0cc5182245bf47fb7481f84f62bf3a8\": container with ID starting with c697e777b485c6aba8107830c6b2bf0ad0cc5182245bf47fb7481f84f62bf3a8 not found: ID does not exist" containerID="c697e777b485c6aba8107830c6b2bf0ad0cc5182245bf47fb7481f84f62bf3a8" Jul 13 07:23:12.789964 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:12.789904 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c697e777b485c6aba8107830c6b2bf0ad0cc5182245bf47fb7481f84f62bf3a8"} err="failed to get container status \"c697e777b485c6aba8107830c6b2bf0ad0cc5182245bf47fb7481f84f62bf3a8\": rpc error: code = NotFound desc = could not find container \"c697e777b485c6aba8107830c6b2bf0ad0cc5182245bf47fb7481f84f62bf3a8\": container with ID starting with c697e777b485c6aba8107830c6b2bf0ad0cc5182245bf47fb7481f84f62bf3a8 not found: ID does not exist" Jul 13 07:23:12.838390 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:12.838358 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74cccb8648-qmv6g"] Jul 13 07:23:12.840714 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:12.840693 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-74cccb8648-qmv6g"] Jul 13 07:23:13.489829 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:13.489794 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:23:13.583540 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:13.583494 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:23:13.640330 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:13.640272 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a39859ff-26ec-4717-951e-8830ea546da4" path="/var/lib/kubelet/pods/a39859ff-26ec-4717-951e-8830ea546da4/volumes" Jul 13 07:23:15.455708 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:15.455670 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:23:42.706402 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:42.706359 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:23:42.806830 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:23:42.806799 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:24:00.958697 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:24:00.958597 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:24:36.705937 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:24:36.705889 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:24:44.231967 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:24:44.231928 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:24:45.603098 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:24:45.603062 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:25:23.989492 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:25:23.989456 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:25:24.086755 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:25:24.086712 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:25:24.192200 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:25:24.192165 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:25:30.074900 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:25:30.074768 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:25:30.137616 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:25:30.137577 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:25:30.214511 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:25:30.214476 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:25:30.402254 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:25:30.402157 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:25:35.956215 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:25:35.956174 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:25:36.056797 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:25:36.056753 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:27:29.095446 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:27:29.095406 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:27:42.537916 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:27:42.537885 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:29:24.842280 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:29:24.842248 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk"] Jul 13 07:29:24.842830 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:29:24.842462 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk" podUID="7bddad45-e0c1-47e8-8a92-4fce721c04a3" containerName="manager" containerID="cri-o://0bf331a019d04e32ce0ed9e6978596224a5c1b6792cdabf19d78a0e5591a445b" gracePeriod=10 Jul 13 07:29:27.400918 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:29:27.400893 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk" Jul 13 07:29:27.543114 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:29:27.543088 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7bddad45-e0c1-47e8-8a92-4fce721c04a3-extensions-socket-volume\") pod \"7bddad45-e0c1-47e8-8a92-4fce721c04a3\" (UID: \"7bddad45-e0c1-47e8-8a92-4fce721c04a3\") " Jul 13 07:29:27.543254 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:29:27.543158 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qb8vb\" (UniqueName: \"kubernetes.io/projected/7bddad45-e0c1-47e8-8a92-4fce721c04a3-kube-api-access-qb8vb\") pod \"7bddad45-e0c1-47e8-8a92-4fce721c04a3\" (UID: \"7bddad45-e0c1-47e8-8a92-4fce721c04a3\") " Jul 13 07:29:27.543471 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:29:27.543448 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bddad45-e0c1-47e8-8a92-4fce721c04a3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7bddad45-e0c1-47e8-8a92-4fce721c04a3" (UID: "7bddad45-e0c1-47e8-8a92-4fce721c04a3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:29:27.545090 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:29:27.545068 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bddad45-e0c1-47e8-8a92-4fce721c04a3-kube-api-access-qb8vb" (OuterVolumeSpecName: "kube-api-access-qb8vb") pod "7bddad45-e0c1-47e8-8a92-4fce721c04a3" (UID: "7bddad45-e0c1-47e8-8a92-4fce721c04a3"). InnerVolumeSpecName "kube-api-access-qb8vb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:29:27.644036 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:29:27.644009 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qb8vb\" (UniqueName: \"kubernetes.io/projected/7bddad45-e0c1-47e8-8a92-4fce721c04a3-kube-api-access-qb8vb\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:29:27.644142 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:29:27.644042 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7bddad45-e0c1-47e8-8a92-4fce721c04a3-extensions-socket-volume\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:29:27.766910 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:29:27.766878 2565 generic.go:356] "Generic (PLEG): container finished" podID="7bddad45-e0c1-47e8-8a92-4fce721c04a3" containerID="0bf331a019d04e32ce0ed9e6978596224a5c1b6792cdabf19d78a0e5591a445b" exitCode=0 Jul 13 07:29:27.767023 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:29:27.766921 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk" Jul 13 07:29:27.767023 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:29:27.766940 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk" event={"ID":"7bddad45-e0c1-47e8-8a92-4fce721c04a3","Type":"ContainerDied","Data":"0bf331a019d04e32ce0ed9e6978596224a5c1b6792cdabf19d78a0e5591a445b"} Jul 13 07:29:27.767023 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:29:27.766980 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk" event={"ID":"7bddad45-e0c1-47e8-8a92-4fce721c04a3","Type":"ContainerDied","Data":"a5b4fcbb50a40f23bf146e2c8a5e6fe0d82cabb3828353b7e39c6b9c05a29e34"} Jul 13 07:29:27.767023 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:29:27.767000 2565 scope.go:117] "RemoveContainer" containerID="0bf331a019d04e32ce0ed9e6978596224a5c1b6792cdabf19d78a0e5591a445b" Jul 13 07:29:27.776801 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:29:27.776785 2565 scope.go:117] "RemoveContainer" containerID="0bf331a019d04e32ce0ed9e6978596224a5c1b6792cdabf19d78a0e5591a445b" Jul 13 07:29:27.777086 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:29:27.777066 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bf331a019d04e32ce0ed9e6978596224a5c1b6792cdabf19d78a0e5591a445b\": container with ID starting with 0bf331a019d04e32ce0ed9e6978596224a5c1b6792cdabf19d78a0e5591a445b not found: ID does not exist" containerID="0bf331a019d04e32ce0ed9e6978596224a5c1b6792cdabf19d78a0e5591a445b" Jul 13 07:29:27.777180 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:29:27.777090 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bf331a019d04e32ce0ed9e6978596224a5c1b6792cdabf19d78a0e5591a445b"} err="failed to get container status \"0bf331a019d04e32ce0ed9e6978596224a5c1b6792cdabf19d78a0e5591a445b\": rpc error: code = NotFound desc = could not find container \"0bf331a019d04e32ce0ed9e6978596224a5c1b6792cdabf19d78a0e5591a445b\": container with ID starting with 0bf331a019d04e32ce0ed9e6978596224a5c1b6792cdabf19d78a0e5591a445b not found: ID does not exist" Jul 13 07:29:27.788408 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:29:27.788383 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk"] Jul 13 07:29:27.793059 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:29:27.793038 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nw8xk"] Jul 13 07:29:29.640519 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:29:29.640483 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bddad45-e0c1-47e8-8a92-4fce721c04a3" path="/var/lib/kubelet/pods/7bddad45-e0c1-47e8-8a92-4fce721c04a3/volumes" Jul 13 07:29:40.023591 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:29:40.023556 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:29:40.075610 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:29:40.075580 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:30:00.148682 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:00.148590 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29732130-n8b62"] Jul 13 07:30:00.149161 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:00.148967 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a39859ff-26ec-4717-951e-8830ea546da4" containerName="authorino" Jul 13 07:30:00.149161 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:00.148980 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a39859ff-26ec-4717-951e-8830ea546da4" containerName="authorino" Jul 13 07:30:00.149161 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:00.148998 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bddad45-e0c1-47e8-8a92-4fce721c04a3" containerName="manager" Jul 13 07:30:00.149161 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:00.149005 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bddad45-e0c1-47e8-8a92-4fce721c04a3" containerName="manager" Jul 13 07:30:00.149161 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:00.149063 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bddad45-e0c1-47e8-8a92-4fce721c04a3" containerName="manager" Jul 13 07:30:00.149161 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:00.149072 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a39859ff-26ec-4717-951e-8830ea546da4" containerName="authorino" Jul 13 07:30:00.152167 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:00.152151 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29732130-n8b62" Jul 13 07:30:00.154650 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:00.154628 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-svhmf\"" Jul 13 07:30:00.158619 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:00.158593 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29732130-n8b62"] Jul 13 07:30:00.286474 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:00.286439 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r5lf\" (UniqueName: \"kubernetes.io/projected/c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b-kube-api-access-7r5lf\") pod \"maas-api-key-cleanup-29732130-n8b62\" (UID: \"c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b\") " pod="opendatahub/maas-api-key-cleanup-29732130-n8b62" Jul 13 07:30:00.387545 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:00.387512 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r5lf\" (UniqueName: \"kubernetes.io/projected/c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b-kube-api-access-7r5lf\") pod \"maas-api-key-cleanup-29732130-n8b62\" (UID: \"c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b\") " pod="opendatahub/maas-api-key-cleanup-29732130-n8b62" Jul 13 07:30:00.396197 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:00.396171 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r5lf\" (UniqueName: \"kubernetes.io/projected/c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b-kube-api-access-7r5lf\") pod \"maas-api-key-cleanup-29732130-n8b62\" (UID: \"c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b\") " pod="opendatahub/maas-api-key-cleanup-29732130-n8b62" Jul 13 07:30:00.463922 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:00.463836 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29732130-n8b62" Jul 13 07:30:00.598200 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:00.598172 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29732130-n8b62"] Jul 13 07:30:00.600184 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:30:00.600149 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc87aa8c4_a2b2_456f_90bf_fd4b999dcd0b.slice/crio-17e6f7da5bab89a7c6d2481e4e57babbf23b4bb8dbd36b9b5273d7a59f6070e2 WatchSource:0}: Error finding container 17e6f7da5bab89a7c6d2481e4e57babbf23b4bb8dbd36b9b5273d7a59f6070e2: Status 404 returned error can't find the container with id 17e6f7da5bab89a7c6d2481e4e57babbf23b4bb8dbd36b9b5273d7a59f6070e2 Jul 13 07:30:00.602048 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:00.602031 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 13 07:30:00.942755 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:00.942698 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29732130-n8b62" event={"ID":"c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b","Type":"ContainerStarted","Data":"17e6f7da5bab89a7c6d2481e4e57babbf23b4bb8dbd36b9b5273d7a59f6070e2"} Jul 13 07:30:03.960791 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:03.960692 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29732130-n8b62" event={"ID":"c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b","Type":"ContainerStarted","Data":"43ff71d1e96c70dbce5bdb4b534f7ae827a6c31a8765ce3516dab4fb524ac47b"} Jul 13 07:30:03.977694 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:03.977646 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29732130-n8b62" podStartSLOduration=1.5115529479999998 podStartE2EDuration="3.977629005s" totalImagesPullingTime="2.466076057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:30:03.975122979 +0000 UTC m=+1080.897375152" watchObservedRunningTime="2026-07-13 07:30:03.977629005 +0000 UTC m=+1080.899881179" Jul 13 07:30:04.966678 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:04.966644 2565 generic.go:356] "Generic (PLEG): container finished" podID="c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b" containerID="43ff71d1e96c70dbce5bdb4b534f7ae827a6c31a8765ce3516dab4fb524ac47b" exitCode=0 Jul 13 07:30:04.967070 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:04.966744 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29732130-n8b62" event={"ID":"c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b","Type":"ContainerDied","Data":"43ff71d1e96c70dbce5bdb4b534f7ae827a6c31a8765ce3516dab4fb524ac47b"} Jul 13 07:30:06.096396 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:06.096372 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29732130-n8b62" Jul 13 07:30:06.141950 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:06.141928 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7r5lf\" (UniqueName: \"kubernetes.io/projected/c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b-kube-api-access-7r5lf\") pod \"c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b\" (UID: \"c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b\") " Jul 13 07:30:06.143957 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:06.143934 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b-kube-api-access-7r5lf" (OuterVolumeSpecName: "kube-api-access-7r5lf") pod "c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b" (UID: "c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b"). InnerVolumeSpecName "kube-api-access-7r5lf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:30:06.243307 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:06.243279 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7r5lf\" (UniqueName: \"kubernetes.io/projected/c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b-kube-api-access-7r5lf\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:30:06.977889 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:06.977859 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29732130-n8b62" Jul 13 07:30:06.978067 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:06.977886 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29732130-n8b62" event={"ID":"c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b","Type":"ContainerDied","Data":"17e6f7da5bab89a7c6d2481e4e57babbf23b4bb8dbd36b9b5273d7a59f6070e2"} Jul 13 07:30:06.978067 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:06.977931 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="17e6f7da5bab89a7c6d2481e4e57babbf23b4bb8dbd36b9b5273d7a59f6070e2" Jul 13 07:30:25.919583 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:25.919537 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7fs5"] Jul 13 07:30:25.920188 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:25.920167 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b" containerName="cleanup" Jul 13 07:30:25.920276 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:25.920206 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b" containerName="cleanup" Jul 13 07:30:25.920388 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:25.920374 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b" containerName="cleanup" Jul 13 07:30:25.926237 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:25.926212 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7fs5" Jul 13 07:30:25.929303 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:25.929283 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7dvk4\"" Jul 13 07:30:25.937034 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:25.937009 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7fs5"] Jul 13 07:30:26.006803 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:26.006762 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mhp8\" (UniqueName: \"kubernetes.io/projected/addab3d1-844d-4dbf-a20e-d00a653a741d-kube-api-access-9mhp8\") pod \"kuadrant-operator-controller-manager-86878c769f-l7fs5\" (UID: \"addab3d1-844d-4dbf-a20e-d00a653a741d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7fs5" Jul 13 07:30:26.006980 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:26.006875 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/addab3d1-844d-4dbf-a20e-d00a653a741d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l7fs5\" (UID: \"addab3d1-844d-4dbf-a20e-d00a653a741d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7fs5" Jul 13 07:30:26.107464 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:26.107423 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/addab3d1-844d-4dbf-a20e-d00a653a741d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l7fs5\" (UID: \"addab3d1-844d-4dbf-a20e-d00a653a741d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7fs5" Jul 13 07:30:26.107666 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:26.107500 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mhp8\" (UniqueName: \"kubernetes.io/projected/addab3d1-844d-4dbf-a20e-d00a653a741d-kube-api-access-9mhp8\") pod \"kuadrant-operator-controller-manager-86878c769f-l7fs5\" (UID: \"addab3d1-844d-4dbf-a20e-d00a653a741d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7fs5" Jul 13 07:30:26.107836 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:26.107809 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/addab3d1-844d-4dbf-a20e-d00a653a741d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l7fs5\" (UID: \"addab3d1-844d-4dbf-a20e-d00a653a741d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7fs5" Jul 13 07:30:26.121496 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:26.121466 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mhp8\" (UniqueName: \"kubernetes.io/projected/addab3d1-844d-4dbf-a20e-d00a653a741d-kube-api-access-9mhp8\") pod \"kuadrant-operator-controller-manager-86878c769f-l7fs5\" (UID: \"addab3d1-844d-4dbf-a20e-d00a653a741d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7fs5" Jul 13 07:30:26.236964 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:26.236934 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7fs5" Jul 13 07:30:26.381491 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:26.381463 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7fs5"] Jul 13 07:30:26.384456 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:30:26.384430 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaddab3d1_844d_4dbf_a20e_d00a653a741d.slice/crio-8fbc630351af99efdcf392d966367489fdd2f43928850c9cea37c4975f4bc70b WatchSource:0}: Error finding container 8fbc630351af99efdcf392d966367489fdd2f43928850c9cea37c4975f4bc70b: Status 404 returned error can't find the container with id 8fbc630351af99efdcf392d966367489fdd2f43928850c9cea37c4975f4bc70b Jul 13 07:30:27.086545 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:27.086507 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7fs5" event={"ID":"addab3d1-844d-4dbf-a20e-d00a653a741d","Type":"ContainerStarted","Data":"7fca1de2d3379cdd4f1f952a04b12574aba69cedaba71c8e6bcc29783aee10f8"} Jul 13 07:30:27.086931 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:27.086567 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7fs5" Jul 13 07:30:27.086931 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:27.086583 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7fs5" event={"ID":"addab3d1-844d-4dbf-a20e-d00a653a741d","Type":"ContainerStarted","Data":"8fbc630351af99efdcf392d966367489fdd2f43928850c9cea37c4975f4bc70b"} Jul 13 07:30:27.107284 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:27.107236 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7fs5" podStartSLOduration=2.107220704 podStartE2EDuration="2.107220704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:30:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:30:27.10494289 +0000 UTC m=+1104.027195066" watchObservedRunningTime="2026-07-13 07:30:27.107220704 +0000 UTC m=+1104.029472877" Jul 13 07:30:38.099462 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:30:38.099429 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l7fs5" Jul 13 07:31:13.775648 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:31:13.775598 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:31:13.841585 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:31:13.841548 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:33:57.543210 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:33:57.543179 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:33:58.858962 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:33:58.858923 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:34:34.938725 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:34:34.938624 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:17.774187 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:17.774125 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:17.879811 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:17.879774 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:18.179801 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:18.179707 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:24.233943 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.233904 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:24.334236 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.334202 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:24.414139 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.414116 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4"] Jul 13 07:36:24.417498 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.417482 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.420043 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.420020 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1300621c-openshift-default-dockercfg-5js6p\"" Jul 13 07:36:24.443737 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.443706 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4"] Jul 13 07:36:24.458809 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.458780 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:24.515280 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.515244 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-envoy\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.515437 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.515307 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k66w\" (UniqueName: \"kubernetes.io/projected/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-kube-api-access-7k66w\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.515437 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.515355 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-data\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.515437 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.515379 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-token\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.515437 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.515410 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-workload-certs\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.515675 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.515510 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-credential-socket\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.515675 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.515547 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istiod-ca-cert\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.515675 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.515607 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-workload-socket\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.515675 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.515631 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-podinfo\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.531995 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.531969 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:24.616586 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.616560 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-workload-socket\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.616586 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.616588 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-podinfo\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.616738 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.616626 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-envoy\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.616738 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.616657 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k66w\" (UniqueName: \"kubernetes.io/projected/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-kube-api-access-7k66w\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.616738 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.616674 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-data\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.616738 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.616693 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-token\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.616738 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.616713 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-workload-certs\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.616992 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.616744 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-credential-socket\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.616992 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.616769 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istiod-ca-cert\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.617110 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.617087 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-workload-certs\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.617194 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.617173 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-credential-socket\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.617252 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.617204 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-data\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.617297 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.617254 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-workload-socket\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.617433 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.617417 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istiod-ca-cert\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.618874 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.618851 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-envoy\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.619057 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.619039 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-podinfo\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.625712 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.625690 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-token\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.625968 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.625943 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k66w\" (UniqueName: \"kubernetes.io/projected/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-kube-api-access-7k66w\") pod \"e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.729449 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.729429 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:24.866792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.866763 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4"] Jul 13 07:36:24.867444 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:36:24.867414 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ec0f3b9_d3a4_4702_ae5e_d5df71c51207.slice/crio-3ffaa880f958e1de128bb82da56d86015fc7f5d9df7d1a0c8df480e86c563a1e WatchSource:0}: Error finding container 3ffaa880f958e1de128bb82da56d86015fc7f5d9df7d1a0c8df480e86c563a1e: Status 404 returned error can't find the container with id 3ffaa880f958e1de128bb82da56d86015fc7f5d9df7d1a0c8df480e86c563a1e Jul 13 07:36:24.870194 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.870156 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:36:24.870267 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.870246 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:36:24.870327 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.870286 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:36:24.979364 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.979306 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" event={"ID":"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207","Type":"ContainerStarted","Data":"a149d300603ac025ab877625a45b47c5cb6a9d19190e4fbb8adac5c9f310cab7"} Jul 13 07:36:24.979525 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:24.979373 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" event={"ID":"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207","Type":"ContainerStarted","Data":"3ffaa880f958e1de128bb82da56d86015fc7f5d9df7d1a0c8df480e86c563a1e"} Jul 13 07:36:25.002562 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:25.002508 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" podStartSLOduration=1.00249097 podStartE2EDuration="1.00249097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:36:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:36:24.99920958 +0000 UTC m=+1461.921461754" watchObservedRunningTime="2026-07-13 07:36:25.00249097 +0000 UTC m=+1461.924743198" Jul 13 07:36:25.574412 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:25.574382 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:25.676001 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:25.675973 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:25.730072 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:25.730045 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:25.734551 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:25.734530 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:25.748014 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:25.747994 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:25.947943 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:25.947866 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:25.984409 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:25.984381 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:25.985165 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:25.985149 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:26.255802 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:26.255756 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:26.355159 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:26.355134 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:28.361156 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:28.361122 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:30.625656 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:30.625626 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:30.775642 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:30.775611 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4"] Jul 13 07:36:30.775803 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:30.775782 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" podUID="8ec0f3b9-d3a4-4702-ae5e-d5df71c51207" containerName="istio-proxy" containerID="cri-o://a149d300603ac025ab877625a45b47c5cb6a9d19190e4fbb8adac5c9f310cab7" gracePeriod=30 Jul 13 07:36:30.799248 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:30.799218 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:30.910443 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:30.910364 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:31.073432 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:31.073403 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:32.654352 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:32.654311 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:36.021762 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.021741 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:36.040742 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.040682 2565 generic.go:356] "Generic (PLEG): container finished" podID="8ec0f3b9-d3a4-4702-ae5e-d5df71c51207" containerID="a149d300603ac025ab877625a45b47c5cb6a9d19190e4fbb8adac5c9f310cab7" exitCode=0 Jul 13 07:36:36.040742 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.040722 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" Jul 13 07:36:36.040882 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.040746 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" event={"ID":"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207","Type":"ContainerDied","Data":"a149d300603ac025ab877625a45b47c5cb6a9d19190e4fbb8adac5c9f310cab7"} Jul 13 07:36:36.040882 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.040786 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4" event={"ID":"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207","Type":"ContainerDied","Data":"3ffaa880f958e1de128bb82da56d86015fc7f5d9df7d1a0c8df480e86c563a1e"} Jul 13 07:36:36.040882 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.040813 2565 scope.go:117] "RemoveContainer" containerID="a149d300603ac025ab877625a45b47c5cb6a9d19190e4fbb8adac5c9f310cab7" Jul 13 07:36:36.052732 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.052712 2565 scope.go:117] "RemoveContainer" containerID="a149d300603ac025ab877625a45b47c5cb6a9d19190e4fbb8adac5c9f310cab7" Jul 13 07:36:36.052969 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:36:36.052950 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a149d300603ac025ab877625a45b47c5cb6a9d19190e4fbb8adac5c9f310cab7\": container with ID starting with a149d300603ac025ab877625a45b47c5cb6a9d19190e4fbb8adac5c9f310cab7 not found: ID does not exist" containerID="a149d300603ac025ab877625a45b47c5cb6a9d19190e4fbb8adac5c9f310cab7" Jul 13 07:36:36.053025 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.052977 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a149d300603ac025ab877625a45b47c5cb6a9d19190e4fbb8adac5c9f310cab7"} err="failed to get container status \"a149d300603ac025ab877625a45b47c5cb6a9d19190e4fbb8adac5c9f310cab7\": rpc error: code = NotFound desc = could not find container \"a149d300603ac025ab877625a45b47c5cb6a9d19190e4fbb8adac5c9f310cab7\": container with ID starting with a149d300603ac025ab877625a45b47c5cb6a9d19190e4fbb8adac5c9f310cab7 not found: ID does not exist" Jul 13 07:36:36.104517 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.104490 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-token\") pod \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " Jul 13 07:36:36.104637 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.104530 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7k66w\" (UniqueName: \"kubernetes.io/projected/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-kube-api-access-7k66w\") pod \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " Jul 13 07:36:36.104637 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.104556 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-podinfo\") pod \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " Jul 13 07:36:36.104637 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.104583 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istiod-ca-cert\") pod \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " Jul 13 07:36:36.104637 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.104619 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-workload-certs\") pod \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " Jul 13 07:36:36.104904 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.104651 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-envoy\") pod \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " Jul 13 07:36:36.104904 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.104681 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-workload-socket\") pod \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " Jul 13 07:36:36.104904 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.104739 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-data\") pod \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " Jul 13 07:36:36.104904 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.104846 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-credential-socket\") pod \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\" (UID: \"8ec0f3b9-d3a4-4702-ae5e-d5df71c51207\") " Jul 13 07:36:36.105099 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.104903 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8ec0f3b9-d3a4-4702-ae5e-d5df71c51207" (UID: "8ec0f3b9-d3a4-4702-ae5e-d5df71c51207"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:36:36.105099 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.104961 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8ec0f3b9-d3a4-4702-ae5e-d5df71c51207" (UID: "8ec0f3b9-d3a4-4702-ae5e-d5df71c51207"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:36:36.105280 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.105062 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8ec0f3b9-d3a4-4702-ae5e-d5df71c51207" (UID: "8ec0f3b9-d3a4-4702-ae5e-d5df71c51207"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:36:36.105280 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.105131 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-data" (OuterVolumeSpecName: "istio-data") pod "8ec0f3b9-d3a4-4702-ae5e-d5df71c51207" (UID: "8ec0f3b9-d3a4-4702-ae5e-d5df71c51207"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:36:36.105280 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.105205 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8ec0f3b9-d3a4-4702-ae5e-d5df71c51207" (UID: "8ec0f3b9-d3a4-4702-ae5e-d5df71c51207"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:36:36.105280 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.105217 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istiod-ca-cert\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:36:36.105280 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.105269 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-workload-certs\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:36:36.106578 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.106546 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-token" (OuterVolumeSpecName: "istio-token") pod "8ec0f3b9-d3a4-4702-ae5e-d5df71c51207" (UID: "8ec0f3b9-d3a4-4702-ae5e-d5df71c51207"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:36:36.106812 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.106789 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8ec0f3b9-d3a4-4702-ae5e-d5df71c51207" (UID: "8ec0f3b9-d3a4-4702-ae5e-d5df71c51207"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:36:36.107112 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.107090 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8ec0f3b9-d3a4-4702-ae5e-d5df71c51207" (UID: "8ec0f3b9-d3a4-4702-ae5e-d5df71c51207"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 07:36:36.107112 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.107087 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-kube-api-access-7k66w" (OuterVolumeSpecName: "kube-api-access-7k66w") pod "8ec0f3b9-d3a4-4702-ae5e-d5df71c51207" (UID: "8ec0f3b9-d3a4-4702-ae5e-d5df71c51207"). InnerVolumeSpecName "kube-api-access-7k66w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:36:36.205858 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.205835 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7k66w\" (UniqueName: \"kubernetes.io/projected/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-kube-api-access-7k66w\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:36:36.205858 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.205856 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-podinfo\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:36:36.205989 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.205866 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-envoy\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:36:36.205989 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.205875 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-workload-socket\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:36:36.205989 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.205885 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-data\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:36:36.205989 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.205893 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-credential-socket\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:36:36.205989 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.205900 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207-istio-token\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:36:36.369606 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.369581 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4"] Jul 13 07:36:36.373524 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.373503 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1300621c-openshift-default-69cf4b86f5-5mnx4"] Jul 13 07:36:36.564663 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.564632 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:36.639789 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.639707 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:36.738257 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.738231 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s"] Jul 13 07:36:36.738614 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.738601 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ec0f3b9-d3a4-4702-ae5e-d5df71c51207" containerName="istio-proxy" Jul 13 07:36:36.738663 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.738617 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ec0f3b9-d3a4-4702-ae5e-d5df71c51207" containerName="istio-proxy" Jul 13 07:36:36.738717 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.738689 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ec0f3b9-d3a4-4702-ae5e-d5df71c51207" containerName="istio-proxy" Jul 13 07:36:36.747446 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.747416 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.751442 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.751375 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-377f9df1-openshift-default-dockercfg-c4pvh\"" Jul 13 07:36:36.753605 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.753582 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s"] Jul 13 07:36:36.778558 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.778535 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:36.810767 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.810737 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-istio-data\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.810889 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.810778 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-workload-socket\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.810889 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.810813 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-credential-socket\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.810889 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.810842 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bc4587e-2577-49ca-8f07-999644126269-istio-token\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.810889 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.810869 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-workload-certs\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.811048 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.810993 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bc4587e-2577-49ca-8f07-999644126269-istiod-ca-cert\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.811048 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.811023 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-istio-envoy\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.811048 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.811041 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7k2h\" (UniqueName: \"kubernetes.io/projected/5bc4587e-2577-49ca-8f07-999644126269-kube-api-access-c7k2h\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.811179 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.811060 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bc4587e-2577-49ca-8f07-999644126269-istio-podinfo\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.879002 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.878975 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:36.912370 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.912287 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-istio-envoy\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.912370 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.912352 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7k2h\" (UniqueName: \"kubernetes.io/projected/5bc4587e-2577-49ca-8f07-999644126269-kube-api-access-c7k2h\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.912535 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.912386 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bc4587e-2577-49ca-8f07-999644126269-istio-podinfo\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.912535 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.912452 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-istio-data\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.912535 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.912486 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-workload-socket\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.912535 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.912522 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-credential-socket\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.912735 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.912551 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bc4587e-2577-49ca-8f07-999644126269-istio-token\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.912735 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.912583 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-workload-certs\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.912735 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.912663 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bc4587e-2577-49ca-8f07-999644126269-istiod-ca-cert\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.912891 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.912851 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-istio-data\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.912948 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.912889 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-workload-socket\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.913008 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.912982 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-credential-socket\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.913065 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.913051 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-workload-certs\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.913358 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.913339 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bc4587e-2577-49ca-8f07-999644126269-istiod-ca-cert\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.915146 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.915125 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-istio-envoy\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.915293 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.915274 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bc4587e-2577-49ca-8f07-999644126269-istio-podinfo\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.921488 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.921465 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bc4587e-2577-49ca-8f07-999644126269-istio-token\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:36.921892 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:36.921875 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7k2h\" (UniqueName: \"kubernetes.io/projected/5bc4587e-2577-49ca-8f07-999644126269-kube-api-access-c7k2h\") pod \"e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:37.059214 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:37.059191 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:37.197977 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:37.197950 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s"] Jul 13 07:36:37.199790 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:36:37.199762 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bc4587e_2577_49ca_8f07_999644126269.slice/crio-2f88fa8bbdb1969f433961bc9f360ea723a3864e09ab4bc7541780bab7df6313 WatchSource:0}: Error finding container 2f88fa8bbdb1969f433961bc9f360ea723a3864e09ab4bc7541780bab7df6313: Status 404 returned error can't find the container with id 2f88fa8bbdb1969f433961bc9f360ea723a3864e09ab4bc7541780bab7df6313 Jul 13 07:36:37.202027 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:37.201991 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:36:37.202099 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:37.202079 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:36:37.202147 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:37.202131 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:36:37.640898 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:37.640864 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ec0f3b9-d3a4-4702-ae5e-d5df71c51207" path="/var/lib/kubelet/pods/8ec0f3b9-d3a4-4702-ae5e-d5df71c51207/volumes" Jul 13 07:36:37.959024 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:37.958935 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:38.055002 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:38.054971 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" event={"ID":"5bc4587e-2577-49ca-8f07-999644126269","Type":"ContainerStarted","Data":"f5eef45e78aae2740a1216ed2ee327249bd21d5a66e3161065b64c96b591002f"} Jul 13 07:36:38.055180 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:38.055026 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" event={"ID":"5bc4587e-2577-49ca-8f07-999644126269","Type":"ContainerStarted","Data":"2f88fa8bbdb1969f433961bc9f360ea723a3864e09ab4bc7541780bab7df6313"} Jul 13 07:36:38.060126 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:38.060102 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:38.064928 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:38.064905 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:38.069205 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:38.069183 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:38.090016 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:38.089963 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" podStartSLOduration=2.089950344 podStartE2EDuration="2.089950344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:36:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:36:38.0866523 +0000 UTC m=+1475.008904472" watchObservedRunningTime="2026-07-13 07:36:38.089950344 +0000 UTC m=+1475.012202518" Jul 13 07:36:38.155031 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:38.155002 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:38.271048 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:38.271015 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:38.524602 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:38.524516 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:38.896931 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:38.896848 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:38.994145 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:38.994118 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:39.060094 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:39.060068 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:39.061148 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:39.061118 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:40.030407 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:40.030362 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:42.924137 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:42.924093 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:43.258881 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:43.258849 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:48.934811 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:48.934779 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s"] Jul 13 07:36:48.935389 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:48.934986 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" podUID="5bc4587e-2577-49ca-8f07-999644126269" containerName="istio-proxy" containerID="cri-o://f5eef45e78aae2740a1216ed2ee327249bd21d5a66e3161065b64c96b591002f" gracePeriod=30 Jul 13 07:36:49.391243 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.391216 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:49.433296 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.433274 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bc4587e-2577-49ca-8f07-999644126269-istio-podinfo\") pod \"5bc4587e-2577-49ca-8f07-999644126269\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " Jul 13 07:36:49.433464 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.433396 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-istio-envoy\") pod \"5bc4587e-2577-49ca-8f07-999644126269\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " Jul 13 07:36:49.433464 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.433444 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-workload-socket\") pod \"5bc4587e-2577-49ca-8f07-999644126269\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " Jul 13 07:36:49.433661 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.433495 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bc4587e-2577-49ca-8f07-999644126269-istio-token\") pod \"5bc4587e-2577-49ca-8f07-999644126269\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " Jul 13 07:36:49.433661 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.433524 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bc4587e-2577-49ca-8f07-999644126269-istiod-ca-cert\") pod \"5bc4587e-2577-49ca-8f07-999644126269\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " Jul 13 07:36:49.433661 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.433607 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-istio-data\") pod \"5bc4587e-2577-49ca-8f07-999644126269\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " Jul 13 07:36:49.433661 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.433631 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-credential-socket\") pod \"5bc4587e-2577-49ca-8f07-999644126269\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " Jul 13 07:36:49.433661 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.433656 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-workload-certs\") pod \"5bc4587e-2577-49ca-8f07-999644126269\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " Jul 13 07:36:49.434011 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.433694 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7k2h\" (UniqueName: \"kubernetes.io/projected/5bc4587e-2577-49ca-8f07-999644126269-kube-api-access-c7k2h\") pod \"5bc4587e-2577-49ca-8f07-999644126269\" (UID: \"5bc4587e-2577-49ca-8f07-999644126269\") " Jul 13 07:36:49.434350 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.434300 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5bc4587e-2577-49ca-8f07-999644126269" (UID: "5bc4587e-2577-49ca-8f07-999644126269"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:36:49.434530 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.434508 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5bc4587e-2577-49ca-8f07-999644126269" (UID: "5bc4587e-2577-49ca-8f07-999644126269"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:36:49.434712 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.434679 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bc4587e-2577-49ca-8f07-999644126269-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5bc4587e-2577-49ca-8f07-999644126269" (UID: "5bc4587e-2577-49ca-8f07-999644126269"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:36:49.435467 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.435334 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-istio-data" (OuterVolumeSpecName: "istio-data") pod "5bc4587e-2577-49ca-8f07-999644126269" (UID: "5bc4587e-2577-49ca-8f07-999644126269"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:36:49.435467 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.435435 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5bc4587e-2577-49ca-8f07-999644126269" (UID: "5bc4587e-2577-49ca-8f07-999644126269"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:36:49.436158 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.436091 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5bc4587e-2577-49ca-8f07-999644126269" (UID: "5bc4587e-2577-49ca-8f07-999644126269"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:36:49.436417 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.436377 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5bc4587e-2577-49ca-8f07-999644126269-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5bc4587e-2577-49ca-8f07-999644126269" (UID: "5bc4587e-2577-49ca-8f07-999644126269"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 07:36:49.436417 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.436392 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bc4587e-2577-49ca-8f07-999644126269-kube-api-access-c7k2h" (OuterVolumeSpecName: "kube-api-access-c7k2h") pod "5bc4587e-2577-49ca-8f07-999644126269" (UID: "5bc4587e-2577-49ca-8f07-999644126269"). InnerVolumeSpecName "kube-api-access-c7k2h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:36:49.436719 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.436691 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bc4587e-2577-49ca-8f07-999644126269-istio-token" (OuterVolumeSpecName: "istio-token") pod "5bc4587e-2577-49ca-8f07-999644126269" (UID: "5bc4587e-2577-49ca-8f07-999644126269"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:36:49.534804 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.534778 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7k2h\" (UniqueName: \"kubernetes.io/projected/5bc4587e-2577-49ca-8f07-999644126269-kube-api-access-c7k2h\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:36:49.534901 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.534807 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5bc4587e-2577-49ca-8f07-999644126269-istio-podinfo\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:36:49.534901 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.534818 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-istio-envoy\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:36:49.534901 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.534827 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-workload-socket\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:36:49.534901 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.534835 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5bc4587e-2577-49ca-8f07-999644126269-istio-token\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:36:49.534901 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.534843 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5bc4587e-2577-49ca-8f07-999644126269-istiod-ca-cert\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:36:49.534901 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.534850 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-istio-data\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:36:49.534901 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.534858 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-credential-socket\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:36:49.534901 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.534865 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5bc4587e-2577-49ca-8f07-999644126269-workload-certs\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:36:49.639763 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.639732 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:49.741423 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:49.741398 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:50.124916 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:50.124847 2565 generic.go:356] "Generic (PLEG): container finished" podID="5bc4587e-2577-49ca-8f07-999644126269" containerID="f5eef45e78aae2740a1216ed2ee327249bd21d5a66e3161065b64c96b591002f" exitCode=0 Jul 13 07:36:50.124916 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:50.124888 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" Jul 13 07:36:50.124916 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:50.124904 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" event={"ID":"5bc4587e-2577-49ca-8f07-999644126269","Type":"ContainerDied","Data":"f5eef45e78aae2740a1216ed2ee327249bd21d5a66e3161065b64c96b591002f"} Jul 13 07:36:50.125444 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:50.124945 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s" event={"ID":"5bc4587e-2577-49ca-8f07-999644126269","Type":"ContainerDied","Data":"2f88fa8bbdb1969f433961bc9f360ea723a3864e09ab4bc7541780bab7df6313"} Jul 13 07:36:50.125444 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:50.124967 2565 scope.go:117] "RemoveContainer" containerID="f5eef45e78aae2740a1216ed2ee327249bd21d5a66e3161065b64c96b591002f" Jul 13 07:36:50.133969 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:50.133953 2565 scope.go:117] "RemoveContainer" containerID="f5eef45e78aae2740a1216ed2ee327249bd21d5a66e3161065b64c96b591002f" Jul 13 07:36:50.134244 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:36:50.134224 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5eef45e78aae2740a1216ed2ee327249bd21d5a66e3161065b64c96b591002f\": container with ID starting with f5eef45e78aae2740a1216ed2ee327249bd21d5a66e3161065b64c96b591002f not found: ID does not exist" containerID="f5eef45e78aae2740a1216ed2ee327249bd21d5a66e3161065b64c96b591002f" Jul 13 07:36:50.134299 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:50.134253 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5eef45e78aae2740a1216ed2ee327249bd21d5a66e3161065b64c96b591002f"} err="failed to get container status \"f5eef45e78aae2740a1216ed2ee327249bd21d5a66e3161065b64c96b591002f\": rpc error: code = NotFound desc = could not find container \"f5eef45e78aae2740a1216ed2ee327249bd21d5a66e3161065b64c96b591002f\": container with ID starting with f5eef45e78aae2740a1216ed2ee327249bd21d5a66e3161065b64c96b591002f not found: ID does not exist" Jul 13 07:36:50.145248 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:50.145228 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s"] Jul 13 07:36:50.150844 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:50.150826 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-377f9df1-openshift-default-57cd7dc869-pwh4s"] Jul 13 07:36:51.002932 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:51.002871 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:51.639173 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:51.639143 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bc4587e-2577-49ca-8f07-999644126269" path="/var/lib/kubelet/pods/5bc4587e-2577-49ca-8f07-999644126269/volumes" Jul 13 07:36:54.954337 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:54.954286 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:55.062815 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.062784 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:55.145545 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.145518 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz"] Jul 13 07:36:55.145959 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.145942 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bc4587e-2577-49ca-8f07-999644126269" containerName="istio-proxy" Jul 13 07:36:55.146059 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.145962 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bc4587e-2577-49ca-8f07-999644126269" containerName="istio-proxy" Jul 13 07:36:55.146059 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.146048 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bc4587e-2577-49ca-8f07-999644126269" containerName="istio-proxy" Jul 13 07:36:55.149585 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.149563 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.152581 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.152555 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-1d9f2735-openshift-default-dockercfg-k4dpl\"" Jul 13 07:36:55.163585 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.163460 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz"] Jul 13 07:36:55.201588 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.201566 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:55.281209 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.281176 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-podinfo\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.281400 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.281211 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-credential-socket\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.281400 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.281245 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43514414-e2f7-442b-825c-bff0a0d19ce2-istiod-ca-cert\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.281400 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.281283 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-token\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.281400 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.281343 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-workload-certs\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.281400 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.281367 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-envoy\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.281586 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.281406 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-data\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.281586 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.281464 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-workload-socket\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.281586 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.281497 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khl8p\" (UniqueName: \"kubernetes.io/projected/43514414-e2f7-442b-825c-bff0a0d19ce2-kube-api-access-khl8p\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.332818 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.332798 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:55.381900 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.381873 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khl8p\" (UniqueName: \"kubernetes.io/projected/43514414-e2f7-442b-825c-bff0a0d19ce2-kube-api-access-khl8p\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.381994 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.381919 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-podinfo\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.381994 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.381939 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-credential-socket\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.381994 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.381979 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43514414-e2f7-442b-825c-bff0a0d19ce2-istiod-ca-cert\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.382142 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.381999 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-token\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.382142 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.382041 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-workload-certs\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.382142 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.382063 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-envoy\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.382380 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.382143 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-data\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.382380 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.382213 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-workload-socket\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.382494 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.382468 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-credential-socket\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.382551 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.382536 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-workload-certs\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.382608 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.382592 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-workload-socket\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.382727 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.382703 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-data\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.382850 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.382832 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43514414-e2f7-442b-825c-bff0a0d19ce2-istiod-ca-cert\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.384229 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.384205 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-envoy\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.384401 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.384384 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-podinfo\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.389715 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.389693 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khl8p\" (UniqueName: \"kubernetes.io/projected/43514414-e2f7-442b-825c-bff0a0d19ce2-kube-api-access-khl8p\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.389939 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.389921 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-token\") pod \"e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.460843 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.460822 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:55.593703 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.593677 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz"] Jul 13 07:36:55.595641 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:36:55.595613 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43514414_e2f7_442b_825c_bff0a0d19ce2.slice/crio-e7926c495630f9beaebdb2ee7d8490bf367c71e5f259971306376c0ec8a76853 WatchSource:0}: Error finding container e7926c495630f9beaebdb2ee7d8490bf367c71e5f259971306376c0ec8a76853: Status 404 returned error can't find the container with id e7926c495630f9beaebdb2ee7d8490bf367c71e5f259971306376c0ec8a76853 Jul 13 07:36:55.597689 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.597661 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:36:55.597768 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.597728 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:36:55.597768 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:55.597759 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:36:56.163093 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:56.163050 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" event={"ID":"43514414-e2f7-442b-825c-bff0a0d19ce2","Type":"ContainerStarted","Data":"ee89637dea2b1a4b3a574062a852fa0b2307ef7c7b0eea297d8aa104452e8f5f"} Jul 13 07:36:56.163485 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:56.163111 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" event={"ID":"43514414-e2f7-442b-825c-bff0a0d19ce2","Type":"ContainerStarted","Data":"e7926c495630f9beaebdb2ee7d8490bf367c71e5f259971306376c0ec8a76853"} Jul 13 07:36:56.187145 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:56.187101 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" podStartSLOduration=1.187086997 podStartE2EDuration="1.187086997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:36:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:36:56.18415843 +0000 UTC m=+1493.106410603" watchObservedRunningTime="2026-07-13 07:36:56.187086997 +0000 UTC m=+1493.109339169" Jul 13 07:36:56.350200 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:56.350172 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:56.432738 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:56.432655 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:56.461369 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:56.461309 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:56.466287 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:56.466263 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:56.522765 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:56.522679 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:56.706449 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:56.706349 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:57.055234 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:57.055204 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:57.156730 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:57.156693 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:36:57.169169 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:57.169146 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:57.170111 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:57.170094 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:36:58.684518 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:36:58.684450 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:37:00.727280 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:00.727243 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:37:00.925325 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:00.925283 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz"] Jul 13 07:37:00.925500 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:00.925461 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" podUID="43514414-e2f7-442b-825c-bff0a0d19ce2" containerName="istio-proxy" containerID="cri-o://ee89637dea2b1a4b3a574062a852fa0b2307ef7c7b0eea297d8aa104452e8f5f" gracePeriod=30 Jul 13 07:37:00.951428 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:00.951399 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:37:01.049067 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:01.049038 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:37:01.183844 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:01.183810 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:37:04.844482 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:04.844450 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:37:06.182830 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.182806 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:37:06.219137 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.219070 2565 generic.go:356] "Generic (PLEG): container finished" podID="43514414-e2f7-442b-825c-bff0a0d19ce2" containerID="ee89637dea2b1a4b3a574062a852fa0b2307ef7c7b0eea297d8aa104452e8f5f" exitCode=0 Jul 13 07:37:06.219137 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.219100 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" Jul 13 07:37:06.219274 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.219148 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" event={"ID":"43514414-e2f7-442b-825c-bff0a0d19ce2","Type":"ContainerDied","Data":"ee89637dea2b1a4b3a574062a852fa0b2307ef7c7b0eea297d8aa104452e8f5f"} Jul 13 07:37:06.219274 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.219197 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz" event={"ID":"43514414-e2f7-442b-825c-bff0a0d19ce2","Type":"ContainerDied","Data":"e7926c495630f9beaebdb2ee7d8490bf367c71e5f259971306376c0ec8a76853"} Jul 13 07:37:06.219274 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.219222 2565 scope.go:117] "RemoveContainer" containerID="ee89637dea2b1a4b3a574062a852fa0b2307ef7c7b0eea297d8aa104452e8f5f" Jul 13 07:37:06.228073 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.228057 2565 scope.go:117] "RemoveContainer" containerID="ee89637dea2b1a4b3a574062a852fa0b2307ef7c7b0eea297d8aa104452e8f5f" Jul 13 07:37:06.228359 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:37:06.228338 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee89637dea2b1a4b3a574062a852fa0b2307ef7c7b0eea297d8aa104452e8f5f\": container with ID starting with ee89637dea2b1a4b3a574062a852fa0b2307ef7c7b0eea297d8aa104452e8f5f not found: ID does not exist" containerID="ee89637dea2b1a4b3a574062a852fa0b2307ef7c7b0eea297d8aa104452e8f5f" Jul 13 07:37:06.228453 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.228365 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee89637dea2b1a4b3a574062a852fa0b2307ef7c7b0eea297d8aa104452e8f5f"} err="failed to get container status \"ee89637dea2b1a4b3a574062a852fa0b2307ef7c7b0eea297d8aa104452e8f5f\": rpc error: code = NotFound desc = could not find container \"ee89637dea2b1a4b3a574062a852fa0b2307ef7c7b0eea297d8aa104452e8f5f\": container with ID starting with ee89637dea2b1a4b3a574062a852fa0b2307ef7c7b0eea297d8aa104452e8f5f not found: ID does not exist" Jul 13 07:37:06.271422 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.271391 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-podinfo\") pod \"43514414-e2f7-442b-825c-bff0a0d19ce2\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " Jul 13 07:37:06.271526 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.271432 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-credential-socket\") pod \"43514414-e2f7-442b-825c-bff0a0d19ce2\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " Jul 13 07:37:06.271526 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.271471 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-workload-socket\") pod \"43514414-e2f7-442b-825c-bff0a0d19ce2\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " Jul 13 07:37:06.271526 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.271498 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-workload-certs\") pod \"43514414-e2f7-442b-825c-bff0a0d19ce2\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " Jul 13 07:37:06.271686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.271543 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khl8p\" (UniqueName: \"kubernetes.io/projected/43514414-e2f7-442b-825c-bff0a0d19ce2-kube-api-access-khl8p\") pod \"43514414-e2f7-442b-825c-bff0a0d19ce2\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " Jul 13 07:37:06.271686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.271572 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-data\") pod \"43514414-e2f7-442b-825c-bff0a0d19ce2\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " Jul 13 07:37:06.271686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.271622 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-token\") pod \"43514414-e2f7-442b-825c-bff0a0d19ce2\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " Jul 13 07:37:06.271686 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.271650 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-envoy\") pod \"43514414-e2f7-442b-825c-bff0a0d19ce2\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " Jul 13 07:37:06.271893 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.271738 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43514414-e2f7-442b-825c-bff0a0d19ce2-istiod-ca-cert\") pod \"43514414-e2f7-442b-825c-bff0a0d19ce2\" (UID: \"43514414-e2f7-442b-825c-bff0a0d19ce2\") " Jul 13 07:37:06.271893 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.271757 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "43514414-e2f7-442b-825c-bff0a0d19ce2" (UID: "43514414-e2f7-442b-825c-bff0a0d19ce2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:37:06.271893 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.271783 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "43514414-e2f7-442b-825c-bff0a0d19ce2" (UID: "43514414-e2f7-442b-825c-bff0a0d19ce2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:37:06.272046 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.272005 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-workload-socket\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:37:06.272046 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.272023 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-workload-certs\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:37:06.272365 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.272311 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43514414-e2f7-442b-825c-bff0a0d19ce2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "43514414-e2f7-442b-825c-bff0a0d19ce2" (UID: "43514414-e2f7-442b-825c-bff0a0d19ce2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:37:06.272491 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.272463 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "43514414-e2f7-442b-825c-bff0a0d19ce2" (UID: "43514414-e2f7-442b-825c-bff0a0d19ce2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:37:06.272710 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.272678 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-data" (OuterVolumeSpecName: "istio-data") pod "43514414-e2f7-442b-825c-bff0a0d19ce2" (UID: "43514414-e2f7-442b-825c-bff0a0d19ce2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:37:06.273696 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.273673 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "43514414-e2f7-442b-825c-bff0a0d19ce2" (UID: "43514414-e2f7-442b-825c-bff0a0d19ce2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 07:37:06.273950 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.273934 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "43514414-e2f7-442b-825c-bff0a0d19ce2" (UID: "43514414-e2f7-442b-825c-bff0a0d19ce2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:37:06.274160 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.274140 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43514414-e2f7-442b-825c-bff0a0d19ce2-kube-api-access-khl8p" (OuterVolumeSpecName: "kube-api-access-khl8p") pod "43514414-e2f7-442b-825c-bff0a0d19ce2" (UID: "43514414-e2f7-442b-825c-bff0a0d19ce2"). InnerVolumeSpecName "kube-api-access-khl8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:37:06.274215 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.274165 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-token" (OuterVolumeSpecName: "istio-token") pod "43514414-e2f7-442b-825c-bff0a0d19ce2" (UID: "43514414-e2f7-442b-825c-bff0a0d19ce2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:37:06.372753 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.372735 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-token\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:37:06.372753 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.372754 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-envoy\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:37:06.372897 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.372764 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43514414-e2f7-442b-825c-bff0a0d19ce2-istiod-ca-cert\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:37:06.372897 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.372773 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-podinfo\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:37:06.372897 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.372781 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-credential-socket\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:37:06.372897 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.372791 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khl8p\" (UniqueName: \"kubernetes.io/projected/43514414-e2f7-442b-825c-bff0a0d19ce2-kube-api-access-khl8p\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:37:06.372897 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.372801 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43514414-e2f7-442b-825c-bff0a0d19ce2-istio-data\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:37:06.542964 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.542938 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz"] Jul 13 07:37:06.548934 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:06.548909 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-1d9f2735-openshift-default-79dc9f6487-qdhhz"] Jul 13 07:37:07.088691 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:07.088661 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:37:07.189025 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:07.188995 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:37:07.555053 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:07.555024 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:37:07.640523 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:07.640498 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43514414-e2f7-442b-825c-bff0a0d19ce2" path="/var/lib/kubelet/pods/43514414-e2f7-442b-825c-bff0a0d19ce2/volumes" Jul 13 07:37:07.643532 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:07.643509 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:37:07.743514 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:07.743485 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:37:09.108560 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:09.108530 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:37:15.003144 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:15.003111 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:37:15.063278 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:15.063252 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:37:15.134804 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:15.134777 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:37:15.235552 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:15.235529 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:37:15.334841 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:15.334769 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:37:15.658753 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:15.658686 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:37:41.583232 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:41.583160 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:37:48.067277 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:48.067243 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:37:48.151949 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:48.151908 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:37:48.268841 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:37:48.268809 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:04.117512 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:04.117476 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:09.849535 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:09.849497 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:09.925346 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:09.925300 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:09.996059 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:09.996027 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:20.532657 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:20.532628 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:21.355474 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:21.355443 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:26.375644 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:26.375610 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:26.434027 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:26.433991 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:27.359830 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:27.359782 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:27.475933 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:27.475883 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:27.560215 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:27.560170 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:27.664893 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:27.664782 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:28.412936 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:28.412905 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:28.549377 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:28.549349 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:30.111346 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:30.111285 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:35.907141 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:35.907097 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:36.007939 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:36.007888 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:36.556389 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:36.556345 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:42.550137 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:42.550101 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:42.619077 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:42.619044 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:42.780620 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:42.780583 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:43.049236 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.049199 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg"] Jul 13 07:38:43.049830 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.049814 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43514414-e2f7-442b-825c-bff0a0d19ce2" containerName="istio-proxy" Jul 13 07:38:43.049882 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.049833 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="43514414-e2f7-442b-825c-bff0a0d19ce2" containerName="istio-proxy" Jul 13 07:38:43.049932 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.049921 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="43514414-e2f7-442b-825c-bff0a0d19ce2" containerName="istio-proxy" Jul 13 07:38:43.053374 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.053353 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.056247 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.056226 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f7d6162d-openshift-default-dockercfg-qmh49\"" Jul 13 07:38:43.074822 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.074798 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg"] Jul 13 07:38:43.076552 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.076526 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:43.087643 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.087612 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txvrl\" (UniqueName: \"kubernetes.io/projected/65f96760-3277-4e9d-9e30-069f7641687e-kube-api-access-txvrl\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.087753 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.087656 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65f96760-3277-4e9d-9e30-069f7641687e-istio-token\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.087753 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.087716 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-workload-socket\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.087753 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.087741 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-credential-socket\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.087896 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.087761 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-istio-data\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.087896 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.087845 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65f96760-3277-4e9d-9e30-069f7641687e-istiod-ca-cert\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.087974 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.087902 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65f96760-3277-4e9d-9e30-069f7641687e-istio-podinfo\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.087974 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.087964 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-workload-certs\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.088051 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.087992 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-istio-envoy\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.172405 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.172363 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:43.188822 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.188787 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-workload-socket\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.188982 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.188825 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-credential-socket\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.188982 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.188846 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-istio-data\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.188982 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.188878 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65f96760-3277-4e9d-9e30-069f7641687e-istiod-ca-cert\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.188982 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.188914 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65f96760-3277-4e9d-9e30-069f7641687e-istio-podinfo\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.189189 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.189163 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-workload-socket\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.189242 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.189209 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-workload-certs\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.189242 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.189223 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-credential-socket\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.189396 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.189243 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-istio-envoy\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.189396 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.189296 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txvrl\" (UniqueName: \"kubernetes.io/projected/65f96760-3277-4e9d-9e30-069f7641687e-kube-api-access-txvrl\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.189396 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.189306 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-istio-data\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.189396 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.189356 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65f96760-3277-4e9d-9e30-069f7641687e-istio-token\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.189589 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.189508 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-workload-certs\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.189694 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.189670 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65f96760-3277-4e9d-9e30-069f7641687e-istiod-ca-cert\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.191457 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.191435 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-istio-envoy\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.191573 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.191544 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65f96760-3277-4e9d-9e30-069f7641687e-istio-podinfo\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.197699 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.197672 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65f96760-3277-4e9d-9e30-069f7641687e-istio-token\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.198126 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.198103 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txvrl\" (UniqueName: \"kubernetes.io/projected/65f96760-3277-4e9d-9e30-069f7641687e-kube-api-access-txvrl\") pod \"e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.365337 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.365233 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:43.508835 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.508805 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg"] Jul 13 07:38:43.510410 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:38:43.510383 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65f96760_3277_4e9d_9e30_069f7641687e.slice/crio-a4afca780976defa6aa26f3a9fa5c6ad018e3897380ef6ef6d7db354ebd8bc48 WatchSource:0}: Error finding container a4afca780976defa6aa26f3a9fa5c6ad018e3897380ef6ef6d7db354ebd8bc48: Status 404 returned error can't find the container with id a4afca780976defa6aa26f3a9fa5c6ad018e3897380ef6ef6d7db354ebd8bc48 Jul 13 07:38:43.512614 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.512586 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:38:43.512695 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.512645 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:38:43.512695 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.512675 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:38:43.737669 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.737630 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" event={"ID":"65f96760-3277-4e9d-9e30-069f7641687e","Type":"ContainerStarted","Data":"288cd99ccc048e7391a14eace357b8e7455c3de19d9d06043591184cbd7a3c04"} Jul 13 07:38:43.738073 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.737700 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" event={"ID":"65f96760-3277-4e9d-9e30-069f7641687e","Type":"ContainerStarted","Data":"a4afca780976defa6aa26f3a9fa5c6ad018e3897380ef6ef6d7db354ebd8bc48"} Jul 13 07:38:43.766406 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:43.766349 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" podStartSLOduration=0.766309636 podStartE2EDuration="766.309636ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:38:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:38:43.763867403 +0000 UTC m=+1600.686119577" watchObservedRunningTime="2026-07-13 07:38:43.766309636 +0000 UTC m=+1600.688561810" Jul 13 07:38:44.365980 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:44.365944 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:44.370738 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:44.370714 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:44.747847 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:44.747814 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:44.748760 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:44.748745 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:38:45.741127 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:45.741093 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:45.822223 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:45.822139 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:45.906489 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:45.906451 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:46.004667 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:46.004537 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:46.289015 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:46.288896 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:46.386437 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:46.386403 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:50.226558 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:50.226511 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:50.862984 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:50.862906 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:50.954261 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:50.954226 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:51.275371 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:51.275308 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:57.092452 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:57.092372 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:57.192981 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:57.192944 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:57.493989 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:57.493951 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:57.855081 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:57.854995 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:38:57.914038 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:38:57.914004 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:39:00.432146 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:00.432102 2565 patch_prober.go:28] interesting pod/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": read tcp 10.133.0.2:57522->10.133.0.56:15021: read: connection reset by peer" start-of-body= Jul 13 07:39:00.432583 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:00.432185 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" podUID="65f96760-3277-4e9d-9e30-069f7641687e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": read tcp 10.133.0.2:57522->10.133.0.56:15021: read: connection reset by peer" Jul 13 07:39:00.833956 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:00.833926 2565 generic.go:356] "Generic (PLEG): container finished" podID="65f96760-3277-4e9d-9e30-069f7641687e" containerID="288cd99ccc048e7391a14eace357b8e7455c3de19d9d06043591184cbd7a3c04" exitCode=0 Jul 13 07:39:00.834100 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:00.833998 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" event={"ID":"65f96760-3277-4e9d-9e30-069f7641687e","Type":"ContainerDied","Data":"288cd99ccc048e7391a14eace357b8e7455c3de19d9d06043591184cbd7a3c04"} Jul 13 07:39:00.834395 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:00.834378 2565 scope.go:117] "RemoveContainer" containerID="288cd99ccc048e7391a14eace357b8e7455c3de19d9d06043591184cbd7a3c04" Jul 13 07:39:00.835350 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:00.835308 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:39:00.835407 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:00.835394 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:39:00.835444 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:00.835434 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:39:01.840801 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:01.840769 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" event={"ID":"65f96760-3277-4e9d-9e30-069f7641687e","Type":"ContainerStarted","Data":"c72f4dd2a6becb14d9b044031297bcdacc4470e524cf4707a3ec606003850355"} Jul 13 07:39:02.366351 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:02.366228 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:39:02.366707 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:02.366672 2565 patch_prober.go:28] interesting pod/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 13 07:39:02.366911 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:02.366885 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" podUID="65f96760-3277-4e9d-9e30-069f7641687e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 13 07:39:03.367253 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:03.367210 2565 patch_prober.go:28] interesting pod/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body= Jul 13 07:39:03.367760 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:03.367274 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" podUID="65f96760-3277-4e9d-9e30-069f7641687e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" Jul 13 07:39:03.876421 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:03.876346 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:39:04.286226 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:04.286191 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg"] Jul 13 07:39:04.287230 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:04.286983 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" podUID="65f96760-3277-4e9d-9e30-069f7641687e" containerName="istio-proxy" containerID="cri-o://c72f4dd2a6becb14d9b044031297bcdacc4470e524cf4707a3ec606003850355" gracePeriod=30 Jul 13 07:39:04.969715 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:04.969674 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:39:05.264841 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:05.264731 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:39:10.895258 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.895227 2565 generic.go:356] "Generic (PLEG): container finished" podID="65f96760-3277-4e9d-9e30-069f7641687e" containerID="c72f4dd2a6becb14d9b044031297bcdacc4470e524cf4707a3ec606003850355" exitCode=0 Jul 13 07:39:10.895693 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.895268 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" event={"ID":"65f96760-3277-4e9d-9e30-069f7641687e","Type":"ContainerDied","Data":"c72f4dd2a6becb14d9b044031297bcdacc4470e524cf4707a3ec606003850355"} Jul 13 07:39:10.895693 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.895382 2565 scope.go:117] "RemoveContainer" containerID="288cd99ccc048e7391a14eace357b8e7455c3de19d9d06043591184cbd7a3c04" Jul 13 07:39:10.948461 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.948439 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:39:10.959363 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.959344 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65f96760-3277-4e9d-9e30-069f7641687e-istiod-ca-cert\") pod \"65f96760-3277-4e9d-9e30-069f7641687e\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " Jul 13 07:39:10.959448 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.959379 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txvrl\" (UniqueName: \"kubernetes.io/projected/65f96760-3277-4e9d-9e30-069f7641687e-kube-api-access-txvrl\") pod \"65f96760-3277-4e9d-9e30-069f7641687e\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " Jul 13 07:39:10.959448 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.959398 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65f96760-3277-4e9d-9e30-069f7641687e-istio-token\") pod \"65f96760-3277-4e9d-9e30-069f7641687e\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " Jul 13 07:39:10.959448 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.959429 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-istio-data\") pod \"65f96760-3277-4e9d-9e30-069f7641687e\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " Jul 13 07:39:10.959602 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.959464 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65f96760-3277-4e9d-9e30-069f7641687e-istio-podinfo\") pod \"65f96760-3277-4e9d-9e30-069f7641687e\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " Jul 13 07:39:10.959602 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.959507 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-istio-envoy\") pod \"65f96760-3277-4e9d-9e30-069f7641687e\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " Jul 13 07:39:10.959602 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.959555 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-workload-socket\") pod \"65f96760-3277-4e9d-9e30-069f7641687e\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " Jul 13 07:39:10.959602 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.959580 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-credential-socket\") pod \"65f96760-3277-4e9d-9e30-069f7641687e\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " Jul 13 07:39:10.959811 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.959608 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-workload-certs\") pod \"65f96760-3277-4e9d-9e30-069f7641687e\" (UID: \"65f96760-3277-4e9d-9e30-069f7641687e\") " Jul 13 07:39:10.959811 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.959697 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65f96760-3277-4e9d-9e30-069f7641687e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "65f96760-3277-4e9d-9e30-069f7641687e" (UID: "65f96760-3277-4e9d-9e30-069f7641687e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:39:10.959919 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.959851 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "65f96760-3277-4e9d-9e30-069f7641687e" (UID: "65f96760-3277-4e9d-9e30-069f7641687e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:39:10.959972 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.959932 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "65f96760-3277-4e9d-9e30-069f7641687e" (UID: "65f96760-3277-4e9d-9e30-069f7641687e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:39:10.960085 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.960044 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "65f96760-3277-4e9d-9e30-069f7641687e" (UID: "65f96760-3277-4e9d-9e30-069f7641687e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:39:10.960142 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.960098 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-workload-socket\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:39:10.960142 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.960116 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-workload-certs\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:39:10.960142 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.960132 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65f96760-3277-4e9d-9e30-069f7641687e-istiod-ca-cert\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:39:10.960445 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.960421 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-istio-data" (OuterVolumeSpecName: "istio-data") pod "65f96760-3277-4e9d-9e30-069f7641687e" (UID: "65f96760-3277-4e9d-9e30-069f7641687e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:39:10.961719 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.961685 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/65f96760-3277-4e9d-9e30-069f7641687e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "65f96760-3277-4e9d-9e30-069f7641687e" (UID: "65f96760-3277-4e9d-9e30-069f7641687e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 07:39:10.961829 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.961796 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "65f96760-3277-4e9d-9e30-069f7641687e" (UID: "65f96760-3277-4e9d-9e30-069f7641687e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:39:10.961910 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.961890 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65f96760-3277-4e9d-9e30-069f7641687e-kube-api-access-txvrl" (OuterVolumeSpecName: "kube-api-access-txvrl") pod "65f96760-3277-4e9d-9e30-069f7641687e" (UID: "65f96760-3277-4e9d-9e30-069f7641687e"). InnerVolumeSpecName "kube-api-access-txvrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:39:10.961971 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:10.961917 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65f96760-3277-4e9d-9e30-069f7641687e-istio-token" (OuterVolumeSpecName: "istio-token") pod "65f96760-3277-4e9d-9e30-069f7641687e" (UID: "65f96760-3277-4e9d-9e30-069f7641687e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:39:11.060665 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:11.060596 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txvrl\" (UniqueName: \"kubernetes.io/projected/65f96760-3277-4e9d-9e30-069f7641687e-kube-api-access-txvrl\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:39:11.060665 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:11.060628 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65f96760-3277-4e9d-9e30-069f7641687e-istio-token\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:39:11.060665 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:11.060642 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-istio-data\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:39:11.060665 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:11.060656 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65f96760-3277-4e9d-9e30-069f7641687e-istio-podinfo\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:39:11.060873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:11.060670 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-istio-envoy\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:39:11.060873 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:11.060684 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f96760-3277-4e9d-9e30-069f7641687e-credential-socket\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:39:11.195761 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:11.195726 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:39:11.301791 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:11.301761 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:39:11.434310 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:11.434231 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:39:11.570797 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:11.570762 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:39:11.901265 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:11.901236 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" Jul 13 07:39:11.901694 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:11.901262 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg" event={"ID":"65f96760-3277-4e9d-9e30-069f7641687e","Type":"ContainerDied","Data":"a4afca780976defa6aa26f3a9fa5c6ad018e3897380ef6ef6d7db354ebd8bc48"} Jul 13 07:39:11.901694 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:11.901336 2565 scope.go:117] "RemoveContainer" containerID="c72f4dd2a6becb14d9b044031297bcdacc4470e524cf4707a3ec606003850355" Jul 13 07:39:11.936416 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:11.936390 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg"] Jul 13 07:39:11.944835 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:11.944816 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f7d6162d-openshift-default-6fb84b55c9-76jwg"] Jul 13 07:39:13.641160 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:13.641120 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65f96760-3277-4e9d-9e30-069f7641687e" path="/var/lib/kubelet/pods/65f96760-3277-4e9d-9e30-069f7641687e/volumes" Jul 13 07:39:17.911278 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:17.911242 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:39:18.016805 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:18.016771 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:39:24.744572 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:24.744535 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:39:25.012407 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.012302 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr"] Jul 13 07:39:25.012919 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.012896 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65f96760-3277-4e9d-9e30-069f7641687e" containerName="istio-proxy" Jul 13 07:39:25.013091 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.013072 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="65f96760-3277-4e9d-9e30-069f7641687e" containerName="istio-proxy" Jul 13 07:39:25.013215 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.013203 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="65f96760-3277-4e9d-9e30-069f7641687e" containerName="istio-proxy" Jul 13 07:39:25.023342 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.021943 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.025337 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.025294 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3ec805da-openshift-default-dockercfg-584lq\"" Jul 13 07:39:25.027921 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.027897 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr"] Jul 13 07:39:25.044348 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.044181 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:39:25.081007 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.080972 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-istio-data\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.081007 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.081013 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31386a4c-4581-4a92-8439-504924c0c66e-istio-podinfo\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.081264 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.081049 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31386a4c-4581-4a92-8439-504924c0c66e-istiod-ca-cert\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.081264 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.081083 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-workload-socket\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.081264 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.081107 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gmld\" (UniqueName: \"kubernetes.io/projected/31386a4c-4581-4a92-8439-504924c0c66e-kube-api-access-5gmld\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.081264 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.081140 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-istio-envoy\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.081264 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.081175 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-workload-certs\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.081264 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.081244 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-credential-socket\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.081538 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.081359 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31386a4c-4581-4a92-8439-504924c0c66e-istio-token\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.182850 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.182814 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-workload-certs\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.183042 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.182886 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-credential-socket\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.183042 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.182926 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31386a4c-4581-4a92-8439-504924c0c66e-istio-token\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.183042 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.182967 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-istio-data\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.183042 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.182983 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31386a4c-4581-4a92-8439-504924c0c66e-istio-podinfo\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.183042 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.183004 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31386a4c-4581-4a92-8439-504924c0c66e-istiod-ca-cert\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.183042 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.183027 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-workload-socket\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.183396 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.183050 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gmld\" (UniqueName: \"kubernetes.io/projected/31386a4c-4581-4a92-8439-504924c0c66e-kube-api-access-5gmld\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.183396 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.183081 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-istio-envoy\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.183396 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.183274 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-workload-certs\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.183396 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.183346 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-credential-socket\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.183610 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.183529 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-workload-socket\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.183783 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.183763 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-istio-data\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.183954 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.183930 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31386a4c-4581-4a92-8439-504924c0c66e-istiod-ca-cert\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.185462 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.185438 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-istio-envoy\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.185957 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.185920 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31386a4c-4581-4a92-8439-504924c0c66e-istio-podinfo\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.195639 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.195614 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31386a4c-4581-4a92-8439-504924c0c66e-istio-token\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.196645 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.196622 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gmld\" (UniqueName: \"kubernetes.io/projected/31386a4c-4581-4a92-8439-504924c0c66e-kube-api-access-5gmld\") pod \"e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.352753 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.352667 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:25.516274 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.516240 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr"] Jul 13 07:39:25.516973 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:39:25.516946 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31386a4c_4581_4a92_8439_504924c0c66e.slice/crio-5da540e95395a7c5a318da1b44e99b9541aa76225e76912d990dca969aa7135d WatchSource:0}: Error finding container 5da540e95395a7c5a318da1b44e99b9541aa76225e76912d990dca969aa7135d: Status 404 returned error can't find the container with id 5da540e95395a7c5a318da1b44e99b9541aa76225e76912d990dca969aa7135d Jul 13 07:39:25.519676 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.519631 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:39:25.519778 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.519709 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:39:25.519778 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.519750 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:39:25.981228 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.981180 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" event={"ID":"31386a4c-4581-4a92-8439-504924c0c66e","Type":"ContainerStarted","Data":"6342219c20e932c39b1a57b6daa37f8d66fe25711f43f0c0e61c47e98cdf9628"} Jul 13 07:39:25.981807 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:25.981770 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" event={"ID":"31386a4c-4581-4a92-8439-504924c0c66e","Type":"ContainerStarted","Data":"5da540e95395a7c5a318da1b44e99b9541aa76225e76912d990dca969aa7135d"} Jul 13 07:39:26.007699 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:26.007664 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:39:26.009263 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:26.009214 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" podStartSLOduration=2.009197053 podStartE2EDuration="2.009197053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:39:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:39:26.005620213 +0000 UTC m=+1642.927872470" watchObservedRunningTime="2026-07-13 07:39:26.009197053 +0000 UTC m=+1642.931449228" Jul 13 07:39:26.106839 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:26.106795 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:39:26.353843 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:26.353810 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:26.359370 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:26.359340 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:26.986474 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:26.986446 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:26.987591 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:26.987573 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:27.954431 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:27.954395 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:39:28.139184 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:28.139153 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:39:28.269014 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:28.268981 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:39:28.368476 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:28.368444 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:39:28.802378 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:28.802345 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:39:28.902524 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:28.902491 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:39:32.394417 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:32.394368 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:39:41.065569 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:41.065482 2565 generic.go:356] "Generic (PLEG): container finished" podID="31386a4c-4581-4a92-8439-504924c0c66e" containerID="6342219c20e932c39b1a57b6daa37f8d66fe25711f43f0c0e61c47e98cdf9628" exitCode=0 Jul 13 07:39:41.065569 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:41.065557 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" event={"ID":"31386a4c-4581-4a92-8439-504924c0c66e","Type":"ContainerDied","Data":"6342219c20e932c39b1a57b6daa37f8d66fe25711f43f0c0e61c47e98cdf9628"} Jul 13 07:39:41.066122 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:41.065999 2565 scope.go:117] "RemoveContainer" containerID="6342219c20e932c39b1a57b6daa37f8d66fe25711f43f0c0e61c47e98cdf9628" Jul 13 07:39:41.067110 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:41.067076 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:39:41.067210 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:41.067141 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:39:41.067210 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:41.067171 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:39:41.987453 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:41.987391 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:42.077636 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:42.077589 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" event={"ID":"31386a4c-4581-4a92-8439-504924c0c66e","Type":"ContainerStarted","Data":"c45cd89337b939d2df7d3468b3047bf77a6fd0fb2a25740ae0b887443a076e58"} Jul 13 07:39:42.353617 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:42.353512 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:42.354789 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:42.354766 2565 patch_prober.go:28] interesting pod/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 13 07:39:42.354851 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:42.354815 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" podUID="31386a4c-4581-4a92-8439-504924c0c66e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 13 07:39:43.353195 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:43.353159 2565 patch_prober.go:28] interesting pod/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 13 07:39:43.353620 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:43.353216 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" podUID="31386a4c-4581-4a92-8439-504924c0c66e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 13 07:39:44.353777 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:44.353737 2565 patch_prober.go:28] interesting pod/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 13 07:39:44.354197 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:44.353804 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" podUID="31386a4c-4581-4a92-8439-504924c0c66e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 13 07:39:45.353360 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:45.353299 2565 patch_prober.go:28] interesting pod/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body= Jul 13 07:39:45.353538 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:45.353378 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" podUID="31386a4c-4581-4a92-8439-504924c0c66e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" Jul 13 07:39:46.357279 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:46.357244 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:46.357767 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:46.357552 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:46.358200 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:46.358181 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:39:51.174214 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:39:51.174179 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:40:06.204544 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:40:06.204509 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:40:06.306287 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:40:06.306248 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:40:09.990415 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:40:09.990380 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:40:10.373171 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:40:10.373086 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:40:10.473919 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:40:10.473882 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:40:10.674391 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:40:10.674303 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:40:15.971449 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:40:15.971396 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:40:20.983110 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:40:20.983073 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:40:31.157744 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:40:31.157651 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:40:57.216468 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:40:57.216428 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:40:57.890547 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:40:57.890512 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:03.378755 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:03.378719 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:03.480599 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:03.480571 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:03.641126 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:03.641041 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr"] Jul 13 07:41:03.641292 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:03.641244 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" podUID="31386a4c-4581-4a92-8439-504924c0c66e" containerName="istio-proxy" containerID="cri-o://c45cd89337b939d2df7d3468b3047bf77a6fd0fb2a25740ae0b887443a076e58" gracePeriod=30 Jul 13 07:41:03.654719 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:03.654696 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:03.867282 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:03.867246 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:04.890633 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:04.890602 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:04.988035 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:04.988005 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:05.088137 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:05.088113 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:05.749006 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:05.748968 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:05.849358 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:05.849327 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:05.950135 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:05.950110 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:07.281052 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:07.281020 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:08.897121 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.897098 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:41:08.986631 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.986608 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-istio-data\") pod \"31386a4c-4581-4a92-8439-504924c0c66e\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " Jul 13 07:41:08.986782 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.986642 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-workload-socket\") pod \"31386a4c-4581-4a92-8439-504924c0c66e\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " Jul 13 07:41:08.986782 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.986666 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-workload-certs\") pod \"31386a4c-4581-4a92-8439-504924c0c66e\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " Jul 13 07:41:08.986782 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.986698 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31386a4c-4581-4a92-8439-504924c0c66e-istio-token\") pod \"31386a4c-4581-4a92-8439-504924c0c66e\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " Jul 13 07:41:08.986782 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.986731 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-credential-socket\") pod \"31386a4c-4581-4a92-8439-504924c0c66e\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " Jul 13 07:41:08.986782 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.986766 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31386a4c-4581-4a92-8439-504924c0c66e-istio-podinfo\") pod \"31386a4c-4581-4a92-8439-504924c0c66e\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " Jul 13 07:41:08.987042 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.986806 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gmld\" (UniqueName: \"kubernetes.io/projected/31386a4c-4581-4a92-8439-504924c0c66e-kube-api-access-5gmld\") pod \"31386a4c-4581-4a92-8439-504924c0c66e\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " Jul 13 07:41:08.987042 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.986847 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31386a4c-4581-4a92-8439-504924c0c66e-istiod-ca-cert\") pod \"31386a4c-4581-4a92-8439-504924c0c66e\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " Jul 13 07:41:08.987042 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.986894 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-istio-envoy\") pod \"31386a4c-4581-4a92-8439-504924c0c66e\" (UID: \"31386a4c-4581-4a92-8439-504924c0c66e\") " Jul 13 07:41:08.987042 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.986915 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "31386a4c-4581-4a92-8439-504924c0c66e" (UID: "31386a4c-4581-4a92-8439-504924c0c66e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:41:08.987042 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.986964 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "31386a4c-4581-4a92-8439-504924c0c66e" (UID: "31386a4c-4581-4a92-8439-504924c0c66e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:41:08.987042 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.986993 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "31386a4c-4581-4a92-8439-504924c0c66e" (UID: "31386a4c-4581-4a92-8439-504924c0c66e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:41:08.987347 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.987250 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-workload-socket\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:41:08.987347 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.987270 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-workload-certs\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:41:08.987347 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.987283 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-credential-socket\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:41:08.987347 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.987307 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31386a4c-4581-4a92-8439-504924c0c66e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "31386a4c-4581-4a92-8439-504924c0c66e" (UID: "31386a4c-4581-4a92-8439-504924c0c66e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:41:08.987637 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.987592 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-istio-data" (OuterVolumeSpecName: "istio-data") pod "31386a4c-4581-4a92-8439-504924c0c66e" (UID: "31386a4c-4581-4a92-8439-504924c0c66e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:41:08.989171 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.989150 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "31386a4c-4581-4a92-8439-504924c0c66e" (UID: "31386a4c-4581-4a92-8439-504924c0c66e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:41:08.989268 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.989179 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/31386a4c-4581-4a92-8439-504924c0c66e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "31386a4c-4581-4a92-8439-504924c0c66e" (UID: "31386a4c-4581-4a92-8439-504924c0c66e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 07:41:08.989348 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.989278 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31386a4c-4581-4a92-8439-504924c0c66e-istio-token" (OuterVolumeSpecName: "istio-token") pod "31386a4c-4581-4a92-8439-504924c0c66e" (UID: "31386a4c-4581-4a92-8439-504924c0c66e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:41:08.989348 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:08.989286 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31386a4c-4581-4a92-8439-504924c0c66e-kube-api-access-5gmld" (OuterVolumeSpecName: "kube-api-access-5gmld") pod "31386a4c-4581-4a92-8439-504924c0c66e" (UID: "31386a4c-4581-4a92-8439-504924c0c66e"). InnerVolumeSpecName "kube-api-access-5gmld". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:41:09.087740 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:09.087711 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/31386a4c-4581-4a92-8439-504924c0c66e-istio-podinfo\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:41:09.087740 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:09.087738 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gmld\" (UniqueName: \"kubernetes.io/projected/31386a4c-4581-4a92-8439-504924c0c66e-kube-api-access-5gmld\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:41:09.087865 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:09.087755 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/31386a4c-4581-4a92-8439-504924c0c66e-istiod-ca-cert\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:41:09.087865 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:09.087765 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-istio-envoy\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:41:09.087865 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:09.087773 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/31386a4c-4581-4a92-8439-504924c0c66e-istio-data\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:41:09.087865 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:09.087781 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/31386a4c-4581-4a92-8439-504924c0c66e-istio-token\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:41:09.557970 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:09.557935 2565 generic.go:356] "Generic (PLEG): container finished" podID="31386a4c-4581-4a92-8439-504924c0c66e" containerID="c45cd89337b939d2df7d3468b3047bf77a6fd0fb2a25740ae0b887443a076e58" exitCode=0 Jul 13 07:41:09.558110 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:09.557976 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" Jul 13 07:41:09.558110 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:09.558018 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" event={"ID":"31386a4c-4581-4a92-8439-504924c0c66e","Type":"ContainerDied","Data":"c45cd89337b939d2df7d3468b3047bf77a6fd0fb2a25740ae0b887443a076e58"} Jul 13 07:41:09.558110 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:09.558103 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr" event={"ID":"31386a4c-4581-4a92-8439-504924c0c66e","Type":"ContainerDied","Data":"5da540e95395a7c5a318da1b44e99b9541aa76225e76912d990dca969aa7135d"} Jul 13 07:41:09.558259 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:09.558126 2565 scope.go:117] "RemoveContainer" containerID="c45cd89337b939d2df7d3468b3047bf77a6fd0fb2a25740ae0b887443a076e58" Jul 13 07:41:09.568813 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:09.568794 2565 scope.go:117] "RemoveContainer" containerID="6342219c20e932c39b1a57b6daa37f8d66fe25711f43f0c0e61c47e98cdf9628" Jul 13 07:41:09.576926 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:09.576907 2565 scope.go:117] "RemoveContainer" containerID="c45cd89337b939d2df7d3468b3047bf77a6fd0fb2a25740ae0b887443a076e58" Jul 13 07:41:09.577157 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:41:09.577139 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c45cd89337b939d2df7d3468b3047bf77a6fd0fb2a25740ae0b887443a076e58\": container with ID starting with c45cd89337b939d2df7d3468b3047bf77a6fd0fb2a25740ae0b887443a076e58 not found: ID does not exist" containerID="c45cd89337b939d2df7d3468b3047bf77a6fd0fb2a25740ae0b887443a076e58" Jul 13 07:41:09.577219 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:09.577165 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c45cd89337b939d2df7d3468b3047bf77a6fd0fb2a25740ae0b887443a076e58"} err="failed to get container status \"c45cd89337b939d2df7d3468b3047bf77a6fd0fb2a25740ae0b887443a076e58\": rpc error: code = NotFound desc = could not find container \"c45cd89337b939d2df7d3468b3047bf77a6fd0fb2a25740ae0b887443a076e58\": container with ID starting with c45cd89337b939d2df7d3468b3047bf77a6fd0fb2a25740ae0b887443a076e58 not found: ID does not exist" Jul 13 07:41:09.577219 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:09.577181 2565 scope.go:117] "RemoveContainer" containerID="6342219c20e932c39b1a57b6daa37f8d66fe25711f43f0c0e61c47e98cdf9628" Jul 13 07:41:09.577488 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:41:09.577438 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6342219c20e932c39b1a57b6daa37f8d66fe25711f43f0c0e61c47e98cdf9628\": container with ID starting with 6342219c20e932c39b1a57b6daa37f8d66fe25711f43f0c0e61c47e98cdf9628 not found: ID does not exist" containerID="6342219c20e932c39b1a57b6daa37f8d66fe25711f43f0c0e61c47e98cdf9628" Jul 13 07:41:09.577544 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:09.577494 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6342219c20e932c39b1a57b6daa37f8d66fe25711f43f0c0e61c47e98cdf9628"} err="failed to get container status \"6342219c20e932c39b1a57b6daa37f8d66fe25711f43f0c0e61c47e98cdf9628\": rpc error: code = NotFound desc = could not find container \"6342219c20e932c39b1a57b6daa37f8d66fe25711f43f0c0e61c47e98cdf9628\": container with ID starting with 6342219c20e932c39b1a57b6daa37f8d66fe25711f43f0c0e61c47e98cdf9628 not found: ID does not exist" Jul 13 07:41:09.580516 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:09.580495 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr"] Jul 13 07:41:09.588745 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:09.588726 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3ec805da-openshift-default-bf6796b5f-zr2dr"] Jul 13 07:41:09.638903 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:09.638881 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31386a4c-4581-4a92-8439-504924c0c66e" path="/var/lib/kubelet/pods/31386a4c-4581-4a92-8439-504924c0c66e/volumes" Jul 13 07:41:13.001391 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:13.001360 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:13.065707 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:13.065678 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:13.646842 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:13.646809 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:19.588308 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:19.588276 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:19.647709 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:19.647676 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:19.727181 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:19.727153 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:19.828295 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:19.828267 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:30.269855 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:30.269814 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:30.583310 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:30.583226 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:51.534918 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:51.534883 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:57.265802 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.265724 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:57.323780 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.323751 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:57.593803 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.593742 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:57.869444 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.869361 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn"] Jul 13 07:41:57.869729 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.869716 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65f96760-3277-4e9d-9e30-069f7641687e" containerName="istio-proxy" Jul 13 07:41:57.869790 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.869730 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="65f96760-3277-4e9d-9e30-069f7641687e" containerName="istio-proxy" Jul 13 07:41:57.869790 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.869739 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31386a4c-4581-4a92-8439-504924c0c66e" containerName="istio-proxy" Jul 13 07:41:57.869790 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.869745 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="31386a4c-4581-4a92-8439-504924c0c66e" containerName="istio-proxy" Jul 13 07:41:57.869790 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.869753 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31386a4c-4581-4a92-8439-504924c0c66e" containerName="istio-proxy" Jul 13 07:41:57.869790 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.869759 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="31386a4c-4581-4a92-8439-504924c0c66e" containerName="istio-proxy" Jul 13 07:41:57.870037 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.869827 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="31386a4c-4581-4a92-8439-504924c0c66e" containerName="istio-proxy" Jul 13 07:41:57.870037 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.869836 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="65f96760-3277-4e9d-9e30-069f7641687e" containerName="istio-proxy" Jul 13 07:41:57.872945 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.872927 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:57.876231 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.876208 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-7d46e0-openshift-default-dockercfg-f97jd\"" Jul 13 07:41:57.900550 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.900520 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn"] Jul 13 07:41:57.920752 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.920722 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:57.944473 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.944449 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-token\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:57.944596 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.944495 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-credential-socket\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:57.944596 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.944562 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-data\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:57.944596 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.944593 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istiod-ca-cert\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:57.944768 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.944622 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-workload-socket\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:57.944768 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.944636 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-envoy\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:57.944768 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.944651 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d624\" (UniqueName: \"kubernetes.io/projected/fcd79183-fe1f-4806-82af-4da86a0f7e8e-kube-api-access-9d624\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:57.944936 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.944785 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-podinfo\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:57.944936 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:57.944823 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-workload-certs\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:58.045704 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.045677 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-token\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:58.045866 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.045716 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-credential-socket\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:58.045866 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.045735 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-data\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:58.045969 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.045863 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istiod-ca-cert\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:58.045969 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.045924 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-workload-socket\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:58.045969 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.045951 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-envoy\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:58.046146 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.046058 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d624\" (UniqueName: \"kubernetes.io/projected/fcd79183-fe1f-4806-82af-4da86a0f7e8e-kube-api-access-9d624\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:58.046146 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.046101 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-data\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:58.046146 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.046131 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-credential-socket\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:58.046305 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.046180 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-podinfo\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:58.046305 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.046202 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-workload-certs\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:58.046641 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.046617 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-workload-certs\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:58.046760 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.046595 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-workload-socket\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:58.046814 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.046789 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istiod-ca-cert\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:58.048709 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.048684 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-envoy\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:58.048902 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.048885 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-podinfo\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:58.059558 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.059536 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-token\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:58.059765 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.059743 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d624\" (UniqueName: \"kubernetes.io/projected/fcd79183-fe1f-4806-82af-4da86a0f7e8e-kube-api-access-9d624\") pod \"e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:58.186270 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.186202 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:58.330349 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.330299 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn"] Jul 13 07:41:58.331792 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.331762 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:41:58.331909 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:41:58.331816 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd79183_fe1f_4806_82af_4da86a0f7e8e.slice/crio-c54bf0ca5791e02cc9c3f4814aac3be6538775643b71880074b18c2baabebfc4 WatchSource:0}: Error finding container c54bf0ca5791e02cc9c3f4814aac3be6538775643b71880074b18c2baabebfc4: Status 404 returned error can't find the container with id c54bf0ca5791e02cc9c3f4814aac3be6538775643b71880074b18c2baabebfc4 Jul 13 07:41:58.333896 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.333871 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:41:58.333948 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.333932 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:41:58.333983 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.333961 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:41:58.816783 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.816746 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" event={"ID":"fcd79183-fe1f-4806-82af-4da86a0f7e8e","Type":"ContainerStarted","Data":"39bf0f7138c2c625a3f715273510d13ed5157b75c2c21731a49f1ea2d4a7372e"} Jul 13 07:41:58.816948 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.816804 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" event={"ID":"fcd79183-fe1f-4806-82af-4da86a0f7e8e","Type":"ContainerStarted","Data":"c54bf0ca5791e02cc9c3f4814aac3be6538775643b71880074b18c2baabebfc4"} Jul 13 07:41:58.839054 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:58.838999 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" podStartSLOduration=1.838986421 podStartE2EDuration="1.838986421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:41:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:41:58.837518242 +0000 UTC m=+1795.759770419" watchObservedRunningTime="2026-07-13 07:41:58.838986421 +0000 UTC m=+1795.761238594" Jul 13 07:41:59.187294 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:59.187210 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:59.192074 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:59.192051 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:59.821287 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:59.821258 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:41:59.822236 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:41:59.822218 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:42:00.711439 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:00.711396 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:42:00.812504 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:00.812477 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:42:01.099844 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:01.099812 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:42:01.204565 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:01.204534 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:42:01.506229 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:01.506192 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:42:01.606392 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:01.606361 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:42:05.184274 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:05.184238 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:42:05.490868 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:05.490837 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:42:05.764474 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:05.764380 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5"] Jul 13 07:42:05.765039 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:05.765019 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="31386a4c-4581-4a92-8439-504924c0c66e" containerName="istio-proxy" Jul 13 07:42:05.768215 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:05.768191 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:05.770529 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:05.770508 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-6d9a89-openshift-default-dockercfg-ph5jp\"" Jul 13 07:42:05.782978 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:05.782955 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5"] Jul 13 07:42:05.800079 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:05.800056 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:42:05.905661 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:05.905625 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-token\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:05.905661 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:05.905657 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgrc8\" (UniqueName: \"kubernetes.io/projected/12fa1e7c-a75a-4641-84e9-3f45e08e3394-kube-api-access-bgrc8\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:05.905852 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:05.905681 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istiod-ca-cert\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:05.905852 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:05.905765 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-workload-socket\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:05.905852 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:05.905790 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-workload-certs\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:05.905852 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:05.905842 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-envoy\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:05.905983 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:05.905875 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-credential-socket\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:05.905983 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:05.905889 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-data\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:05.905983 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:05.905918 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-podinfo\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:06.007164 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.007134 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-podinfo\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:06.007310 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.007171 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-token\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:06.007310 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.007187 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgrc8\" (UniqueName: \"kubernetes.io/projected/12fa1e7c-a75a-4641-84e9-3f45e08e3394-kube-api-access-bgrc8\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:06.007310 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.007301 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istiod-ca-cert\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:06.007480 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.007396 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-workload-socket\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:06.007480 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.007427 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-workload-certs\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:06.007569 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.007505 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-envoy\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:06.007569 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.007548 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-credential-socket\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:06.007670 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.007571 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-data\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:06.007838 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.007801 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-workload-socket\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:06.007914 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.007893 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-workload-certs\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:06.008019 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.007989 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-credential-socket\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:06.008019 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.007995 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-data\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:06.008185 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.008090 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istiod-ca-cert\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:06.009831 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.009804 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-envoy\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:06.010124 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.010098 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-podinfo\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:06.017667 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.017609 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-token\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:06.019381 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.019354 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgrc8\" (UniqueName: \"kubernetes.io/projected/12fa1e7c-a75a-4641-84e9-3f45e08e3394-kube-api-access-bgrc8\") pod \"e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:06.032594 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.032563 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:42:06.079527 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.079507 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:06.217525 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.217498 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5"] Jul 13 07:42:06.219347 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:42:06.219297 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12fa1e7c_a75a_4641_84e9_3f45e08e3394.slice/crio-6862a56feb303a82ce02c9d1be5ba486a3875534268112bb9449c936a16600bd WatchSource:0}: Error finding container 6862a56feb303a82ce02c9d1be5ba486a3875534268112bb9449c936a16600bd: Status 404 returned error can't find the container with id 6862a56feb303a82ce02c9d1be5ba486a3875534268112bb9449c936a16600bd Jul 13 07:42:06.221664 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.221634 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:42:06.221770 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.221696 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:42:06.221770 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.221726 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:42:06.858385 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.858351 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" event={"ID":"12fa1e7c-a75a-4641-84e9-3f45e08e3394","Type":"ContainerStarted","Data":"8826d673731191a6ab5a9b6e067fdf6d78abe898f0347d66707ba5f30164b4b7"} Jul 13 07:42:06.858574 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.858402 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" event={"ID":"12fa1e7c-a75a-4641-84e9-3f45e08e3394","Type":"ContainerStarted","Data":"6862a56feb303a82ce02c9d1be5ba486a3875534268112bb9449c936a16600bd"} Jul 13 07:42:06.883004 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:06.882960 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" podStartSLOduration=1.882945759 podStartE2EDuration="1.882945759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:42:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:42:06.879567658 +0000 UTC m=+1803.801819830" watchObservedRunningTime="2026-07-13 07:42:06.882945759 +0000 UTC m=+1803.805197931" Jul 13 07:42:07.080116 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:07.080081 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:07.085330 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:07.085298 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:07.863804 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:07.863773 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:07.864923 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:07.864902 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:08.773578 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:08.773543 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:42:08.859005 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:08.858965 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:42:08.938557 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:08.938514 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:42:09.429467 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:09.429434 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:42:09.532570 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:09.532522 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:42:13.233722 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:13.233688 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:42:15.863485 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:15.863452 2565 patch_prober.go:28] interesting pod/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 13 07:42:15.863863 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:15.863534 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" podUID="fcd79183-fe1f-4806-82af-4da86a0f7e8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 13 07:42:16.920040 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:16.920002 2565 generic.go:356] "Generic (PLEG): container finished" podID="fcd79183-fe1f-4806-82af-4da86a0f7e8e" containerID="39bf0f7138c2c625a3f715273510d13ed5157b75c2c21731a49f1ea2d4a7372e" exitCode=0 Jul 13 07:42:16.920544 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:16.920073 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" event={"ID":"fcd79183-fe1f-4806-82af-4da86a0f7e8e","Type":"ContainerDied","Data":"39bf0f7138c2c625a3f715273510d13ed5157b75c2c21731a49f1ea2d4a7372e"} Jul 13 07:42:16.920544 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:16.920529 2565 scope.go:117] "RemoveContainer" containerID="39bf0f7138c2c625a3f715273510d13ed5157b75c2c21731a49f1ea2d4a7372e" Jul 13 07:42:16.921513 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:16.921489 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:42:16.921568 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:16.921552 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:42:16.921604 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:16.921592 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:42:17.926641 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:17.926609 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" event={"ID":"fcd79183-fe1f-4806-82af-4da86a0f7e8e","Type":"ContainerStarted","Data":"53509e90144fd55db38873620d11d4768efb97b2c034bc18b665256d3642b0a5"} Jul 13 07:42:18.186716 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:18.186601 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:42:18.187072 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:18.187043 2565 patch_prober.go:28] interesting pod/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 13 07:42:18.187167 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:18.187101 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" podUID="fcd79183-fe1f-4806-82af-4da86a0f7e8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 13 07:42:19.187286 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:19.187251 2565 patch_prober.go:28] interesting pod/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 13 07:42:19.187872 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:19.187840 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" podUID="fcd79183-fe1f-4806-82af-4da86a0f7e8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 13 07:42:20.187079 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:20.187040 2565 patch_prober.go:28] interesting pod/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 13 07:42:20.187376 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:20.187347 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" podUID="fcd79183-fe1f-4806-82af-4da86a0f7e8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 13 07:42:21.187465 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:21.186962 2565 patch_prober.go:28] interesting pod/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body= Jul 13 07:42:21.187465 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:21.187036 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" podUID="fcd79183-fe1f-4806-82af-4da86a0f7e8e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" Jul 13 07:42:22.191501 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:22.191467 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:42:22.191917 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:22.191855 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:42:22.192473 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:22.192449 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:42:22.243175 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:22.243141 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:42:22.305064 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:22.305030 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:42:23.905476 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:23.905446 2565 patch_prober.go:28] interesting pod/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 13 07:42:23.906650 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:23.905525 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" podUID="12fa1e7c-a75a-4641-84e9-3f45e08e3394" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 13 07:42:24.241738 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:24.241711 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:42:24.970089 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:24.970056 2565 generic.go:356] "Generic (PLEG): container finished" podID="12fa1e7c-a75a-4641-84e9-3f45e08e3394" containerID="8826d673731191a6ab5a9b6e067fdf6d78abe898f0347d66707ba5f30164b4b7" exitCode=0 Jul 13 07:42:24.970470 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:24.970137 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" event={"ID":"12fa1e7c-a75a-4641-84e9-3f45e08e3394","Type":"ContainerDied","Data":"8826d673731191a6ab5a9b6e067fdf6d78abe898f0347d66707ba5f30164b4b7"} Jul 13 07:42:24.970524 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:24.970509 2565 scope.go:117] "RemoveContainer" containerID="8826d673731191a6ab5a9b6e067fdf6d78abe898f0347d66707ba5f30164b4b7" Jul 13 07:42:24.971508 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:24.971482 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:42:24.971573 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:24.971550 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:42:24.971613 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:24.971582 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:42:25.981466 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:25.981425 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" event={"ID":"12fa1e7c-a75a-4641-84e9-3f45e08e3394","Type":"ContainerStarted","Data":"e8eeb23f111cf7f5cd3935fbda63c5ce4a07620cbed393f11e0624b0cd2f14f3"} Jul 13 07:42:26.080767 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:26.080607 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:26.080767 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:26.080642 2565 patch_prober.go:28] interesting pod/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Jul 13 07:42:26.081025 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:26.080784 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" podUID="12fa1e7c-a75a-4641-84e9-3f45e08e3394" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Jul 13 07:42:27.080180 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:27.080138 2565 patch_prober.go:28] interesting pod/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Jul 13 07:42:27.080813 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:27.080780 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" podUID="12fa1e7c-a75a-4641-84e9-3f45e08e3394" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Jul 13 07:42:28.080280 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:28.080231 2565 patch_prober.go:28] interesting pod/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Jul 13 07:42:28.080780 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:28.080305 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" podUID="12fa1e7c-a75a-4641-84e9-3f45e08e3394" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Jul 13 07:42:29.080817 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:29.080774 2565 patch_prober.go:28] interesting pod/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body= Jul 13 07:42:29.081455 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:29.080838 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" podUID="12fa1e7c-a75a-4641-84e9-3f45e08e3394" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" Jul 13 07:42:30.083483 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:30.083455 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:30.083851 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:30.083791 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:30.084376 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:30.084360 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:42:30.153608 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:30.153577 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:42:30.254370 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:30.254337 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:42:42.369118 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:42:42.369079 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:01.433640 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:01.433597 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:02.329603 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:02.329573 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:02.474944 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:02.474914 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:02.848944 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:02.848914 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:02.950155 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:02.950125 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:03.052883 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:03.052845 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:03.210679 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:03.210598 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:07.926142 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:07.926110 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:44.706979 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:44.706891 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:44.964482 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:44.964392 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn"] Jul 13 07:43:44.989872 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:44.989832 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:45.224406 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:45.224301 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:45.400096 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:45.400058 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" podUID="fcd79183-fe1f-4806-82af-4da86a0f7e8e" containerName="istio-proxy" containerID="cri-o://53509e90144fd55db38873620d11d4768efb97b2c034bc18b665256d3642b0a5" gracePeriod=30 Jul 13 07:43:45.420630 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:45.420598 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:45.867245 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:45.867207 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:45.966368 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:45.966325 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:46.066659 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:46.066628 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:46.286819 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:46.286782 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:50.653619 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.653595 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:43:50.734943 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.734920 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-credential-socket\") pod \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " Jul 13 07:43:50.735061 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.734950 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-workload-certs\") pod \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " Jul 13 07:43:50.735061 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.734978 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-token\") pod \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " Jul 13 07:43:50.735061 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.734993 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-data\") pod \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " Jul 13 07:43:50.735061 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.735031 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-envoy\") pod \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " Jul 13 07:43:50.735061 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.735049 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istiod-ca-cert\") pod \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " Jul 13 07:43:50.735343 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.735080 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9d624\" (UniqueName: \"kubernetes.io/projected/fcd79183-fe1f-4806-82af-4da86a0f7e8e-kube-api-access-9d624\") pod \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " Jul 13 07:43:50.735343 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.735099 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-podinfo\") pod \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " Jul 13 07:43:50.735343 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.735127 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-workload-socket\") pod \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\" (UID: \"fcd79183-fe1f-4806-82af-4da86a0f7e8e\") " Jul 13 07:43:50.735343 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.735255 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fcd79183-fe1f-4806-82af-4da86a0f7e8e" (UID: "fcd79183-fe1f-4806-82af-4da86a0f7e8e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:43:50.735573 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.735495 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fcd79183-fe1f-4806-82af-4da86a0f7e8e" (UID: "fcd79183-fe1f-4806-82af-4da86a0f7e8e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:43:50.735573 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.735499 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fcd79183-fe1f-4806-82af-4da86a0f7e8e" (UID: "fcd79183-fe1f-4806-82af-4da86a0f7e8e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:43:50.735678 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.735606 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-credential-socket\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:43:50.735678 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.735626 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-workload-certs\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:43:50.735678 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.735641 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istiod-ca-cert\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:43:50.735830 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.735738 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fcd79183-fe1f-4806-82af-4da86a0f7e8e" (UID: "fcd79183-fe1f-4806-82af-4da86a0f7e8e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:43:50.736103 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.736072 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-data" (OuterVolumeSpecName: "istio-data") pod "fcd79183-fe1f-4806-82af-4da86a0f7e8e" (UID: "fcd79183-fe1f-4806-82af-4da86a0f7e8e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:43:50.737229 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.737201 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fcd79183-fe1f-4806-82af-4da86a0f7e8e" (UID: "fcd79183-fe1f-4806-82af-4da86a0f7e8e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:43:50.737529 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.737502 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fcd79183-fe1f-4806-82af-4da86a0f7e8e" (UID: "fcd79183-fe1f-4806-82af-4da86a0f7e8e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 07:43:50.737529 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.737509 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-token" (OuterVolumeSpecName: "istio-token") pod "fcd79183-fe1f-4806-82af-4da86a0f7e8e" (UID: "fcd79183-fe1f-4806-82af-4da86a0f7e8e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:43:50.737653 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.737639 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcd79183-fe1f-4806-82af-4da86a0f7e8e-kube-api-access-9d624" (OuterVolumeSpecName: "kube-api-access-9d624") pod "fcd79183-fe1f-4806-82af-4da86a0f7e8e" (UID: "fcd79183-fe1f-4806-82af-4da86a0f7e8e"). InnerVolumeSpecName "kube-api-access-9d624". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:43:50.836702 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.836678 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-envoy\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:43:50.836702 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.836702 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9d624\" (UniqueName: \"kubernetes.io/projected/fcd79183-fe1f-4806-82af-4da86a0f7e8e-kube-api-access-9d624\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:43:50.836842 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.836713 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-podinfo\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:43:50.836842 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.836721 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-workload-socket\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:43:50.836842 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.836730 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-token\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:43:50.836842 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:50.836738 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcd79183-fe1f-4806-82af-4da86a0f7e8e-istio-data\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:43:51.438529 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:51.438495 2565 generic.go:356] "Generic (PLEG): container finished" podID="fcd79183-fe1f-4806-82af-4da86a0f7e8e" containerID="53509e90144fd55db38873620d11d4768efb97b2c034bc18b665256d3642b0a5" exitCode=0 Jul 13 07:43:51.438719 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:51.438542 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" Jul 13 07:43:51.438719 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:51.438545 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" event={"ID":"fcd79183-fe1f-4806-82af-4da86a0f7e8e","Type":"ContainerDied","Data":"53509e90144fd55db38873620d11d4768efb97b2c034bc18b665256d3642b0a5"} Jul 13 07:43:51.438719 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:51.438646 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn" event={"ID":"fcd79183-fe1f-4806-82af-4da86a0f7e8e","Type":"ContainerDied","Data":"c54bf0ca5791e02cc9c3f4814aac3be6538775643b71880074b18c2baabebfc4"} Jul 13 07:43:51.438719 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:51.438669 2565 scope.go:117] "RemoveContainer" containerID="53509e90144fd55db38873620d11d4768efb97b2c034bc18b665256d3642b0a5" Jul 13 07:43:51.447988 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:51.447972 2565 scope.go:117] "RemoveContainer" containerID="39bf0f7138c2c625a3f715273510d13ed5157b75c2c21731a49f1ea2d4a7372e" Jul 13 07:43:51.455772 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:51.455755 2565 scope.go:117] "RemoveContainer" containerID="53509e90144fd55db38873620d11d4768efb97b2c034bc18b665256d3642b0a5" Jul 13 07:43:51.455992 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:43:51.455972 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53509e90144fd55db38873620d11d4768efb97b2c034bc18b665256d3642b0a5\": container with ID starting with 53509e90144fd55db38873620d11d4768efb97b2c034bc18b665256d3642b0a5 not found: ID does not exist" containerID="53509e90144fd55db38873620d11d4768efb97b2c034bc18b665256d3642b0a5" Jul 13 07:43:51.456035 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:51.456001 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53509e90144fd55db38873620d11d4768efb97b2c034bc18b665256d3642b0a5"} err="failed to get container status \"53509e90144fd55db38873620d11d4768efb97b2c034bc18b665256d3642b0a5\": rpc error: code = NotFound desc = could not find container \"53509e90144fd55db38873620d11d4768efb97b2c034bc18b665256d3642b0a5\": container with ID starting with 53509e90144fd55db38873620d11d4768efb97b2c034bc18b665256d3642b0a5 not found: ID does not exist" Jul 13 07:43:51.456035 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:51.456018 2565 scope.go:117] "RemoveContainer" containerID="39bf0f7138c2c625a3f715273510d13ed5157b75c2c21731a49f1ea2d4a7372e" Jul 13 07:43:51.456228 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:43:51.456212 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39bf0f7138c2c625a3f715273510d13ed5157b75c2c21731a49f1ea2d4a7372e\": container with ID starting with 39bf0f7138c2c625a3f715273510d13ed5157b75c2c21731a49f1ea2d4a7372e not found: ID does not exist" containerID="39bf0f7138c2c625a3f715273510d13ed5157b75c2c21731a49f1ea2d4a7372e" Jul 13 07:43:51.456281 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:51.456232 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39bf0f7138c2c625a3f715273510d13ed5157b75c2c21731a49f1ea2d4a7372e"} err="failed to get container status \"39bf0f7138c2c625a3f715273510d13ed5157b75c2c21731a49f1ea2d4a7372e\": rpc error: code = NotFound desc = could not find container \"39bf0f7138c2c625a3f715273510d13ed5157b75c2c21731a49f1ea2d4a7372e\": container with ID starting with 39bf0f7138c2c625a3f715273510d13ed5157b75c2c21731a49f1ea2d4a7372e not found: ID does not exist" Jul 13 07:43:51.461993 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:51.461972 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn"] Jul 13 07:43:51.467024 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:51.467003 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-7d46e0-openshift-default-595b679d8f-t78xn"] Jul 13 07:43:51.640413 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:51.640383 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcd79183-fe1f-4806-82af-4da86a0f7e8e" path="/var/lib/kubelet/pods/fcd79183-fe1f-4806-82af-4da86a0f7e8e/volumes" Jul 13 07:43:51.894839 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:51.894797 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:51.987892 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:51.987863 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:52.147538 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:52.147457 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5"] Jul 13 07:43:52.147752 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:52.147721 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" podUID="12fa1e7c-a75a-4641-84e9-3f45e08e3394" containerName="istio-proxy" containerID="cri-o://e8eeb23f111cf7f5cd3935fbda63c5ce4a07620cbed393f11e0624b0cd2f14f3" gracePeriod=30 Jul 13 07:43:52.169016 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:52.168985 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:52.394111 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:52.394070 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:52.732813 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:52.732780 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:53.047140 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:53.047101 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:53.286653 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:53.286575 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:57.411102 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.411041 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:43:57.473492 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.473451 2565 generic.go:356] "Generic (PLEG): container finished" podID="12fa1e7c-a75a-4641-84e9-3f45e08e3394" containerID="e8eeb23f111cf7f5cd3935fbda63c5ce4a07620cbed393f11e0624b0cd2f14f3" exitCode=0 Jul 13 07:43:57.473648 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.473516 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" Jul 13 07:43:57.473648 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.473517 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" event={"ID":"12fa1e7c-a75a-4641-84e9-3f45e08e3394","Type":"ContainerDied","Data":"e8eeb23f111cf7f5cd3935fbda63c5ce4a07620cbed393f11e0624b0cd2f14f3"} Jul 13 07:43:57.473648 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.473573 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5" event={"ID":"12fa1e7c-a75a-4641-84e9-3f45e08e3394","Type":"ContainerDied","Data":"6862a56feb303a82ce02c9d1be5ba486a3875534268112bb9449c936a16600bd"} Jul 13 07:43:57.473648 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.473604 2565 scope.go:117] "RemoveContainer" containerID="e8eeb23f111cf7f5cd3935fbda63c5ce4a07620cbed393f11e0624b0cd2f14f3" Jul 13 07:43:57.482681 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.482661 2565 scope.go:117] "RemoveContainer" containerID="8826d673731191a6ab5a9b6e067fdf6d78abe898f0347d66707ba5f30164b4b7" Jul 13 07:43:57.490934 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.490909 2565 scope.go:117] "RemoveContainer" containerID="e8eeb23f111cf7f5cd3935fbda63c5ce4a07620cbed393f11e0624b0cd2f14f3" Jul 13 07:43:57.491186 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:43:57.491167 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8eeb23f111cf7f5cd3935fbda63c5ce4a07620cbed393f11e0624b0cd2f14f3\": container with ID starting with e8eeb23f111cf7f5cd3935fbda63c5ce4a07620cbed393f11e0624b0cd2f14f3 not found: ID does not exist" containerID="e8eeb23f111cf7f5cd3935fbda63c5ce4a07620cbed393f11e0624b0cd2f14f3" Jul 13 07:43:57.491275 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.491194 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8eeb23f111cf7f5cd3935fbda63c5ce4a07620cbed393f11e0624b0cd2f14f3"} err="failed to get container status \"e8eeb23f111cf7f5cd3935fbda63c5ce4a07620cbed393f11e0624b0cd2f14f3\": rpc error: code = NotFound desc = could not find container \"e8eeb23f111cf7f5cd3935fbda63c5ce4a07620cbed393f11e0624b0cd2f14f3\": container with ID starting with e8eeb23f111cf7f5cd3935fbda63c5ce4a07620cbed393f11e0624b0cd2f14f3 not found: ID does not exist" Jul 13 07:43:57.491275 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.491213 2565 scope.go:117] "RemoveContainer" containerID="8826d673731191a6ab5a9b6e067fdf6d78abe898f0347d66707ba5f30164b4b7" Jul 13 07:43:57.491483 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:43:57.491468 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8826d673731191a6ab5a9b6e067fdf6d78abe898f0347d66707ba5f30164b4b7\": container with ID starting with 8826d673731191a6ab5a9b6e067fdf6d78abe898f0347d66707ba5f30164b4b7 not found: ID does not exist" containerID="8826d673731191a6ab5a9b6e067fdf6d78abe898f0347d66707ba5f30164b4b7" Jul 13 07:43:57.491521 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.491486 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8826d673731191a6ab5a9b6e067fdf6d78abe898f0347d66707ba5f30164b4b7"} err="failed to get container status \"8826d673731191a6ab5a9b6e067fdf6d78abe898f0347d66707ba5f30164b4b7\": rpc error: code = NotFound desc = could not find container \"8826d673731191a6ab5a9b6e067fdf6d78abe898f0347d66707ba5f30164b4b7\": container with ID starting with 8826d673731191a6ab5a9b6e067fdf6d78abe898f0347d66707ba5f30164b4b7 not found: ID does not exist" Jul 13 07:43:57.497836 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.497813 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-workload-certs\") pod \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " Jul 13 07:43:57.497919 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.497844 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-data\") pod \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " Jul 13 07:43:57.497919 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.497870 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-envoy\") pod \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " Jul 13 07:43:57.497919 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.497893 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-podinfo\") pod \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " Jul 13 07:43:57.498099 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.497925 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istiod-ca-cert\") pod \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " Jul 13 07:43:57.498099 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.497973 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgrc8\" (UniqueName: \"kubernetes.io/projected/12fa1e7c-a75a-4641-84e9-3f45e08e3394-kube-api-access-bgrc8\") pod \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " Jul 13 07:43:57.498099 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.498004 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-token\") pod \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " Jul 13 07:43:57.498099 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.498042 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-credential-socket\") pod \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " Jul 13 07:43:57.498099 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.498075 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-workload-socket\") pod \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\" (UID: \"12fa1e7c-a75a-4641-84e9-3f45e08e3394\") " Jul 13 07:43:57.498099 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.498089 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "12fa1e7c-a75a-4641-84e9-3f45e08e3394" (UID: "12fa1e7c-a75a-4641-84e9-3f45e08e3394"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:43:57.498410 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.498391 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-workload-certs\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:43:57.498477 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.498454 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "12fa1e7c-a75a-4641-84e9-3f45e08e3394" (UID: "12fa1e7c-a75a-4641-84e9-3f45e08e3394"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:43:57.498543 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.498475 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "12fa1e7c-a75a-4641-84e9-3f45e08e3394" (UID: "12fa1e7c-a75a-4641-84e9-3f45e08e3394"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:43:57.498604 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.498572 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "12fa1e7c-a75a-4641-84e9-3f45e08e3394" (UID: "12fa1e7c-a75a-4641-84e9-3f45e08e3394"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:43:57.499187 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.499161 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-data" (OuterVolumeSpecName: "istio-data") pod "12fa1e7c-a75a-4641-84e9-3f45e08e3394" (UID: "12fa1e7c-a75a-4641-84e9-3f45e08e3394"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:43:57.500183 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.500160 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "12fa1e7c-a75a-4641-84e9-3f45e08e3394" (UID: "12fa1e7c-a75a-4641-84e9-3f45e08e3394"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:43:57.500276 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.500225 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-token" (OuterVolumeSpecName: "istio-token") pod "12fa1e7c-a75a-4641-84e9-3f45e08e3394" (UID: "12fa1e7c-a75a-4641-84e9-3f45e08e3394"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:43:57.500276 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.500255 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12fa1e7c-a75a-4641-84e9-3f45e08e3394-kube-api-access-bgrc8" (OuterVolumeSpecName: "kube-api-access-bgrc8") pod "12fa1e7c-a75a-4641-84e9-3f45e08e3394" (UID: "12fa1e7c-a75a-4641-84e9-3f45e08e3394"). InnerVolumeSpecName "kube-api-access-bgrc8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:43:57.500444 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.500423 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "12fa1e7c-a75a-4641-84e9-3f45e08e3394" (UID: "12fa1e7c-a75a-4641-84e9-3f45e08e3394"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 07:43:57.599463 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.599423 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-data\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:43:57.599463 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.599454 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-envoy\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:43:57.599463 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.599463 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-podinfo\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:43:57.599463 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.599472 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istiod-ca-cert\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:43:57.599738 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.599481 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgrc8\" (UniqueName: \"kubernetes.io/projected/12fa1e7c-a75a-4641-84e9-3f45e08e3394-kube-api-access-bgrc8\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:43:57.599738 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.599491 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12fa1e7c-a75a-4641-84e9-3f45e08e3394-istio-token\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:43:57.599738 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.599499 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-credential-socket\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:43:57.599738 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.599507 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12fa1e7c-a75a-4641-84e9-3f45e08e3394-workload-socket\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:43:57.790194 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.790158 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5"] Jul 13 07:43:57.795766 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:57.795741 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-6d9a89-openshift-default-58dc88769-l2jm5"] Jul 13 07:43:58.235300 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:58.235272 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:58.355367 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:58.355293 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:58.467121 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:58.467088 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:58.649054 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:58.648961 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:58.937334 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:58.937232 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:59.038530 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:59.038497 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:43:59.640534 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:43:59.640493 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12fa1e7c-a75a-4641-84e9-3f45e08e3394" path="/var/lib/kubelet/pods/12fa1e7c-a75a-4641-84e9-3f45e08e3394/volumes" Jul 13 07:44:02.752987 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:02.752951 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:03.212212 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.212127 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:03.505094 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.504879 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc"] Jul 13 07:44:03.505543 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.505520 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12fa1e7c-a75a-4641-84e9-3f45e08e3394" containerName="istio-proxy" Jul 13 07:44:03.505543 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.505542 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="12fa1e7c-a75a-4641-84e9-3f45e08e3394" containerName="istio-proxy" Jul 13 07:44:03.505763 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.505580 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcd79183-fe1f-4806-82af-4da86a0f7e8e" containerName="istio-proxy" Jul 13 07:44:03.505763 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.505589 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcd79183-fe1f-4806-82af-4da86a0f7e8e" containerName="istio-proxy" Jul 13 07:44:03.505763 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.505599 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcd79183-fe1f-4806-82af-4da86a0f7e8e" containerName="istio-proxy" Jul 13 07:44:03.505763 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.505607 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcd79183-fe1f-4806-82af-4da86a0f7e8e" containerName="istio-proxy" Jul 13 07:44:03.505763 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.505684 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcd79183-fe1f-4806-82af-4da86a0f7e8e" containerName="istio-proxy" Jul 13 07:44:03.505763 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.505702 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="12fa1e7c-a75a-4641-84e9-3f45e08e3394" containerName="istio-proxy" Jul 13 07:44:03.505763 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.505712 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="12fa1e7c-a75a-4641-84e9-3f45e08e3394" containerName="istio-proxy" Jul 13 07:44:03.509058 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.509035 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.512929 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.512908 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-464dbd-openshift-default-dockercfg-tv667\"" Jul 13 07:44:03.521176 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.521154 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc"] Jul 13 07:44:03.531920 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.531889 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:03.651722 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.651691 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-data\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.651892 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.651736 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-workload-certs\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.651892 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.651799 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-token\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.651892 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.651830 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62jx7\" (UniqueName: \"kubernetes.io/projected/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-kube-api-access-62jx7\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.652004 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.651897 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-podinfo\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.652004 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.651954 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-workload-socket\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.652073 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.652003 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-credential-socket\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.652073 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.652029 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istiod-ca-cert\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.652139 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.652100 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-envoy\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.752913 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.752880 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-envoy\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.753117 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.752926 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-data\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.753117 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.752967 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-workload-certs\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.753117 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.753030 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-token\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.753117 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.753065 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62jx7\" (UniqueName: \"kubernetes.io/projected/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-kube-api-access-62jx7\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.753117 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.753088 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-podinfo\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.753117 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.753116 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-workload-socket\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.753737 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.753162 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-credential-socket\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.753737 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.753188 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istiod-ca-cert\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.753737 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.753396 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-workload-certs\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.753737 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.753426 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-data\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.754294 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.753886 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-workload-socket\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.754413 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.754389 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istiod-ca-cert\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.755181 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.755109 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-credential-socket\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.755657 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.755622 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-envoy\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.756206 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.756185 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-podinfo\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.763503 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.763485 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62jx7\" (UniqueName: \"kubernetes.io/projected/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-kube-api-access-62jx7\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.764851 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.764827 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-token\") pod \"e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.820151 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.820125 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:03.970298 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.970272 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc"] Jul 13 07:44:03.972874 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:44:03.972840 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0b23cef_ead1_49d7_8e7d_91e2bb5196a8.slice/crio-2ba37497733855dc3d8b3425623e8ac613dea92a2527c21612f65d81e7fa3867 WatchSource:0}: Error finding container 2ba37497733855dc3d8b3425623e8ac613dea92a2527c21612f65d81e7fa3867: Status 404 returned error can't find the container with id 2ba37497733855dc3d8b3425623e8ac613dea92a2527c21612f65d81e7fa3867 Jul 13 07:44:03.975157 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.975114 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:44:03.975245 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.975207 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:44:03.975285 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.975254 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:44:03.983987 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:03.983962 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:04.513858 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:04.513829 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" event={"ID":"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8","Type":"ContainerStarted","Data":"6f5a2414445b4c82e1bba494e92cd14ca9362d23f6eebfbf79af8f6ce51844c9"} Jul 13 07:44:04.514029 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:04.513878 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" event={"ID":"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8","Type":"ContainerStarted","Data":"2ba37497733855dc3d8b3425623e8ac613dea92a2527c21612f65d81e7fa3867"} Jul 13 07:44:04.534455 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:04.534410 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" podStartSLOduration=1.534393862 podStartE2EDuration="1.534393862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:44:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:44:04.534199118 +0000 UTC m=+1921.456451291" watchObservedRunningTime="2026-07-13 07:44:04.534393862 +0000 UTC m=+1921.456646035" Jul 13 07:44:04.820683 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:04.820598 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:05.826072 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:05.826044 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:06.525642 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:06.525603 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:06.526663 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:06.526643 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:06.553658 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:06.553617 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:07.965664 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:07.965625 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:10.933940 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:10.933910 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:18.594506 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:18.594473 2565 generic.go:356] "Generic (PLEG): container finished" podID="b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" containerID="6f5a2414445b4c82e1bba494e92cd14ca9362d23f6eebfbf79af8f6ce51844c9" exitCode=0 Jul 13 07:44:18.595023 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:18.594550 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" event={"ID":"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8","Type":"ContainerDied","Data":"6f5a2414445b4c82e1bba494e92cd14ca9362d23f6eebfbf79af8f6ce51844c9"} Jul 13 07:44:18.595103 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:18.595028 2565 scope.go:117] "RemoveContainer" containerID="6f5a2414445b4c82e1bba494e92cd14ca9362d23f6eebfbf79af8f6ce51844c9" Jul 13 07:44:18.596019 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:18.595995 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:44:18.596092 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:18.596057 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:44:18.596092 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:18.596087 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:44:18.857137 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:18.857055 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:19.227900 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:19.227820 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:19.328846 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:19.328818 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:19.429151 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:19.429116 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:19.601677 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:19.601626 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:19.608844 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:19.608814 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" event={"ID":"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8","Type":"ContainerStarted","Data":"acf7ca2236d7374506da142707aceaf545892ceebd9e4ae777d4776413b4a459"} Jul 13 07:44:19.821053 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:19.821022 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:19.822233 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:19.822205 2565 patch_prober.go:28] interesting pod/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body= Jul 13 07:44:19.822393 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:19.822259 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" podUID="b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" Jul 13 07:44:20.820924 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:20.820892 2565 patch_prober.go:28] interesting pod/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body= Jul 13 07:44:20.821275 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:20.820940 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" podUID="b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" Jul 13 07:44:21.526128 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:21.526090 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:21.820532 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:21.820460 2565 patch_prober.go:28] interesting pod/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body= Jul 13 07:44:21.820532 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:21.820521 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" podUID="b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" Jul 13 07:44:22.821179 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:22.821150 2565 patch_prober.go:28] interesting pod/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body= Jul 13 07:44:22.821556 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:22.821201 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" podUID="b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" Jul 13 07:44:23.824513 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:23.824483 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:23.825360 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:23.825340 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:24.998130 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:24.998098 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:25.062297 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:25.062266 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:25.231136 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:25.231099 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:25.458689 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:25.458592 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:25.622890 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:25.622859 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:25.991420 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:25.991386 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:26.092330 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:26.092289 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:26.192788 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:26.192741 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:26.319668 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:26.319584 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:31.710015 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:31.709979 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:31.811747 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:31.811706 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:31.975971 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:31.975884 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc"] Jul 13 07:44:31.976165 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:31.976140 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" podUID="b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" containerName="istio-proxy" containerID="cri-o://acf7ca2236d7374506da142707aceaf545892ceebd9e4ae777d4776413b4a459" gracePeriod=30 Jul 13 07:44:31.992848 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:31.992807 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:32.198020 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.197980 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:32.517436 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.517393 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:32.768733 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.768642 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx"] Jul 13 07:44:32.769174 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.769031 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12fa1e7c-a75a-4641-84e9-3f45e08e3394" containerName="istio-proxy" Jul 13 07:44:32.769174 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.769045 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="12fa1e7c-a75a-4641-84e9-3f45e08e3394" containerName="istio-proxy" Jul 13 07:44:32.769174 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.769112 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcd79183-fe1f-4806-82af-4da86a0f7e8e" containerName="istio-proxy" Jul 13 07:44:32.771221 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.771205 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.773653 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.773632 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-db7d2d-openshift-default-dockercfg-hbd45\"" Jul 13 07:44:32.784180 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.784159 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx"] Jul 13 07:44:32.785640 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.785615 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:32.812641 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.812616 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-data\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.812745 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.812648 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9qvw\" (UniqueName: \"kubernetes.io/projected/e4bf14c8-060a-47ef-8363-cfcb445d255f-kube-api-access-d9qvw\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.812745 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.812695 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-podinfo\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.812745 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.812711 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-token\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.812882 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.812752 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-credential-socket\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.812882 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.812789 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-workload-socket\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.812882 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.812825 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-envoy\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.812882 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.812846 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4bf14c8-060a-47ef-8363-cfcb445d255f-istiod-ca-cert\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.812882 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.812877 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-workload-certs\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.914105 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.914073 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-podinfo\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.914105 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.914107 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-token\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.914409 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.914130 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-credential-socket\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.914409 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.914157 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-workload-socket\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.914409 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.914177 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-envoy\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.914409 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.914198 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4bf14c8-060a-47ef-8363-cfcb445d255f-istiod-ca-cert\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.914409 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.914244 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-workload-certs\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.914409 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.914354 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-data\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.914409 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.914380 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9qvw\" (UniqueName: \"kubernetes.io/projected/e4bf14c8-060a-47ef-8363-cfcb445d255f-kube-api-access-d9qvw\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.914797 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.914628 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-credential-socket\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.914797 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.914774 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-workload-certs\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.914901 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.914793 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-workload-socket\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.915073 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.915049 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-data\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.915171 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.915154 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4bf14c8-060a-47ef-8363-cfcb445d255f-istiod-ca-cert\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.916757 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.916735 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-envoy\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.916757 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.916754 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-podinfo\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.922181 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.922158 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-token\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:32.922359 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:32.922343 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9qvw\" (UniqueName: \"kubernetes.io/projected/e4bf14c8-060a-47ef-8363-cfcb445d255f-kube-api-access-d9qvw\") pod \"e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:33.082846 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:33.082765 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:33.124787 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:33.124754 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:33.224524 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:33.224497 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx"] Jul 13 07:44:33.226333 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:44:33.226289 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4bf14c8_060a_47ef_8363_cfcb445d255f.slice/crio-3182ee935e4557571d24921eb48bf0dd85888916ebb26706d811c015f7a1c772 WatchSource:0}: Error finding container 3182ee935e4557571d24921eb48bf0dd85888916ebb26706d811c015f7a1c772: Status 404 returned error can't find the container with id 3182ee935e4557571d24921eb48bf0dd85888916ebb26706d811c015f7a1c772 Jul 13 07:44:33.228466 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:33.228435 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:44:33.228578 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:33.228516 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:44:33.228578 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:33.228561 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:44:33.683389 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:33.683353 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" event={"ID":"e4bf14c8-060a-47ef-8363-cfcb445d255f","Type":"ContainerStarted","Data":"a6df2209823f7a45fa3e3fa4dc7d387fbcd1884f6ee7ee5f224f81b70afb16c0"} Jul 13 07:44:33.683602 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:33.683417 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" event={"ID":"e4bf14c8-060a-47ef-8363-cfcb445d255f","Type":"ContainerStarted","Data":"3182ee935e4557571d24921eb48bf0dd85888916ebb26706d811c015f7a1c772"} Jul 13 07:44:33.702596 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:33.702544 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" podStartSLOduration=1.702526362 podStartE2EDuration="1.702526362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:44:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:44:33.701963107 +0000 UTC m=+1950.624215280" watchObservedRunningTime="2026-07-13 07:44:33.702526362 +0000 UTC m=+1950.624778538" Jul 13 07:44:34.083722 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:34.083696 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:34.088982 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:34.088960 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:34.688548 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:34.688522 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:34.689521 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:34.689493 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:35.551571 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:35.551514 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:35.632599 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:35.632557 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:35.697703 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:35.697676 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:36.031466 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:36.031436 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:36.227163 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:36.227132 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:36.328087 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:36.327983 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:37.231983 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.231957 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:37.351671 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.351586 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-workload-certs\") pod \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " Jul 13 07:44:37.351671 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.351621 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-token\") pod \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " Jul 13 07:44:37.351671 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.351652 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-podinfo\") pod \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " Jul 13 07:44:37.351952 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.351689 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-credential-socket\") pod \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " Jul 13 07:44:37.351952 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.351756 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62jx7\" (UniqueName: \"kubernetes.io/projected/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-kube-api-access-62jx7\") pod \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " Jul 13 07:44:37.351952 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.351792 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istiod-ca-cert\") pod \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " Jul 13 07:44:37.351952 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.351815 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-envoy\") pod \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " Jul 13 07:44:37.351952 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.351867 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" (UID: "b0b23cef-ead1-49d7-8e7d-91e2bb5196a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:44:37.351952 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.351878 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-data\") pod \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " Jul 13 07:44:37.351952 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.351931 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-workload-socket\") pod \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\" (UID: \"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8\") " Jul 13 07:44:37.352304 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.352067 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" (UID: "b0b23cef-ead1-49d7-8e7d-91e2bb5196a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:44:37.352304 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.352270 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" (UID: "b0b23cef-ead1-49d7-8e7d-91e2bb5196a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:44:37.352304 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.352287 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" (UID: "b0b23cef-ead1-49d7-8e7d-91e2bb5196a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:44:37.352496 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.352358 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-workload-certs\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:44:37.352496 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.352379 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-credential-socket\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:44:37.352800 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.352779 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-data" (OuterVolumeSpecName: "istio-data") pod "b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" (UID: "b0b23cef-ead1-49d7-8e7d-91e2bb5196a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:44:37.353938 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.353913 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-kube-api-access-62jx7" (OuterVolumeSpecName: "kube-api-access-62jx7") pod "b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" (UID: "b0b23cef-ead1-49d7-8e7d-91e2bb5196a8"). InnerVolumeSpecName "kube-api-access-62jx7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:44:37.353938 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.353921 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" (UID: "b0b23cef-ead1-49d7-8e7d-91e2bb5196a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 07:44:37.354189 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.354170 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" (UID: "b0b23cef-ead1-49d7-8e7d-91e2bb5196a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:44:37.354418 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.354397 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" (UID: "b0b23cef-ead1-49d7-8e7d-91e2bb5196a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:44:37.453702 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.453675 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-data\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:44:37.453702 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.453701 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-workload-socket\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:44:37.453882 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.453712 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-token\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:44:37.453882 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.453720 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-podinfo\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:44:37.453882 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.453730 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62jx7\" (UniqueName: \"kubernetes.io/projected/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-kube-api-access-62jx7\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:44:37.453882 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.453738 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istiod-ca-cert\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:44:37.453882 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.453746 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8-istio-envoy\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:44:37.706290 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.706257 2565 generic.go:356] "Generic (PLEG): container finished" podID="b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" containerID="acf7ca2236d7374506da142707aceaf545892ceebd9e4ae777d4776413b4a459" exitCode=0 Jul 13 07:44:37.706471 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.706301 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" Jul 13 07:44:37.706471 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.706354 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" event={"ID":"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8","Type":"ContainerDied","Data":"acf7ca2236d7374506da142707aceaf545892ceebd9e4ae777d4776413b4a459"} Jul 13 07:44:37.706471 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.706405 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc" event={"ID":"b0b23cef-ead1-49d7-8e7d-91e2bb5196a8","Type":"ContainerDied","Data":"2ba37497733855dc3d8b3425623e8ac613dea92a2527c21612f65d81e7fa3867"} Jul 13 07:44:37.706471 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.706427 2565 scope.go:117] "RemoveContainer" containerID="acf7ca2236d7374506da142707aceaf545892ceebd9e4ae777d4776413b4a459" Jul 13 07:44:37.715771 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.715755 2565 scope.go:117] "RemoveContainer" containerID="6f5a2414445b4c82e1bba494e92cd14ca9362d23f6eebfbf79af8f6ce51844c9" Jul 13 07:44:37.723709 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.723673 2565 scope.go:117] "RemoveContainer" containerID="acf7ca2236d7374506da142707aceaf545892ceebd9e4ae777d4776413b4a459" Jul 13 07:44:37.723994 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:44:37.723970 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acf7ca2236d7374506da142707aceaf545892ceebd9e4ae777d4776413b4a459\": container with ID starting with acf7ca2236d7374506da142707aceaf545892ceebd9e4ae777d4776413b4a459 not found: ID does not exist" containerID="acf7ca2236d7374506da142707aceaf545892ceebd9e4ae777d4776413b4a459" Jul 13 07:44:37.723994 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.723999 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acf7ca2236d7374506da142707aceaf545892ceebd9e4ae777d4776413b4a459"} err="failed to get container status \"acf7ca2236d7374506da142707aceaf545892ceebd9e4ae777d4776413b4a459\": rpc error: code = NotFound desc = could not find container \"acf7ca2236d7374506da142707aceaf545892ceebd9e4ae777d4776413b4a459\": container with ID starting with acf7ca2236d7374506da142707aceaf545892ceebd9e4ae777d4776413b4a459 not found: ID does not exist" Jul 13 07:44:37.724164 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.724017 2565 scope.go:117] "RemoveContainer" containerID="6f5a2414445b4c82e1bba494e92cd14ca9362d23f6eebfbf79af8f6ce51844c9" Jul 13 07:44:37.724331 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:44:37.724290 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f5a2414445b4c82e1bba494e92cd14ca9362d23f6eebfbf79af8f6ce51844c9\": container with ID starting with 6f5a2414445b4c82e1bba494e92cd14ca9362d23f6eebfbf79af8f6ce51844c9 not found: ID does not exist" containerID="6f5a2414445b4c82e1bba494e92cd14ca9362d23f6eebfbf79af8f6ce51844c9" Jul 13 07:44:37.724438 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.724337 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f5a2414445b4c82e1bba494e92cd14ca9362d23f6eebfbf79af8f6ce51844c9"} err="failed to get container status \"6f5a2414445b4c82e1bba494e92cd14ca9362d23f6eebfbf79af8f6ce51844c9\": rpc error: code = NotFound desc = could not find container \"6f5a2414445b4c82e1bba494e92cd14ca9362d23f6eebfbf79af8f6ce51844c9\": container with ID starting with 6f5a2414445b4c82e1bba494e92cd14ca9362d23f6eebfbf79af8f6ce51844c9 not found: ID does not exist" Jul 13 07:44:37.726279 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.726262 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc"] Jul 13 07:44:37.730708 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:37.730678 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-464dbd-openshift-default-d47ffd5b9-h8hzc"] Jul 13 07:44:39.640395 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:39.640363 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" path="/var/lib/kubelet/pods/b0b23cef-ead1-49d7-8e7d-91e2bb5196a8/volumes" Jul 13 07:44:40.028039 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:40.028007 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:40.358840 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:40.358759 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:40.652069 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:40.651994 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:40.756452 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:40.756425 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:43.555018 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:43.554986 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:43.677335 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:43.676762 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:43.785968 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:43.785932 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:44.037802 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:44.037774 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:44.144591 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:44.144555 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:44.251000 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:44.250954 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:47.946943 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:47.946908 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:48.765982 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:48.765947 2565 generic.go:356] "Generic (PLEG): container finished" podID="e4bf14c8-060a-47ef-8363-cfcb445d255f" containerID="a6df2209823f7a45fa3e3fa4dc7d387fbcd1884f6ee7ee5f224f81b70afb16c0" exitCode=0 Jul 13 07:44:48.766179 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:48.766021 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" event={"ID":"e4bf14c8-060a-47ef-8363-cfcb445d255f","Type":"ContainerDied","Data":"a6df2209823f7a45fa3e3fa4dc7d387fbcd1884f6ee7ee5f224f81b70afb16c0"} Jul 13 07:44:48.766469 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:48.766453 2565 scope.go:117] "RemoveContainer" containerID="a6df2209823f7a45fa3e3fa4dc7d387fbcd1884f6ee7ee5f224f81b70afb16c0" Jul 13 07:44:48.767585 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:48.767557 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:44:48.767705 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:48.767640 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:44:48.767772 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:48.767726 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 13 07:44:49.689425 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:49.689383 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:49.776409 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:49.776367 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" event={"ID":"e4bf14c8-060a-47ef-8363-cfcb445d255f","Type":"ContainerStarted","Data":"877a5ddf4f07257eb0b17aa85346a21f54c7465da75ecef43d14dec0d04f335d"} Jul 13 07:44:50.085182 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:50.085151 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:50.085465 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:50.085438 2565 patch_prober.go:28] interesting pod/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Jul 13 07:44:50.085693 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:50.085665 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" podUID="e4bf14c8-060a-47ef-8363-cfcb445d255f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Jul 13 07:44:51.083662 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:51.083624 2565 patch_prober.go:28] interesting pod/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Jul 13 07:44:51.084240 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:51.084205 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" podUID="e4bf14c8-060a-47ef-8363-cfcb445d255f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Jul 13 07:44:52.083754 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:52.083294 2565 patch_prober.go:28] interesting pod/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Jul 13 07:44:52.083754 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:52.083377 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" podUID="e4bf14c8-060a-47ef-8363-cfcb445d255f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Jul 13 07:44:53.084172 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:53.084137 2565 patch_prober.go:28] interesting pod/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Jul 13 07:44:53.084732 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:53.084695 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" podUID="e4bf14c8-060a-47ef-8363-cfcb445d255f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Jul 13 07:44:54.087277 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:54.087245 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:54.087779 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:54.087634 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:54.088402 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:54.088383 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:44:57.967591 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:57.967499 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:44:58.069374 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:44:58.069335 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:45:00.137397 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.137364 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-da56f9-29732145-rtvkm"] Jul 13 07:45:00.137768 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.137729 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" containerName="istio-proxy" Jul 13 07:45:00.137768 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.137740 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" containerName="istio-proxy" Jul 13 07:45:00.137768 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.137752 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" containerName="istio-proxy" Jul 13 07:45:00.137768 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.137758 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" containerName="istio-proxy" Jul 13 07:45:00.137911 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.137807 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" containerName="istio-proxy" Jul 13 07:45:00.137911 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.137816 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0b23cef-ead1-49d7-8e7d-91e2bb5196a8" containerName="istio-proxy" Jul 13 07:45:00.140476 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.140456 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-da56f9-29732145-rtvkm" Jul 13 07:45:00.140793 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.140780 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29732145-44qzq"] Jul 13 07:45:00.143029 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.143005 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29732145-44qzq" Jul 13 07:45:00.143167 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.143146 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-svhmf\"" Jul 13 07:45:00.143243 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.143178 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-db7d2d-29732145-g95bs"] Jul 13 07:45:00.145444 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.145428 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-db7d2d-29732145-g95bs" Jul 13 07:45:00.150101 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.150081 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-da56f9-29732145-rtvkm"] Jul 13 07:45:00.154950 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.154931 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29732145-44qzq"] Jul 13 07:45:00.164676 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.164656 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-db7d2d-29732145-g95bs"] Jul 13 07:45:00.262241 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.262207 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnwjc\" (UniqueName: \"kubernetes.io/projected/7d601ab6-4d54-488e-b816-0bd293a31e79-kube-api-access-nnwjc\") pod \"maas-api-key-cleanup-e2e-shared-a-db7d2d-29732145-g95bs\" (UID: \"7d601ab6-4d54-488e-b816-0bd293a31e79\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-db7d2d-29732145-g95bs" Jul 13 07:45:00.262433 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.262251 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzs5h\" (UniqueName: \"kubernetes.io/projected/c00f2c05-4e15-4a9e-8e7b-680682c92d77-kube-api-access-vzs5h\") pod \"maas-api-key-cleanup-e2e-shared-b-da56f9-29732145-rtvkm\" (UID: \"c00f2c05-4e15-4a9e-8e7b-680682c92d77\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-da56f9-29732145-rtvkm" Jul 13 07:45:00.262433 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.262377 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrwpp\" (UniqueName: \"kubernetes.io/projected/1097b364-5e04-4eb3-bc1a-d5ee694d11e9-kube-api-access-zrwpp\") pod \"maas-api-key-cleanup-29732145-44qzq\" (UID: \"1097b364-5e04-4eb3-bc1a-d5ee694d11e9\") " pod="opendatahub/maas-api-key-cleanup-29732145-44qzq" Jul 13 07:45:00.363539 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.363502 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnwjc\" (UniqueName: \"kubernetes.io/projected/7d601ab6-4d54-488e-b816-0bd293a31e79-kube-api-access-nnwjc\") pod \"maas-api-key-cleanup-e2e-shared-a-db7d2d-29732145-g95bs\" (UID: \"7d601ab6-4d54-488e-b816-0bd293a31e79\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-db7d2d-29732145-g95bs" Jul 13 07:45:00.363683 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.363550 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzs5h\" (UniqueName: \"kubernetes.io/projected/c00f2c05-4e15-4a9e-8e7b-680682c92d77-kube-api-access-vzs5h\") pod \"maas-api-key-cleanup-e2e-shared-b-da56f9-29732145-rtvkm\" (UID: \"c00f2c05-4e15-4a9e-8e7b-680682c92d77\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-da56f9-29732145-rtvkm" Jul 13 07:45:00.363683 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.363626 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrwpp\" (UniqueName: \"kubernetes.io/projected/1097b364-5e04-4eb3-bc1a-d5ee694d11e9-kube-api-access-zrwpp\") pod \"maas-api-key-cleanup-29732145-44qzq\" (UID: \"1097b364-5e04-4eb3-bc1a-d5ee694d11e9\") " pod="opendatahub/maas-api-key-cleanup-29732145-44qzq" Jul 13 07:45:00.372836 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.372805 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnwjc\" (UniqueName: \"kubernetes.io/projected/7d601ab6-4d54-488e-b816-0bd293a31e79-kube-api-access-nnwjc\") pod \"maas-api-key-cleanup-e2e-shared-a-db7d2d-29732145-g95bs\" (UID: \"7d601ab6-4d54-488e-b816-0bd293a31e79\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-db7d2d-29732145-g95bs" Jul 13 07:45:00.372949 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.372908 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzs5h\" (UniqueName: \"kubernetes.io/projected/c00f2c05-4e15-4a9e-8e7b-680682c92d77-kube-api-access-vzs5h\") pod \"maas-api-key-cleanup-e2e-shared-b-da56f9-29732145-rtvkm\" (UID: \"c00f2c05-4e15-4a9e-8e7b-680682c92d77\") " pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-da56f9-29732145-rtvkm" Jul 13 07:45:00.372949 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.372916 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrwpp\" (UniqueName: \"kubernetes.io/projected/1097b364-5e04-4eb3-bc1a-d5ee694d11e9-kube-api-access-zrwpp\") pod \"maas-api-key-cleanup-29732145-44qzq\" (UID: \"1097b364-5e04-4eb3-bc1a-d5ee694d11e9\") " pod="opendatahub/maas-api-key-cleanup-29732145-44qzq" Jul 13 07:45:00.453693 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.453629 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-da56f9-29732145-rtvkm" Jul 13 07:45:00.462693 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.462658 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29732145-44qzq" Jul 13 07:45:00.471658 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.471636 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-db7d2d-29732145-g95bs" Jul 13 07:45:00.614987 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.614959 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29732145-44qzq"] Jul 13 07:45:00.616827 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:45:00.616799 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1097b364_5e04_4eb3_bc1a_d5ee694d11e9.slice/crio-55d761b226cdb6411e1d4765c3a70e921a087a0d5a75ff1fea4094fdae438446 WatchSource:0}: Error finding container 55d761b226cdb6411e1d4765c3a70e921a087a0d5a75ff1fea4094fdae438446: Status 404 returned error can't find the container with id 55d761b226cdb6411e1d4765c3a70e921a087a0d5a75ff1fea4094fdae438446 Jul 13 07:45:00.839748 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.839715 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29732145-44qzq" event={"ID":"1097b364-5e04-4eb3-bc1a-d5ee694d11e9","Type":"ContainerStarted","Data":"0e62f12cd5c6f97e576111299b9d513bdd8a8dece1c72fb080157862f9227673"} Jul 13 07:45:00.839898 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.839775 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29732145-44qzq" event={"ID":"1097b364-5e04-4eb3-bc1a-d5ee694d11e9","Type":"ContainerStarted","Data":"55d761b226cdb6411e1d4765c3a70e921a087a0d5a75ff1fea4094fdae438446"} Jul 13 07:45:00.849867 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.849834 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-da56f9-29732145-rtvkm"] Jul 13 07:45:00.850178 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:45:00.850142 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc00f2c05_4e15_4a9e_8e7b_680682c92d77.slice/crio-c75ffcfdd497307e13bcf1138784ae093718c93a23724bf07102a4d51f1a9072 WatchSource:0}: Error finding container c75ffcfdd497307e13bcf1138784ae093718c93a23724bf07102a4d51f1a9072: Status 404 returned error can't find the container with id c75ffcfdd497307e13bcf1138784ae093718c93a23724bf07102a4d51f1a9072 Jul 13 07:45:00.864138 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.864092 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29732145-44qzq" podStartSLOduration=0.864072677 podStartE2EDuration="864.072677ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:45:00.861960437 +0000 UTC m=+1977.784212611" watchObservedRunningTime="2026-07-13 07:45:00.864072677 +0000 UTC m=+1977.786324853" Jul 13 07:45:00.886022 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:00.886003 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-db7d2d-29732145-g95bs"] Jul 13 07:45:00.887537 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:45:00.887514 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d601ab6_4d54_488e_b816_0bd293a31e79.slice/crio-e5a3de4785e044ab13360813381473cd86c2f79d18153229954588d67e1b623b WatchSource:0}: Error finding container e5a3de4785e044ab13360813381473cd86c2f79d18153229954588d67e1b623b: Status 404 returned error can't find the container with id e5a3de4785e044ab13360813381473cd86c2f79d18153229954588d67e1b623b Jul 13 07:45:01.846485 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:01.846446 2565 generic.go:356] "Generic (PLEG): container finished" podID="1097b364-5e04-4eb3-bc1a-d5ee694d11e9" containerID="0e62f12cd5c6f97e576111299b9d513bdd8a8dece1c72fb080157862f9227673" exitCode=0 Jul 13 07:45:01.846899 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:01.846489 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29732145-44qzq" event={"ID":"1097b364-5e04-4eb3-bc1a-d5ee694d11e9","Type":"ContainerDied","Data":"0e62f12cd5c6f97e576111299b9d513bdd8a8dece1c72fb080157862f9227673"} Jul 13 07:45:01.848217 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:01.848190 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-da56f9-29732145-rtvkm" event={"ID":"c00f2c05-4e15-4a9e-8e7b-680682c92d77","Type":"ContainerStarted","Data":"977964cb31a5a15a0bef8436995d1bab1910c8833a4160b77e1676279a57a139"} Jul 13 07:45:01.848354 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:01.848230 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-da56f9-29732145-rtvkm" event={"ID":"c00f2c05-4e15-4a9e-8e7b-680682c92d77","Type":"ContainerStarted","Data":"c75ffcfdd497307e13bcf1138784ae093718c93a23724bf07102a4d51f1a9072"} Jul 13 07:45:01.849608 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:01.849590 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-db7d2d-29732145-g95bs" event={"ID":"7d601ab6-4d54-488e-b816-0bd293a31e79","Type":"ContainerStarted","Data":"9f2ff51216892ed3895b9ec91ffd94e63e124a34e189f087334375108b6a6a8c"} Jul 13 07:45:01.849691 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:01.849631 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-db7d2d-29732145-g95bs" event={"ID":"7d601ab6-4d54-488e-b816-0bd293a31e79","Type":"ContainerStarted","Data":"e5a3de4785e044ab13360813381473cd86c2f79d18153229954588d67e1b623b"} Jul 13 07:45:01.879065 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:01.879022 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-da56f9-29732145-rtvkm" podStartSLOduration=1.879010302 podStartE2EDuration="1.879010302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:45:01.877656754 +0000 UTC m=+1978.799908938" watchObservedRunningTime="2026-07-13 07:45:01.879010302 +0000 UTC m=+1978.801262525" Jul 13 07:45:01.893096 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:01.893058 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-db7d2d-29732145-g95bs" podStartSLOduration=1.8930474309999998 podStartE2EDuration="1.893047431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-13 07:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:45:01.8920154 +0000 UTC m=+1978.814267573" watchObservedRunningTime="2026-07-13 07:45:01.893047431 +0000 UTC m=+1978.815299657" Jul 13 07:45:02.855949 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:02.855915 2565 generic.go:356] "Generic (PLEG): container finished" podID="c00f2c05-4e15-4a9e-8e7b-680682c92d77" containerID="977964cb31a5a15a0bef8436995d1bab1910c8833a4160b77e1676279a57a139" exitCode=0 Jul 13 07:45:02.856404 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:02.855967 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-da56f9-29732145-rtvkm" event={"ID":"c00f2c05-4e15-4a9e-8e7b-680682c92d77","Type":"ContainerDied","Data":"977964cb31a5a15a0bef8436995d1bab1910c8833a4160b77e1676279a57a139"} Jul 13 07:45:02.857604 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:02.857576 2565 generic.go:356] "Generic (PLEG): container finished" podID="7d601ab6-4d54-488e-b816-0bd293a31e79" containerID="9f2ff51216892ed3895b9ec91ffd94e63e124a34e189f087334375108b6a6a8c" exitCode=0 Jul 13 07:45:02.857738 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:02.857646 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-db7d2d-29732145-g95bs" event={"ID":"7d601ab6-4d54-488e-b816-0bd293a31e79","Type":"ContainerDied","Data":"9f2ff51216892ed3895b9ec91ffd94e63e124a34e189f087334375108b6a6a8c"} Jul 13 07:45:02.996735 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:02.996713 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29732145-44qzq" Jul 13 07:45:03.086921 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:03.086894 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrwpp\" (UniqueName: \"kubernetes.io/projected/1097b364-5e04-4eb3-bc1a-d5ee694d11e9-kube-api-access-zrwpp\") pod \"1097b364-5e04-4eb3-bc1a-d5ee694d11e9\" (UID: \"1097b364-5e04-4eb3-bc1a-d5ee694d11e9\") " Jul 13 07:45:03.088915 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:03.088890 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1097b364-5e04-4eb3-bc1a-d5ee694d11e9-kube-api-access-zrwpp" (OuterVolumeSpecName: "kube-api-access-zrwpp") pod "1097b364-5e04-4eb3-bc1a-d5ee694d11e9" (UID: "1097b364-5e04-4eb3-bc1a-d5ee694d11e9"). InnerVolumeSpecName "kube-api-access-zrwpp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:45:03.188349 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:03.188250 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrwpp\" (UniqueName: \"kubernetes.io/projected/1097b364-5e04-4eb3-bc1a-d5ee694d11e9-kube-api-access-zrwpp\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:45:03.864228 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:03.864195 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29732145-44qzq" event={"ID":"1097b364-5e04-4eb3-bc1a-d5ee694d11e9","Type":"ContainerDied","Data":"55d761b226cdb6411e1d4765c3a70e921a087a0d5a75ff1fea4094fdae438446"} Jul 13 07:45:03.864646 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:03.864234 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29732145-44qzq" Jul 13 07:45:03.864646 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:03.864254 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55d761b226cdb6411e1d4765c3a70e921a087a0d5a75ff1fea4094fdae438446" Jul 13 07:45:04.009704 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:04.009682 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-da56f9-29732145-rtvkm" Jul 13 07:45:04.025455 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:04.025436 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-db7d2d-29732145-g95bs" Jul 13 07:45:04.095883 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:04.095858 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzs5h\" (UniqueName: \"kubernetes.io/projected/c00f2c05-4e15-4a9e-8e7b-680682c92d77-kube-api-access-vzs5h\") pod \"c00f2c05-4e15-4a9e-8e7b-680682c92d77\" (UID: \"c00f2c05-4e15-4a9e-8e7b-680682c92d77\") " Jul 13 07:45:04.097905 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:04.097875 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c00f2c05-4e15-4a9e-8e7b-680682c92d77-kube-api-access-vzs5h" (OuterVolumeSpecName: "kube-api-access-vzs5h") pod "c00f2c05-4e15-4a9e-8e7b-680682c92d77" (UID: "c00f2c05-4e15-4a9e-8e7b-680682c92d77"). InnerVolumeSpecName "kube-api-access-vzs5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:45:04.196289 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:04.196232 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nnwjc\" (UniqueName: \"kubernetes.io/projected/7d601ab6-4d54-488e-b816-0bd293a31e79-kube-api-access-nnwjc\") pod \"7d601ab6-4d54-488e-b816-0bd293a31e79\" (UID: \"7d601ab6-4d54-488e-b816-0bd293a31e79\") " Jul 13 07:45:04.196497 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:04.196480 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzs5h\" (UniqueName: \"kubernetes.io/projected/c00f2c05-4e15-4a9e-8e7b-680682c92d77-kube-api-access-vzs5h\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:45:04.198105 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:04.198082 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d601ab6-4d54-488e-b816-0bd293a31e79-kube-api-access-nnwjc" (OuterVolumeSpecName: "kube-api-access-nnwjc") pod "7d601ab6-4d54-488e-b816-0bd293a31e79" (UID: "7d601ab6-4d54-488e-b816-0bd293a31e79"). InnerVolumeSpecName "kube-api-access-nnwjc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:45:04.297330 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:04.297289 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nnwjc\" (UniqueName: \"kubernetes.io/projected/7d601ab6-4d54-488e-b816-0bd293a31e79-kube-api-access-nnwjc\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:45:04.870640 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:04.870613 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-da56f9-29732145-rtvkm" Jul 13 07:45:04.871015 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:04.870650 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-b-da56f9-29732145-rtvkm" event={"ID":"c00f2c05-4e15-4a9e-8e7b-680682c92d77","Type":"ContainerDied","Data":"c75ffcfdd497307e13bcf1138784ae093718c93a23724bf07102a4d51f1a9072"} Jul 13 07:45:04.871015 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:04.870709 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c75ffcfdd497307e13bcf1138784ae093718c93a23724bf07102a4d51f1a9072" Jul 13 07:45:04.872065 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:04.872043 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-db7d2d-29732145-g95bs" event={"ID":"7d601ab6-4d54-488e-b816-0bd293a31e79","Type":"ContainerDied","Data":"e5a3de4785e044ab13360813381473cd86c2f79d18153229954588d67e1b623b"} Jul 13 07:45:04.872195 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:04.872086 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5a3de4785e044ab13360813381473cd86c2f79d18153229954588d67e1b623b" Jul 13 07:45:04.872195 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:04.872049 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-e2e-shared-a-db7d2d-29732145-g95bs" Jul 13 07:45:05.056429 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:05.056401 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:45:05.150439 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:05.150361 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:45:06.965881 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:06.965847 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:45:07.064552 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:07.064499 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:45:07.851335 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:07.851281 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:45:51.155539 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:45:51.155497 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:47:38.923694 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:47:38.923661 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:47:39.841083 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:47:39.841051 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:47:50.180470 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:47:50.180429 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:47:52.443864 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:47:52.443812 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:47:52.532694 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:47:52.532654 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:47:57.018997 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:47:57.018919 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:48:08.834989 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:48:08.834953 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:48:20.556337 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:48:20.556277 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:48:32.446463 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:48:32.446430 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:48:37.083422 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:48:37.083384 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:49:01.285410 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:49:01.285373 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:49:02.218671 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:49:02.218639 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:49:09.266679 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:49:09.266641 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:49:21.140835 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:49:21.140777 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:49:21.240978 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:49:21.240944 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:49:32.858640 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:49:32.858517 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:49:58.919878 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:49:58.919838 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:49:59.027666 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:49:59.027632 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:50:05.913513 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:50:05.913467 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:50:06.013093 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:50:06.013062 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:50:07.744870 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:50:07.744833 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:50:07.854073 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:50:07.854037 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:50:15.803528 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:50:15.803495 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:50:16.776303 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:50:16.776265 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:50:17.865112 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:50:17.865083 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:50:18.215727 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:50:18.215640 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:50:18.317978 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:50:18.317927 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:50:18.417893 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:50:18.417860 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:50:18.528046 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:50:18.528014 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:50:18.533939 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:50:18.533912 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-db7d2d-29732145-g95bs"] Jul 13 07:50:18.536027 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:50:18.536008 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-a-db7d2d-29732145-g95bs"] Jul 13 07:50:19.639472 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:50:19.639435 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d601ab6-4d54-488e-b816-0bd293a31e79" path="/var/lib/kubelet/pods/7d601ab6-4d54-488e-b816-0bd293a31e79/volumes" Jul 13 07:50:23.298604 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:50:23.298567 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:51:00.803441 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:00.803360 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:51:01.062012 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:01.061916 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx"] Jul 13 07:51:01.062180 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:01.062142 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" podUID="e4bf14c8-060a-47ef-8363-cfcb445d255f" containerName="istio-proxy" containerID="cri-o://877a5ddf4f07257eb0b17aa85346a21f54c7465da75ecef43d14dec0d04f335d" gracePeriod=30 Jul 13 07:51:01.074078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:01.074045 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:51:01.303922 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:01.303889 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:51:01.471959 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:01.471868 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:51:01.888383 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:01.888352 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:51:01.992672 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:01.992640 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:51:02.093378 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:02.093345 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:51:02.227637 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:02.227555 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:51:02.229373 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:02.229351 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-da56f9-29732145-rtvkm"] Jul 13 07:51:02.233967 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:02.233943 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-key-cleanup-e2e-shared-b-da56f9-29732145-rtvkm"] Jul 13 07:51:03.640064 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:03.640033 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c00f2c05-4e15-4a9e-8e7b-680682c92d77" path="/var/lib/kubelet/pods/c00f2c05-4e15-4a9e-8e7b-680682c92d77/volumes" Jul 13 07:51:03.821169 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:03.821142 2565 scope.go:117] "RemoveContainer" containerID="9f2ff51216892ed3895b9ec91ffd94e63e124a34e189f087334375108b6a6a8c" Jul 13 07:51:03.829948 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:03.829928 2565 scope.go:117] "RemoveContainer" containerID="977964cb31a5a15a0bef8436995d1bab1910c8833a4160b77e1676279a57a139" Jul 13 07:51:06.723897 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.723874 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:51:06.806866 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.806831 2565 generic.go:356] "Generic (PLEG): container finished" podID="e4bf14c8-060a-47ef-8363-cfcb445d255f" containerID="877a5ddf4f07257eb0b17aa85346a21f54c7465da75ecef43d14dec0d04f335d" exitCode=0 Jul 13 07:51:06.807032 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.806881 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" Jul 13 07:51:06.807032 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.806910 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" event={"ID":"e4bf14c8-060a-47ef-8363-cfcb445d255f","Type":"ContainerDied","Data":"877a5ddf4f07257eb0b17aa85346a21f54c7465da75ecef43d14dec0d04f335d"} Jul 13 07:51:06.807032 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.806966 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx" event={"ID":"e4bf14c8-060a-47ef-8363-cfcb445d255f","Type":"ContainerDied","Data":"3182ee935e4557571d24921eb48bf0dd85888916ebb26706d811c015f7a1c772"} Jul 13 07:51:06.807032 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.806987 2565 scope.go:117] "RemoveContainer" containerID="877a5ddf4f07257eb0b17aa85346a21f54c7465da75ecef43d14dec0d04f335d" Jul 13 07:51:06.813213 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.813189 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-data\") pod \"e4bf14c8-060a-47ef-8363-cfcb445d255f\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " Jul 13 07:51:06.813373 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.813249 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-credential-socket\") pod \"e4bf14c8-060a-47ef-8363-cfcb445d255f\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " Jul 13 07:51:06.813373 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.813274 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-workload-certs\") pod \"e4bf14c8-060a-47ef-8363-cfcb445d255f\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " Jul 13 07:51:06.813373 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.813352 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-podinfo\") pod \"e4bf14c8-060a-47ef-8363-cfcb445d255f\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " Jul 13 07:51:06.813553 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.813377 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-envoy\") pod \"e4bf14c8-060a-47ef-8363-cfcb445d255f\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " Jul 13 07:51:06.813553 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.813395 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4bf14c8-060a-47ef-8363-cfcb445d255f-istiod-ca-cert\") pod \"e4bf14c8-060a-47ef-8363-cfcb445d255f\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " Jul 13 07:51:06.813553 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.813429 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9qvw\" (UniqueName: \"kubernetes.io/projected/e4bf14c8-060a-47ef-8363-cfcb445d255f-kube-api-access-d9qvw\") pod \"e4bf14c8-060a-47ef-8363-cfcb445d255f\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " Jul 13 07:51:06.813553 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.813455 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-workload-socket\") pod \"e4bf14c8-060a-47ef-8363-cfcb445d255f\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " Jul 13 07:51:06.813553 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.813483 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-token\") pod \"e4bf14c8-060a-47ef-8363-cfcb445d255f\" (UID: \"e4bf14c8-060a-47ef-8363-cfcb445d255f\") " Jul 13 07:51:06.813553 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.813520 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e4bf14c8-060a-47ef-8363-cfcb445d255f" (UID: "e4bf14c8-060a-47ef-8363-cfcb445d255f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:51:06.813848 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.813720 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e4bf14c8-060a-47ef-8363-cfcb445d255f" (UID: "e4bf14c8-060a-47ef-8363-cfcb445d255f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:51:06.813848 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.813787 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-credential-socket\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:51:06.813962 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.813936 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e4bf14c8-060a-47ef-8363-cfcb445d255f" (UID: "e4bf14c8-060a-47ef-8363-cfcb445d255f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:51:06.814024 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.814001 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4bf14c8-060a-47ef-8363-cfcb445d255f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e4bf14c8-060a-47ef-8363-cfcb445d255f" (UID: "e4bf14c8-060a-47ef-8363-cfcb445d255f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 13 07:51:06.814175 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.814151 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-data" (OuterVolumeSpecName: "istio-data") pod "e4bf14c8-060a-47ef-8363-cfcb445d255f" (UID: "e4bf14c8-060a-47ef-8363-cfcb445d255f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:51:06.815894 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.815866 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4bf14c8-060a-47ef-8363-cfcb445d255f-kube-api-access-d9qvw" (OuterVolumeSpecName: "kube-api-access-d9qvw") pod "e4bf14c8-060a-47ef-8363-cfcb445d255f" (UID: "e4bf14c8-060a-47ef-8363-cfcb445d255f"). InnerVolumeSpecName "kube-api-access-d9qvw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:51:06.816019 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.815942 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e4bf14c8-060a-47ef-8363-cfcb445d255f" (UID: "e4bf14c8-060a-47ef-8363-cfcb445d255f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 13 07:51:06.816192 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.816160 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e4bf14c8-060a-47ef-8363-cfcb445d255f" (UID: "e4bf14c8-060a-47ef-8363-cfcb445d255f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 13 07:51:06.816307 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.816225 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-token" (OuterVolumeSpecName: "istio-token") pod "e4bf14c8-060a-47ef-8363-cfcb445d255f" (UID: "e4bf14c8-060a-47ef-8363-cfcb445d255f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 13 07:51:06.816931 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.816911 2565 scope.go:117] "RemoveContainer" containerID="a6df2209823f7a45fa3e3fa4dc7d387fbcd1884f6ee7ee5f224f81b70afb16c0" Jul 13 07:51:06.833466 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.833447 2565 scope.go:117] "RemoveContainer" containerID="877a5ddf4f07257eb0b17aa85346a21f54c7465da75ecef43d14dec0d04f335d" Jul 13 07:51:06.833728 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:51:06.833703 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"877a5ddf4f07257eb0b17aa85346a21f54c7465da75ecef43d14dec0d04f335d\": container with ID starting with 877a5ddf4f07257eb0b17aa85346a21f54c7465da75ecef43d14dec0d04f335d not found: ID does not exist" containerID="877a5ddf4f07257eb0b17aa85346a21f54c7465da75ecef43d14dec0d04f335d" Jul 13 07:51:06.833813 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.833744 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"877a5ddf4f07257eb0b17aa85346a21f54c7465da75ecef43d14dec0d04f335d"} err="failed to get container status \"877a5ddf4f07257eb0b17aa85346a21f54c7465da75ecef43d14dec0d04f335d\": rpc error: code = NotFound desc = could not find container \"877a5ddf4f07257eb0b17aa85346a21f54c7465da75ecef43d14dec0d04f335d\": container with ID starting with 877a5ddf4f07257eb0b17aa85346a21f54c7465da75ecef43d14dec0d04f335d not found: ID does not exist" Jul 13 07:51:06.833813 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.833762 2565 scope.go:117] "RemoveContainer" containerID="a6df2209823f7a45fa3e3fa4dc7d387fbcd1884f6ee7ee5f224f81b70afb16c0" Jul 13 07:51:06.834003 ip-10-0-141-197 kubenswrapper[2565]: E0713 07:51:06.833989 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6df2209823f7a45fa3e3fa4dc7d387fbcd1884f6ee7ee5f224f81b70afb16c0\": container with ID starting with a6df2209823f7a45fa3e3fa4dc7d387fbcd1884f6ee7ee5f224f81b70afb16c0 not found: ID does not exist" containerID="a6df2209823f7a45fa3e3fa4dc7d387fbcd1884f6ee7ee5f224f81b70afb16c0" Jul 13 07:51:06.834043 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.834007 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6df2209823f7a45fa3e3fa4dc7d387fbcd1884f6ee7ee5f224f81b70afb16c0"} err="failed to get container status \"a6df2209823f7a45fa3e3fa4dc7d387fbcd1884f6ee7ee5f224f81b70afb16c0\": rpc error: code = NotFound desc = could not find container \"a6df2209823f7a45fa3e3fa4dc7d387fbcd1884f6ee7ee5f224f81b70afb16c0\": container with ID starting with a6df2209823f7a45fa3e3fa4dc7d387fbcd1884f6ee7ee5f224f81b70afb16c0 not found: ID does not exist" Jul 13 07:51:06.914398 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.914366 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-data\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:51:06.914398 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.914394 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-workload-certs\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:51:06.914398 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.914402 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-podinfo\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:51:06.914630 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.914411 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-envoy\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:51:06.914630 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.914420 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4bf14c8-060a-47ef-8363-cfcb445d255f-istiod-ca-cert\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:51:06.914630 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.914428 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9qvw\" (UniqueName: \"kubernetes.io/projected/e4bf14c8-060a-47ef-8363-cfcb445d255f-kube-api-access-d9qvw\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:51:06.914630 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.914436 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4bf14c8-060a-47ef-8363-cfcb445d255f-workload-socket\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:51:06.914630 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:06.914445 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4bf14c8-060a-47ef-8363-cfcb445d255f-istio-token\") on node \"ip-10-0-141-197.ec2.internal\" DevicePath \"\"" Jul 13 07:51:07.133953 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:07.133920 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx"] Jul 13 07:51:07.141133 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:07.141105 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-db7d2d-openshift-default-b9bb7794c-fnktx"] Jul 13 07:51:07.639946 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:07.639905 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4bf14c8-060a-47ef-8363-cfcb445d255f" path="/var/lib/kubelet/pods/e4bf14c8-060a-47ef-8363-cfcb445d255f/volumes" Jul 13 07:51:07.834521 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:07.834491 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:51:07.946750 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:07.946668 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:51:08.211598 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:08.211511 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:51:08.425431 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:08.425395 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:51:08.836387 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:08.836357 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b98bdbfc-c9f8z_e5c6d326-3be0-4439-9977-5d2ca817f9ec/authorino/0.log" Jul 13 07:51:13.429177 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:13.429146 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-xgrh2_38ecc585-1619-4cab-919e-c391bcf32d2f/manager/0.log" Jul 13 07:51:13.562571 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:13.562544 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wmpzw_68a9f171-f008-4aac-b5bd-5685e65de3a3/manager/0.log" Jul 13 07:51:13.829664 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:13.829637 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29732130-n8b62_c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b/cleanup/0.log" Jul 13 07:51:13.935646 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:13.935614 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29732145-44qzq_1097b364-5e04-4eb3-bc1a-d5ee694d11e9/cleanup/0.log" Jul 13 07:51:14.194060 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:14.193970 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-mfsdb_1a8a2b9d-4cae-4c04-95ce-51fe2d029dcd/server/0.log" Jul 13 07:51:14.313837 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:14.313807 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-sngbb_ab07d64c-e94f-4a2b-bf28-16e619440df2/manager/0.log" Jul 13 07:51:14.707756 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:14.707730 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b4d7c976f-l7hc2_fb118592-97c7-43d9-8798-a99200ad855c/copy-manifests/0.log" Jul 13 07:51:14.720950 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:14.720919 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b4d7c976f-l7hc2_fb118592-97c7-43d9-8798-a99200ad855c/manager/0.log" Jul 13 07:51:14.846169 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:14.846138 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-bvtqp_4888ae0f-0a08-4695-ac70-b7ec8236ae17/postgres/0.log" Jul 13 07:51:15.628926 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:15.628898 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m_5626ff45-1355-4328-bd1e-902fe9565e51/util/0.log" Jul 13 07:51:15.635411 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:15.635384 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m_5626ff45-1355-4328-bd1e-902fe9565e51/pull/0.log" Jul 13 07:51:15.641880 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:15.641860 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m_5626ff45-1355-4328-bd1e-902fe9565e51/extract/0.log" Jul 13 07:51:15.756097 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:15.756068 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km_462db094-9794-4b22-8ca0-473068ed3c32/util/0.log" Jul 13 07:51:15.762600 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:15.762580 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km_462db094-9794-4b22-8ca0-473068ed3c32/pull/0.log" Jul 13 07:51:15.768562 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:15.768544 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km_462db094-9794-4b22-8ca0-473068ed3c32/extract/0.log" Jul 13 07:51:15.878773 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:15.878743 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb_302ee945-6eef-40ba-8378-adcba96f53f9/util/0.log" Jul 13 07:51:15.884942 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:15.884872 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb_302ee945-6eef-40ba-8378-adcba96f53f9/pull/0.log" Jul 13 07:51:15.890344 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:15.890292 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb_302ee945-6eef-40ba-8378-adcba96f53f9/extract/0.log" Jul 13 07:51:15.999441 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:15.999419 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk_97194eab-7f39-4076-bc88-75334dcc8ed7/extract/0.log" Jul 13 07:51:16.005066 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:16.005043 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk_97194eab-7f39-4076-bc88-75334dcc8ed7/util/0.log" Jul 13 07:51:16.012250 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:16.012230 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk_97194eab-7f39-4076-bc88-75334dcc8ed7/pull/0.log" Jul 13 07:51:16.132078 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:16.132037 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b98bdbfc-c9f8z_e5c6d326-3be0-4439-9977-5d2ca817f9ec/authorino/0.log" Jul 13 07:51:16.267453 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:16.267416 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ztvnq_761ec76e-0c8a-4f0a-a890-b20f046b278e/manager/0.log" Jul 13 07:51:16.386968 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:16.386938 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-nk465_f4c816a3-9509-46d8-9746-52aead1d57d4/manager/0.log" Jul 13 07:51:16.618486 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:16.618407 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xdm8j_150fc264-ce80-43af-84ea-beaf2c43df2b/registry-server/0.log" Jul 13 07:51:16.747673 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:16.747641 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-l7fs5_addab3d1-844d-4dbf-a20e-d00a653a741d/manager/0.log" Jul 13 07:51:17.346638 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:17.346607 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4d2tqw_653b9081-9efc-4a65-8a6f-601fd7fb9c70/istio-proxy/0.log" Jul 13 07:51:17.575445 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:17.575396 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55f9f4ffd9-gsbd4_82a2e396-6550-4c4b-b4c1-f211e589c5c5/kube-auth-proxy/0.log" Jul 13 07:51:17.810242 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:17.810215 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-w9qjf_5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021/istio-proxy/1.log" Jul 13 07:51:17.929115 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:17.929081 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-598sx_1669fd3c-1f63-460c-b386-b528ea3d0ff5/payload-pre-processing/0.log" Jul 13 07:51:18.049266 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:18.049236 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-k8dm5_d266065b-5053-4702-965a-cfb5aa944018/payload-processing/0.log" Jul 13 07:51:18.670818 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:18.670782 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-dqxzm_2bdaae6a-827f-4f8c-9ab2-9ca287e80c52/main/0.log" Jul 13 07:51:19.027287 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:19.027261 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-dvxb2_2759d8a8-f717-4800-b843-a39ca2ab2216/main/0.log" Jul 13 07:51:23.151436 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:23.151406 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:51:23.248041 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:23.247998 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" limit=1024 Jul 13 07:51:26.177581 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:26.177546 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jhvbm_d3595a67-9572-42c0-a4f2-8ef34b5ab1e1/global-pull-secret-syncer/0.log" Jul 13 07:51:26.232843 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:26.232810 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-b5lgv_3709e359-4669-4da2-b46d-3ccf1049dc47/konnectivity-agent/0.log" Jul 13 07:51:26.389931 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:26.389899 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-197.ec2.internal_c6527244e4faae6846389be1f06153b7/haproxy/0.log" Jul 13 07:51:31.334988 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:31.334962 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m_5626ff45-1355-4328-bd1e-902fe9565e51/extract/0.log" Jul 13 07:51:31.359713 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:31.359682 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m_5626ff45-1355-4328-bd1e-902fe9565e51/util/0.log" Jul 13 07:51:31.389180 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:31.389152 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759zz86m_5626ff45-1355-4328-bd1e-902fe9565e51/pull/0.log" Jul 13 07:51:31.424123 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:31.424102 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km_462db094-9794-4b22-8ca0-473068ed3c32/extract/0.log" Jul 13 07:51:31.448887 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:31.448866 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km_462db094-9794-4b22-8ca0-473068ed3c32/util/0.log" Jul 13 07:51:31.476072 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:31.476045 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tq4km_462db094-9794-4b22-8ca0-473068ed3c32/pull/0.log" Jul 13 07:51:31.506963 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:31.506941 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb_302ee945-6eef-40ba-8378-adcba96f53f9/extract/0.log" Jul 13 07:51:31.530850 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:31.530820 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb_302ee945-6eef-40ba-8378-adcba96f53f9/util/0.log" Jul 13 07:51:31.555905 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:31.555880 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ts4hb_302ee945-6eef-40ba-8378-adcba96f53f9/pull/0.log" Jul 13 07:51:31.587183 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:31.587120 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk_97194eab-7f39-4076-bc88-75334dcc8ed7/extract/0.log" Jul 13 07:51:31.617639 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:31.617615 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk_97194eab-7f39-4076-bc88-75334dcc8ed7/util/0.log" Jul 13 07:51:31.638190 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:31.638170 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1t6hxk_97194eab-7f39-4076-bc88-75334dcc8ed7/pull/0.log" Jul 13 07:51:31.933137 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:31.933040 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b98bdbfc-c9f8z_e5c6d326-3be0-4439-9977-5d2ca817f9ec/authorino/0.log" Jul 13 07:51:31.971302 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:31.971275 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ztvnq_761ec76e-0c8a-4f0a-a890-b20f046b278e/manager/0.log" Jul 13 07:51:32.021009 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:32.020980 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-nk465_f4c816a3-9509-46d8-9746-52aead1d57d4/manager/0.log" Jul 13 07:51:32.096727 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:32.096699 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-xdm8j_150fc264-ce80-43af-84ea-beaf2c43df2b/registry-server/0.log" Jul 13 07:51:32.194998 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:32.194905 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-l7fs5_addab3d1-844d-4dbf-a20e-d00a653a741d/manager/0.log" Jul 13 07:51:34.623513 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:34.623487 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9jl54_d6a06168-c3aa-4a3b-9a51-a6c4de07f375/node-exporter/0.log" Jul 13 07:51:34.648075 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:34.648050 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9jl54_d6a06168-c3aa-4a3b-9a51-a6c4de07f375/kube-rbac-proxy/0.log" Jul 13 07:51:34.676227 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:34.676204 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9jl54_d6a06168-c3aa-4a3b-9a51-a6c4de07f375/init-textfile/0.log" Jul 13 07:51:36.247245 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.247209 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c"] Jul 13 07:51:36.247682 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.247599 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1097b364-5e04-4eb3-bc1a-d5ee694d11e9" containerName="cleanup" Jul 13 07:51:36.247682 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.247610 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1097b364-5e04-4eb3-bc1a-d5ee694d11e9" containerName="cleanup" Jul 13 07:51:36.247682 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.247621 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c00f2c05-4e15-4a9e-8e7b-680682c92d77" containerName="cleanup" Jul 13 07:51:36.247682 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.247627 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c00f2c05-4e15-4a9e-8e7b-680682c92d77" containerName="cleanup" Jul 13 07:51:36.247682 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.247646 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4bf14c8-060a-47ef-8363-cfcb445d255f" containerName="istio-proxy" Jul 13 07:51:36.247682 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.247654 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4bf14c8-060a-47ef-8363-cfcb445d255f" containerName="istio-proxy" Jul 13 07:51:36.247682 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.247664 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4bf14c8-060a-47ef-8363-cfcb445d255f" containerName="istio-proxy" Jul 13 07:51:36.247682 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.247673 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4bf14c8-060a-47ef-8363-cfcb445d255f" containerName="istio-proxy" Jul 13 07:51:36.247682 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.247684 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d601ab6-4d54-488e-b816-0bd293a31e79" containerName="cleanup" Jul 13 07:51:36.248031 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.247692 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d601ab6-4d54-488e-b816-0bd293a31e79" containerName="cleanup" Jul 13 07:51:36.248031 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.247781 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1097b364-5e04-4eb3-bc1a-d5ee694d11e9" containerName="cleanup" Jul 13 07:51:36.248031 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.247793 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4bf14c8-060a-47ef-8363-cfcb445d255f" containerName="istio-proxy" Jul 13 07:51:36.248031 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.247800 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4bf14c8-060a-47ef-8363-cfcb445d255f" containerName="istio-proxy" Jul 13 07:51:36.248031 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.247806 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c00f2c05-4e15-4a9e-8e7b-680682c92d77" containerName="cleanup" Jul 13 07:51:36.248031 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.247813 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d601ab6-4d54-488e-b816-0bd293a31e79" containerName="cleanup" Jul 13 07:51:36.251252 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.251234 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" Jul 13 07:51:36.254056 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.254037 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tzdq9\"/\"openshift-service-ca.crt\"" Jul 13 07:51:36.255041 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.255024 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tzdq9\"/\"default-dockercfg-ngqlr\"" Jul 13 07:51:36.255104 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.255034 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tzdq9\"/\"kube-root-ca.crt\"" Jul 13 07:51:36.259333 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.259292 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c"] Jul 13 07:51:36.368510 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.368477 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9fb4f750-f759-4fc5-9b6d-d04ffe85db20-podres\") pod \"perf-node-gather-daemonset-mzn5c\" (UID: \"9fb4f750-f759-4fc5-9b6d-d04ffe85db20\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" Jul 13 07:51:36.368688 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.368527 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fb4f750-f759-4fc5-9b6d-d04ffe85db20-lib-modules\") pod \"perf-node-gather-daemonset-mzn5c\" (UID: \"9fb4f750-f759-4fc5-9b6d-d04ffe85db20\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" Jul 13 07:51:36.368688 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.368579 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9fb4f750-f759-4fc5-9b6d-d04ffe85db20-proc\") pod \"perf-node-gather-daemonset-mzn5c\" (UID: \"9fb4f750-f759-4fc5-9b6d-d04ffe85db20\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" Jul 13 07:51:36.368688 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.368605 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fb4f750-f759-4fc5-9b6d-d04ffe85db20-sys\") pod \"perf-node-gather-daemonset-mzn5c\" (UID: \"9fb4f750-f759-4fc5-9b6d-d04ffe85db20\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" Jul 13 07:51:36.368793 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.368725 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cf7p\" (UniqueName: \"kubernetes.io/projected/9fb4f750-f759-4fc5-9b6d-d04ffe85db20-kube-api-access-2cf7p\") pod \"perf-node-gather-daemonset-mzn5c\" (UID: \"9fb4f750-f759-4fc5-9b6d-d04ffe85db20\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" Jul 13 07:51:36.469337 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.469286 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9fb4f750-f759-4fc5-9b6d-d04ffe85db20-podres\") pod \"perf-node-gather-daemonset-mzn5c\" (UID: \"9fb4f750-f759-4fc5-9b6d-d04ffe85db20\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" Jul 13 07:51:36.469504 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.469354 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fb4f750-f759-4fc5-9b6d-d04ffe85db20-lib-modules\") pod \"perf-node-gather-daemonset-mzn5c\" (UID: \"9fb4f750-f759-4fc5-9b6d-d04ffe85db20\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" Jul 13 07:51:36.469504 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.469380 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9fb4f750-f759-4fc5-9b6d-d04ffe85db20-proc\") pod \"perf-node-gather-daemonset-mzn5c\" (UID: \"9fb4f750-f759-4fc5-9b6d-d04ffe85db20\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" Jul 13 07:51:36.469504 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.469410 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fb4f750-f759-4fc5-9b6d-d04ffe85db20-sys\") pod \"perf-node-gather-daemonset-mzn5c\" (UID: \"9fb4f750-f759-4fc5-9b6d-d04ffe85db20\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" Jul 13 07:51:36.469504 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.469449 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9fb4f750-f759-4fc5-9b6d-d04ffe85db20-podres\") pod \"perf-node-gather-daemonset-mzn5c\" (UID: \"9fb4f750-f759-4fc5-9b6d-d04ffe85db20\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" Jul 13 07:51:36.469504 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.469472 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cf7p\" (UniqueName: \"kubernetes.io/projected/9fb4f750-f759-4fc5-9b6d-d04ffe85db20-kube-api-access-2cf7p\") pod \"perf-node-gather-daemonset-mzn5c\" (UID: \"9fb4f750-f759-4fc5-9b6d-d04ffe85db20\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" Jul 13 07:51:36.469504 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.469493 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9fb4f750-f759-4fc5-9b6d-d04ffe85db20-proc\") pod \"perf-node-gather-daemonset-mzn5c\" (UID: \"9fb4f750-f759-4fc5-9b6d-d04ffe85db20\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" Jul 13 07:51:36.469728 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.469503 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9fb4f750-f759-4fc5-9b6d-d04ffe85db20-sys\") pod \"perf-node-gather-daemonset-mzn5c\" (UID: \"9fb4f750-f759-4fc5-9b6d-d04ffe85db20\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" Jul 13 07:51:36.469728 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.469526 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9fb4f750-f759-4fc5-9b6d-d04ffe85db20-lib-modules\") pod \"perf-node-gather-daemonset-mzn5c\" (UID: \"9fb4f750-f759-4fc5-9b6d-d04ffe85db20\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" Jul 13 07:51:36.478281 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.478256 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cf7p\" (UniqueName: \"kubernetes.io/projected/9fb4f750-f759-4fc5-9b6d-d04ffe85db20-kube-api-access-2cf7p\") pod \"perf-node-gather-daemonset-mzn5c\" (UID: \"9fb4f750-f759-4fc5-9b6d-d04ffe85db20\") " pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" Jul 13 07:51:36.561719 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.561628 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" Jul 13 07:51:36.700374 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.700346 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c"] Jul 13 07:51:36.702337 ip-10-0-141-197 kubenswrapper[2565]: W0713 07:51:36.702287 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9fb4f750_f759_4fc5_9b6d_d04ffe85db20.slice/crio-bf631201bcd18f5c2cb200fb93f15380875dc498250141aed62babf523a8433d WatchSource:0}: Error finding container bf631201bcd18f5c2cb200fb93f15380875dc498250141aed62babf523a8433d: Status 404 returned error can't find the container with id bf631201bcd18f5c2cb200fb93f15380875dc498250141aed62babf523a8433d Jul 13 07:51:36.969772 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.969684 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" event={"ID":"9fb4f750-f759-4fc5-9b6d-d04ffe85db20","Type":"ContainerStarted","Data":"f9a0e59924183369ec866e32b6023a7f3d2c82f8bfec2701c1d6dd7ff1d52678"} Jul 13 07:51:36.969772 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.969739 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" Jul 13 07:51:36.969772 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.969757 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" event={"ID":"9fb4f750-f759-4fc5-9b6d-d04ffe85db20","Type":"ContainerStarted","Data":"bf631201bcd18f5c2cb200fb93f15380875dc498250141aed62babf523a8433d"} Jul 13 07:51:36.989420 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:36.989370 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" podStartSLOduration=0.989356428 podStartE2EDuration="989.356428ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-13 07:51:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-13 07:51:36.986892778 +0000 UTC m=+2373.909144951" watchObservedRunningTime="2026-07-13 07:51:36.989356428 +0000 UTC m=+2373.911608601" Jul 13 07:51:39.708549 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:39.708524 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sgkm7_c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8/dns/0.log" Jul 13 07:51:39.733060 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:39.733039 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sgkm7_c36dd43a-b54d-45ea-ab7f-ee80a1fe58e8/kube-rbac-proxy/0.log" Jul 13 07:51:39.821149 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:39.821120 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q9787_fb41cbdc-4be4-4e54-9c8d-fad3734be1af/dns-node-resolver/0.log" Jul 13 07:51:40.429385 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:40.429357 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8495fd756d-br9vq_35201dbf-5ef9-435b-a881-30dc2e7774d3/registry/0.log" Jul 13 07:51:40.459264 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:40.459235 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bqlnb_4900d593-e893-4320-8eaf-b3d326987b17/node-ca/0.log" Jul 13 07:51:41.556707 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:41.556678 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4d2tqw_653b9081-9efc-4a65-8a6f-601fd7fb9c70/istio-proxy/0.log" Jul 13 07:51:41.737177 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:41.737148 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55f9f4ffd9-gsbd4_82a2e396-6550-4c4b-b4c1-f211e589c5c5/kube-auth-proxy/0.log" Jul 13 07:51:41.817138 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:41.817054 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-w9qjf_5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021/istio-proxy/0.log" Jul 13 07:51:41.845030 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:41.845006 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-w9qjf_5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021/istio-proxy/1.log" Jul 13 07:51:41.873684 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:41.873663 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-598sx_1669fd3c-1f63-460c-b386-b528ea3d0ff5/payload-pre-processing/0.log" Jul 13 07:51:41.921655 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:41.921630 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-k8dm5_d266065b-5053-4702-965a-cfb5aa944018/payload-processing/0.log" Jul 13 07:51:42.733516 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:42.733487 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ttnn7_6a3d4b3e-f6ad-444b-b69d-c5602afb93fe/serve-healthcheck-canary/0.log" Jul 13 07:51:42.985631 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:42.985612 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tzdq9/perf-node-gather-daemonset-mzn5c" Jul 13 07:51:43.331666 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:43.331590 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2qghx_e0c99f85-cd64-45cb-a2ae-37cceb18333d/kube-rbac-proxy/0.log" Jul 13 07:51:43.361453 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:43.361433 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2qghx_e0c99f85-cd64-45cb-a2ae-37cceb18333d/exporter/0.log" Jul 13 07:51:43.388877 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:43.388850 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2qghx_e0c99f85-cd64-45cb-a2ae-37cceb18333d/extractor/0.log" Jul 13 07:51:46.129773 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:46.129740 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-xgrh2_38ecc585-1619-4cab-919e-c391bcf32d2f/manager/0.log" Jul 13 07:51:46.274488 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:46.274459 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wmpzw_68a9f171-f008-4aac-b5bd-5685e65de3a3/manager/0.log" Jul 13 07:51:46.339629 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:46.339604 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29732130-n8b62_c87aa8c4-a2b2-456f-90bf-fd4b999dcd0b/cleanup/0.log" Jul 13 07:51:46.370223 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:46.370198 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29732145-44qzq_1097b364-5e04-4eb3-bc1a-d5ee694d11e9/cleanup/0.log" Jul 13 07:51:46.495295 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:46.495272 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-mfsdb_1a8a2b9d-4cae-4c04-95ce-51fe2d029dcd/server/0.log" Jul 13 07:51:46.563041 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:46.562959 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-sngbb_ab07d64c-e94f-4a2b-bf28-16e619440df2/manager/0.log" Jul 13 07:51:46.769778 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:46.769745 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b4d7c976f-l7hc2_fb118592-97c7-43d9-8798-a99200ad855c/manager/0.log" Jul 13 07:51:46.792112 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:46.792087 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5b4d7c976f-l7hc2_fb118592-97c7-43d9-8798-a99200ad855c/copy-manifests/0.log" Jul 13 07:51:46.821573 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:46.821510 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-bvtqp_4888ae0f-0a08-4695-ac70-b7ec8236ae17/postgres/0.log" Jul 13 07:51:47.702783 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:47.702750 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4d2tqw_653b9081-9efc-4a65-8a6f-601fd7fb9c70/istio-proxy/0.log" Jul 13 07:51:47.860114 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:47.860074 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55f9f4ffd9-gsbd4_82a2e396-6550-4c4b-b4c1-f211e589c5c5/kube-auth-proxy/0.log" Jul 13 07:51:47.900574 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:47.900535 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-w9qjf_5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021/istio-proxy/0.log" Jul 13 07:51:47.931140 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:47.931063 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-w9qjf_5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021/istio-proxy/1.log" Jul 13 07:51:47.954457 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:47.954432 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-598sx_1669fd3c-1f63-460c-b386-b528ea3d0ff5/payload-pre-processing/0.log" Jul 13 07:51:47.995061 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:47.995033 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-k8dm5_d266065b-5053-4702-965a-cfb5aa944018/payload-processing/0.log" Jul 13 07:51:49.184586 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:49.184541 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4d2tqw_653b9081-9efc-4a65-8a6f-601fd7fb9c70/istio-proxy/0.log" Jul 13 07:51:49.333168 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:49.333142 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-55f9f4ffd9-gsbd4_82a2e396-6550-4c4b-b4c1-f211e589c5c5/kube-auth-proxy/0.log" Jul 13 07:51:49.376535 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:49.376499 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-w9qjf_5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021/istio-proxy/0.log" Jul 13 07:51:49.406445 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:49.406418 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-w9qjf_5ddc0ff9-6d4e-4b00-ba2e-79887b5d0021/istio-proxy/1.log" Jul 13 07:51:49.425699 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:49.425672 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-598sx_1669fd3c-1f63-460c-b386-b528ea3d0ff5/payload-pre-processing/0.log" Jul 13 07:51:49.461948 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:49.461871 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-k8dm5_d266065b-5053-4702-965a-cfb5aa944018/payload-processing/0.log" Jul 13 07:51:53.683902 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:53.683875 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-hdjgp_26243c9e-354b-4202-b393-9388d5a89aec/migrator/0.log" Jul 13 07:51:53.711391 ip-10-0-141-197 kubenswrapper[2565]: I0713 07:51:53.711362 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-hdjgp_26243c9e-354b-4202-b393-9388d5a89aec/graceful-termination/0.log"