Jul 21 14:32:08.276952 ip-10-0-131-241 systemd[1]: Starting Kubernetes Kubelet... Jul 21 14:32:08.820316 ip-10-0-131-241 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 14:32:08.820316 ip-10-0-131-241 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 21 14:32:08.820316 ip-10-0-131-241 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 14:32:08.820316 ip-10-0-131-241 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 21 14:32:08.820316 ip-10-0-131-241 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 14:32:08.820316 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.723879 2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 21 14:32:08.820316 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730403 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 14:32:08.820316 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730414 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 14:32:08.820316 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730418 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 14:32:08.820316 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730421 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 14:32:08.820316 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730424 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 14:32:08.820316 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730427 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 14:32:08.820316 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730430 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 14:32:08.820316 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730434 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 14:32:08.824013 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730436 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 14:32:08.824013 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730439 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 14:32:08.824013 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730441 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 14:32:08.824013 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730445 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 14:32:08.824013 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730447 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 14:32:08.824013 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730450 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 14:32:08.824013 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730453 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 14:32:08.824013 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730455 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 14:32:08.824013 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730458 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 14:32:08.824013 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730462 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 14:32:08.824013 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730466 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 14:32:08.824013 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730469 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 14:32:08.824013 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730472 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 14:32:08.824013 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730475 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 14:32:08.824013 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730478 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 14:32:08.824013 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730480 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 14:32:08.824013 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730483 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 14:32:08.824013 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730487 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 14:32:08.824013 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730491 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 14:32:08.803358 ip-10-0-131-241 systemd[1]: Started Kubernetes Kubelet. Jul 21 14:32:08.838256 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730494 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 14:32:08.838256 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730496 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 14:32:08.838256 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730499 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 14:32:08.838256 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730502 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 14:32:08.838256 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730505 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 14:32:08.838256 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730508 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 14:32:08.838256 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730510 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 14:32:08.838256 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730513 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 14:32:08.838256 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730532 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 14:32:08.838256 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730535 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 14:32:08.838256 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730538 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 14:32:08.838256 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730541 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 14:32:08.838256 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730544 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 14:32:08.838256 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730547 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 14:32:08.838256 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730549 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 14:32:08.838256 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730553 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 14:32:08.838256 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730555 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 14:32:08.838256 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730557 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 14:32:08.838256 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730560 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 14:32:08.838256 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730563 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 14:32:08.841128 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730566 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 14:32:08.841128 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730568 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 14:32:08.841128 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730572 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 14:32:08.841128 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730574 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 14:32:08.841128 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730577 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 14:32:08.841128 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730579 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 14:32:08.841128 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730582 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 14:32:08.841128 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730584 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 14:32:08.841128 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730587 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 14:32:08.841128 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730589 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 14:32:08.841128 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730592 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 14:32:08.841128 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730594 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 14:32:08.841128 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730596 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 14:32:08.841128 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730599 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 14:32:08.841128 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730601 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 14:32:08.841128 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730605 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 14:32:08.841128 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730607 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 14:32:08.841128 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730610 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 14:32:08.841128 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730613 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 14:32:08.854573 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730616 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 14:32:08.854573 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730618 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 14:32:08.854573 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730621 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 21 14:32:08.854573 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730624 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 14:32:08.854573 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730626 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 14:32:08.854573 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730629 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 14:32:08.854573 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730631 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 14:32:08.854573 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730634 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 14:32:08.854573 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730636 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 14:32:08.854573 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730639 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 14:32:08.854573 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730642 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 14:32:08.854573 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730645 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 14:32:08.854573 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730647 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 14:32:08.854573 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730650 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 14:32:08.854573 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730653 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 14:32:08.854573 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730656 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 14:32:08.854573 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730658 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 14:32:08.854573 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730661 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 14:32:08.854573 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730663 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 14:32:08.854573 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730666 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 14:32:08.857374 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730670 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 14:32:08.857374 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730672 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 14:32:08.857374 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730675 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 14:32:08.857374 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730678 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 14:32:08.857374 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730682 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 14:32:08.857374 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730684 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 14:32:08.857374 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730687 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 14:32:08.857374 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730689 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 14:32:08.857374 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730692 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 14:32:08.857374 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730695 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 14:32:08.857374 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730698 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 14:32:08.857374 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730701 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 14:32:08.857374 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.730703 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 14:32:08.857374 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731421 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 14:32:08.857374 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731427 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 14:32:08.857374 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731432 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 14:32:08.857374 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731437 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 14:32:08.857374 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731440 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 14:32:08.857374 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731443 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 14:32:08.857374 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731446 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 14:32:08.872227 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731449 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 14:32:08.872227 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731451 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 14:32:08.872227 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731454 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 14:32:08.872227 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731456 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 14:32:08.872227 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731459 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 14:32:08.872227 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731461 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 14:32:08.872227 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731464 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 14:32:08.872227 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731467 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 14:32:08.872227 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731470 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 14:32:08.872227 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731472 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 14:32:08.872227 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731475 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 14:32:08.872227 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731477 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 14:32:08.872227 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731480 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 14:32:08.872227 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731482 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 14:32:08.872227 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731485 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 14:32:08.872227 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731490 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 14:32:08.872227 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731493 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 14:32:08.872227 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731495 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 14:32:08.872227 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731498 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 14:32:08.872227 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731500 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 14:32:09.019323 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731503 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 14:32:09.019323 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731506 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 14:32:09.019323 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731512 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 14:32:09.019323 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731515 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 14:32:09.019323 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731534 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 14:32:09.019323 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731537 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 14:32:09.019323 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731540 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 14:32:09.019323 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731542 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 14:32:09.019323 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731545 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 14:32:09.019323 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731548 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 14:32:09.019323 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731552 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 14:32:09.019323 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731554 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 14:32:09.019323 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731557 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 14:32:09.019323 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731562 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 14:32:09.019323 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731566 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 14:32:09.019323 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731569 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 14:32:09.019323 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731572 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 14:32:09.019323 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731576 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 14:32:09.019323 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731578 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 14:32:09.020104 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731582 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 14:32:09.020104 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731584 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 14:32:09.020104 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731587 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 14:32:09.020104 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731589 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 14:32:09.020104 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731592 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 14:32:09.020104 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731594 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 14:32:09.020104 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731597 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 14:32:09.020104 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731600 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 14:32:09.020104 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731603 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 14:32:09.020104 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731605 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 14:32:09.020104 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731608 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 14:32:09.020104 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731610 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 14:32:09.020104 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731613 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 14:32:09.020104 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731615 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 14:32:09.020104 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731618 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 14:32:09.020104 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731622 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 14:32:09.020104 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731625 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 14:32:09.020104 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731627 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 14:32:09.020104 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731630 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 14:32:09.020104 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731632 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 14:32:09.020919 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731635 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 14:32:09.020919 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731639 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 14:32:09.020919 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731642 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 14:32:09.020919 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731645 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 14:32:09.020919 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731649 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 14:32:09.020919 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731652 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 14:32:09.020919 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731654 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 14:32:09.020919 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731657 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 14:32:09.020919 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731660 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 14:32:09.020919 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731662 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 14:32:09.020919 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731665 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 14:32:09.020919 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731668 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 14:32:09.020919 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731670 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 14:32:09.020919 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731673 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 21 14:32:09.020919 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731676 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 14:32:09.020919 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731678 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 14:32:09.020919 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731681 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 14:32:09.020919 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731685 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 14:32:09.020919 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731687 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 14:32:09.020919 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731690 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 14:32:09.021542 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731692 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 14:32:09.021542 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731695 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 14:32:09.021542 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731697 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 14:32:09.021542 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731700 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 14:32:09.021542 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731702 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 14:32:09.021542 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731705 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 14:32:09.021542 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731707 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 14:32:09.021542 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731711 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 14:32:09.021542 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731714 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 14:32:09.021542 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731717 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 14:32:09.021542 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731720 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 14:32:09.021542 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731722 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 14:32:09.021542 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.731725 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 14:32:09.021542 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732084 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 14:32:09.021542 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732089 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 14:32:09.021542 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732091 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 14:32:09.021542 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732095 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 14:32:09.021542 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732099 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 14:32:09.021542 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732101 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 14:32:09.021542 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732104 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 14:32:09.022349 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732107 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 14:32:09.022349 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732109 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 14:32:09.022349 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732112 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 14:32:09.022349 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732115 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 14:32:09.022349 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732117 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 14:32:09.022349 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732122 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 14:32:09.022349 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732125 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 14:32:09.022349 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732128 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 14:32:09.022349 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732132 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 14:32:09.022349 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732135 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 14:32:09.022349 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732138 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 14:32:09.022349 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732141 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 14:32:09.022349 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732144 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 14:32:09.022349 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732146 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 14:32:09.022349 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732148 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 14:32:09.022349 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732151 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 14:32:09.022349 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732154 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 14:32:09.022349 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732157 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 14:32:09.022349 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732159 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 14:32:09.022973 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732163 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 14:32:09.022973 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732165 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 14:32:09.022973 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732169 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 14:32:09.022973 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732172 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 14:32:09.022973 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732174 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 14:32:09.022973 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732177 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 14:32:09.022973 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732179 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 14:32:09.022973 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732182 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 14:32:09.022973 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732184 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 14:32:09.022973 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732188 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 14:32:09.022973 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732191 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 14:32:09.022973 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732193 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 14:32:09.022973 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732196 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 14:32:09.022973 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732198 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 14:32:09.022973 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732200 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 14:32:09.022973 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732203 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 14:32:09.022973 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732205 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 14:32:09.022973 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732208 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 14:32:09.022973 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732211 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 14:32:09.023813 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732213 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 14:32:09.023813 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732216 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 14:32:09.023813 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732218 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 14:32:09.023813 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732221 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 14:32:09.023813 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732223 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 14:32:09.023813 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732226 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 14:32:09.023813 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732228 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 14:32:09.023813 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732231 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 14:32:09.023813 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732233 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 14:32:09.023813 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732235 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 14:32:09.023813 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732238 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 14:32:09.023813 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732240 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 14:32:09.023813 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732243 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 14:32:09.023813 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732247 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 14:32:09.023813 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732249 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 14:32:09.023813 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732252 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 14:32:09.023813 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732257 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 14:32:09.023813 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732260 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 14:32:09.023813 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732263 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 14:32:09.023813 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732265 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 14:32:09.024438 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732268 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 14:32:09.024438 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732270 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 14:32:09.024438 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732274 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 14:32:09.024438 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732276 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 14:32:09.024438 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732279 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 14:32:09.024438 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732281 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 21 14:32:09.024438 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732284 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 14:32:09.024438 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732286 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 14:32:09.024438 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732289 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 14:32:09.024438 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732292 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 14:32:09.024438 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732295 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 14:32:09.024438 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732297 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 14:32:09.024438 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732300 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 14:32:09.024438 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732302 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 14:32:09.024438 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732305 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 14:32:09.024438 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732307 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 14:32:09.024438 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732310 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 14:32:09.024438 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732312 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 14:32:09.024438 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732315 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 14:32:09.024438 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732317 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 14:32:09.025040 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732320 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 14:32:09.025040 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732323 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 14:32:09.025040 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732327 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 14:32:09.025040 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732330 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 14:32:09.025040 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732332 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 14:32:09.025040 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732336 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 14:32:09.025040 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732339 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 14:32:09.025040 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732342 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 14:32:09.025040 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732344 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 14:32:09.025040 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732347 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 14:32:09.025040 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732349 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 14:32:09.025040 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732352 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 14:32:09.025040 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732354 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 14:32:09.025040 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.732357 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 14:32:09.025040 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732428 2559 flags.go:64] FLAG: --address="0.0.0.0" Jul 21 14:32:09.025040 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732434 2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 21 14:32:09.025040 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732440 2559 flags.go:64] FLAG: --anonymous-auth="true" Jul 21 14:32:09.025040 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732445 2559 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 21 14:32:09.025040 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732448 2559 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 21 14:32:09.025040 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732451 2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732455 2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732459 2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732462 2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732465 2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732468 2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732472 2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732475 2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732479 2559 flags.go:64] FLAG: --cgroup-root="" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732481 2559 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732484 2559 flags.go:64] FLAG: --client-ca-file="" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732487 2559 flags.go:64] FLAG: --cloud-provider="external" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732489 2559 flags.go:64] FLAG: --cluster-dns="[]" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732494 2559 flags.go:64] FLAG: --cluster-domain="" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732497 2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732500 2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732503 2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732506 2559 flags.go:64] FLAG: --container-log-max-files="5" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732511 2559 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732514 2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732533 2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732536 2559 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732539 2559 flags.go:64] FLAG: --contention-profiling="false" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732543 2559 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 21 14:32:09.025590 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732546 2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732549 2559 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732552 2559 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732558 2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732561 2559 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732563 2559 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732566 2559 flags.go:64] FLAG: --enable-load-reader="false" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732569 2559 flags.go:64] FLAG: --enable-server="true" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.732572 2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733232 2559 flags.go:64] FLAG: --event-burst="100" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733236 2559 flags.go:64] FLAG: --event-qps="50" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733239 2559 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733242 2559 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733245 2559 flags.go:64] FLAG: --eviction-hard="" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733249 2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733252 2559 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733256 2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733260 2559 flags.go:64] FLAG: --eviction-soft="" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733263 2559 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733266 2559 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733269 2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733272 2559 flags.go:64] FLAG: --experimental-mounter-path="" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733275 2559 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733278 2559 flags.go:64] FLAG: --fail-swap-on="true" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733281 2559 flags.go:64] FLAG: --feature-gates="" Jul 21 14:32:09.026268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733285 2559 flags.go:64] FLAG: --file-check-frequency="20s" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733289 2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733292 2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733295 2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733298 2559 flags.go:64] FLAG: --healthz-port="10248" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733301 2559 flags.go:64] FLAG: --help="false" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733304 2559 flags.go:64] FLAG: --hostname-override="ip-10-0-131-241.ec2.internal" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733307 2559 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733310 2559 flags.go:64] FLAG: --http-check-frequency="20s" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733313 2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733318 2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733321 2559 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733324 2559 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733327 2559 flags.go:64] FLAG: --image-service-endpoint="" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733330 2559 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733333 2559 flags.go:64] FLAG: --kube-api-burst="100" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733336 2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733339 2559 flags.go:64] FLAG: --kube-api-qps="50" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733341 2559 flags.go:64] FLAG: --kube-reserved="" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733344 2559 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733347 2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733350 2559 flags.go:64] FLAG: --kubelet-cgroups="" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733352 2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733355 2559 flags.go:64] FLAG: --lock-file="" Jul 21 14:32:09.027202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733358 2559 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733360 2559 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733363 2559 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733378 2559 flags.go:64] FLAG: --log-json-split-stream="false" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733381 2559 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733384 2559 flags.go:64] FLAG: --log-text-split-stream="false" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733387 2559 flags.go:64] FLAG: --logging-format="text" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733389 2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733393 2559 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733397 2559 flags.go:64] FLAG: --manifest-url="" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733400 2559 flags.go:64] FLAG: --manifest-url-header="" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733404 2559 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733407 2559 flags.go:64] FLAG: --max-open-files="1000000" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733418 2559 flags.go:64] FLAG: --max-pods="110" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733421 2559 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733424 2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733428 2559 flags.go:64] FLAG: --memory-manager-policy="None" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733431 2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733436 2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733438 2559 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733441 2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733448 2559 flags.go:64] FLAG: --node-status-max-images="50" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733451 2559 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733454 2559 flags.go:64] FLAG: --oom-score-adj="-999" Jul 21 14:32:09.028000 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733457 2559 flags.go:64] FLAG: --pod-cidr="" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733460 2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733465 2559 flags.go:64] FLAG: --pod-manifest-path="" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733468 2559 flags.go:64] FLAG: --pod-max-pids="-1" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733471 2559 flags.go:64] FLAG: --pods-per-core="0" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733474 2559 flags.go:64] FLAG: --port="10250" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733477 2559 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733480 2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a37e2e698e4de1d5" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733483 2559 flags.go:64] FLAG: --qos-reserved="" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733486 2559 flags.go:64] FLAG: --read-only-port="10255" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733489 2559 flags.go:64] FLAG: --register-node="true" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733492 2559 flags.go:64] FLAG: --register-with-taints="" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733495 2559 flags.go:64] FLAG: --registry-burst="10" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733498 2559 flags.go:64] FLAG: --registry-qps="5" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733500 2559 flags.go:64] FLAG: --reserved-cpus="" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733503 2559 flags.go:64] FLAG: --reserved-memory="" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733507 2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733509 2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733514 2559 flags.go:64] FLAG: --rotate-certificates="false" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733529 2559 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733532 2559 flags.go:64] FLAG: --runonce="false" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733535 2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733538 2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733541 2559 flags.go:64] FLAG: --seccomp-default="false" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733544 2559 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 21 14:32:09.029089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733547 2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733551 2559 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733554 2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733558 2559 flags.go:64] FLAG: --storage-driver-password="root" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733560 2559 flags.go:64] FLAG: --storage-driver-secure="false" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733563 2559 flags.go:64] FLAG: --storage-driver-table="stats" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733566 2559 flags.go:64] FLAG: --storage-driver-user="root" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733569 2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733571 2559 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733574 2559 flags.go:64] FLAG: --system-cgroups="" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733577 2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733582 2559 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733585 2559 flags.go:64] FLAG: --tls-cert-file="" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733588 2559 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733591 2559 flags.go:64] FLAG: --tls-min-version="" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733594 2559 flags.go:64] FLAG: --tls-private-key-file="" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733597 2559 flags.go:64] FLAG: --topology-manager-policy="none" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733600 2559 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733603 2559 flags.go:64] FLAG: --topology-manager-scope="container" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733606 2559 flags.go:64] FLAG: --v="2" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733609 2559 flags.go:64] FLAG: --version="false" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733613 2559 flags.go:64] FLAG: --vmodule="" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733617 2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.733620 2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 21 14:32:09.030035 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733732 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 14:32:09.122127 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733738 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 14:32:09.122127 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733742 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 14:32:09.122127 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733745 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 14:32:09.122127 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733747 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 14:32:09.122127 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733750 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 14:32:09.122127 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733752 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 14:32:09.122127 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733755 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 14:32:09.122127 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733758 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 14:32:09.122127 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733763 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 14:32:09.122127 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733765 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 14:32:09.122127 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733768 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 14:32:09.122127 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733771 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 14:32:09.122127 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733773 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 14:32:09.122127 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733776 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 14:32:09.122127 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733778 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 14:32:09.122127 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733781 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 14:32:09.122127 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733783 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 14:32:09.122127 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733786 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 14:32:09.122127 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733788 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 14:32:09.122822 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733791 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 14:32:09.122822 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733793 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 14:32:09.122822 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733796 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 14:32:09.122822 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733798 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 14:32:09.122822 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733800 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 21 14:32:09.122822 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733803 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 14:32:09.122822 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733805 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 14:32:09.122822 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733808 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 14:32:09.122822 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733811 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 14:32:09.122822 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733813 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 14:32:09.122822 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733816 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 14:32:09.122822 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733818 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 14:32:09.122822 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733820 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 14:32:09.122822 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733824 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 14:32:09.122822 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733827 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 14:32:09.122822 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733829 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 14:32:09.122822 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733832 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 14:32:09.122822 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733834 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 14:32:09.122822 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733837 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 14:32:09.123390 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733839 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 14:32:09.123390 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733842 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 14:32:09.123390 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733847 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 14:32:09.123390 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733850 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 14:32:09.123390 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733853 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 14:32:09.123390 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733855 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 14:32:09.123390 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733858 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 14:32:09.123390 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733860 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 14:32:09.123390 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733863 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 14:32:09.123390 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733865 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 14:32:09.123390 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733868 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 14:32:09.123390 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733870 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 14:32:09.123390 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733873 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 14:32:09.123390 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733875 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 14:32:09.123390 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733877 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 14:32:09.123390 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733880 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 14:32:09.123390 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733882 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 14:32:09.123390 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733885 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 14:32:09.123390 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733887 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 14:32:09.123390 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733890 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 14:32:09.124007 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733893 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 14:32:09.124007 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733895 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 14:32:09.124007 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733898 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 14:32:09.124007 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733900 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 14:32:09.124007 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733902 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 14:32:09.124007 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733906 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 14:32:09.124007 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733911 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 14:32:09.124007 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733913 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 14:32:09.124007 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733916 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 14:32:09.124007 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733919 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 14:32:09.124007 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733922 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 14:32:09.124007 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733925 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 14:32:09.124007 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733927 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 14:32:09.124007 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733930 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 14:32:09.124007 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733933 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 14:32:09.124007 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733936 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 14:32:09.124007 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733939 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 14:32:09.124007 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733941 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 14:32:09.124007 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733944 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 14:32:09.124007 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733946 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 14:32:09.124590 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733949 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 14:32:09.124590 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733952 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 14:32:09.124590 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733955 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 14:32:09.124590 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733957 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 14:32:09.124590 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733960 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 14:32:09.124590 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733962 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 14:32:09.124590 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733965 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 14:32:09.124590 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733967 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 14:32:09.124590 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733970 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 14:32:09.124590 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733974 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 14:32:09.124590 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733977 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 14:32:09.124590 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733980 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 14:32:09.124590 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733982 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 14:32:09.124590 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733986 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 14:32:09.124590 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733989 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 14:32:09.124590 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733991 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 14:32:09.124590 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733994 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 14:32:09.124590 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.733996 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 14:32:09.124590 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.734000 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 14:32:09.124590 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.734002 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 14:32:09.125158 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.734830 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 14:32:09.125158 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.742996 2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 21 14:32:09.125158 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.743120 2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 21 14:32:09.125158 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.744013 2559 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 21 14:32:09.125158 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.744024 2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 21 14:32:09.125158 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744080 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 14:32:09.125158 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744086 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 14:32:09.125158 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744089 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 14:32:09.125158 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744092 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 14:32:09.125158 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744096 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 14:32:09.125158 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744100 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 14:32:09.125158 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744103 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 14:32:09.125158 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744106 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 14:32:09.125158 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744108 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 14:32:09.125158 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744111 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 14:32:09.125604 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744114 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 14:32:09.125604 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744116 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 14:32:09.125604 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744119 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 14:32:09.125604 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744122 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 14:32:09.125604 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744124 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 14:32:09.125604 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744127 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 14:32:09.125604 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744129 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 14:32:09.125604 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744132 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 14:32:09.125604 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744135 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 14:32:09.125604 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744138 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 14:32:09.125604 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744140 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 14:32:09.125604 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744143 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 14:32:09.125604 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744148 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 14:32:09.125604 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744151 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 14:32:09.125604 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744154 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 14:32:09.125604 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744156 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 14:32:09.125604 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744159 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 14:32:09.125604 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744161 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 14:32:09.125604 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744165 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 14:32:09.125604 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744167 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 14:32:09.126198 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744170 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 14:32:09.126198 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744173 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 14:32:09.126198 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744175 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 14:32:09.126198 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744178 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 14:32:09.126198 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744182 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 14:32:09.126198 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744186 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 14:32:09.126198 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744189 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 14:32:09.126198 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744191 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 14:32:09.126198 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744194 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 14:32:09.126198 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744197 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 14:32:09.126198 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744200 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 14:32:09.126198 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744202 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 14:32:09.126198 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744205 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 14:32:09.126198 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744207 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 14:32:09.126198 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744210 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 14:32:09.126198 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744213 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 14:32:09.126198 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744216 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 14:32:09.126198 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744218 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 14:32:09.126198 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744221 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 14:32:09.126198 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744223 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 14:32:09.126740 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744226 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 14:32:09.126740 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744229 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 14:32:09.126740 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744232 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 14:32:09.126740 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744234 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 14:32:09.126740 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744238 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 21 14:32:09.126740 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744240 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 14:32:09.126740 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744243 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 14:32:09.126740 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744246 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 14:32:09.126740 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744250 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 14:32:09.126740 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744254 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 14:32:09.126740 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744256 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 14:32:09.126740 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744259 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 14:32:09.126740 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744262 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 14:32:09.126740 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744264 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 14:32:09.126740 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744267 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 14:32:09.126740 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744270 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 14:32:09.126740 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744272 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 14:32:09.126740 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744275 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 14:32:09.126740 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744277 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 14:32:09.127277 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744279 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 14:32:09.127277 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744282 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 14:32:09.127277 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744285 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 14:32:09.127277 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744287 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 14:32:09.127277 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744289 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 14:32:09.127277 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744292 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 14:32:09.127277 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744294 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 14:32:09.127277 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744297 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 14:32:09.127277 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744299 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 14:32:09.127277 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744302 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 14:32:09.127277 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744307 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 14:32:09.127277 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744310 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 14:32:09.127277 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744312 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 14:32:09.127277 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744315 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 14:32:09.127277 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744318 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 14:32:09.127277 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744320 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 14:32:09.127277 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744323 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 14:32:09.127277 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744327 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 14:32:09.127277 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744329 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 14:32:09.127277 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744332 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 14:32:09.127821 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744334 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 14:32:09.127821 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744337 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 14:32:09.127821 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744339 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 14:32:09.127821 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744342 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 14:32:09.127821 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744344 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 14:32:09.127821 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744347 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 14:32:09.127821 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744350 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 14:32:09.127821 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744352 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 14:32:09.127821 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744355 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 14:32:09.127821 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744357 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 14:32:09.127821 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.744362 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 14:32:09.127821 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744501 2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 14:32:09.127821 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744507 2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 14:32:09.127821 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744511 2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 14:32:09.127821 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744515 2559 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 14:32:09.128266 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744545 2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 14:32:09.128266 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744548 2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 14:32:09.128266 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744551 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 14:32:09.128266 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744553 2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 14:32:09.128266 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744556 2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 14:32:09.128266 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744558 2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 14:32:09.128266 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744561 2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 14:32:09.128266 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744564 2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 14:32:09.128266 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744571 2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 14:32:09.128266 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744575 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 14:32:09.128266 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744578 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 14:32:09.128266 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744582 2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 14:32:09.128266 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744585 2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 14:32:09.128266 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744587 2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 14:32:09.128266 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744590 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 14:32:09.128266 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744594 2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 14:32:09.128266 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744597 2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 14:32:09.128266 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744599 2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 14:32:09.128266 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744602 2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 14:32:09.128790 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744605 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 14:32:09.128790 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744607 2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 14:32:09.128790 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744610 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 14:32:09.128790 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744612 2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 14:32:09.128790 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744615 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 14:32:09.128790 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744617 2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 14:32:09.128790 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744620 2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 14:32:09.128790 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744623 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 14:32:09.128790 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744625 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 14:32:09.128790 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744627 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 14:32:09.128790 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744630 2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 14:32:09.128790 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744633 2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 14:32:09.128790 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744635 2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 14:32:09.128790 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744637 2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 14:32:09.128790 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744640 2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 14:32:09.128790 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744643 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 14:32:09.128790 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744645 2559 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 14:32:09.128790 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744648 2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 14:32:09.128790 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744650 2559 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 14:32:09.128790 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744653 2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 14:32:09.129346 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744656 2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 14:32:09.129346 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744659 2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 14:32:09.129346 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744662 2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 14:32:09.129346 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744664 2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 14:32:09.129346 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744667 2559 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 14:32:09.129346 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744670 2559 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 14:32:09.129346 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744672 2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 14:32:09.129346 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744675 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 14:32:09.129346 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744679 2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 14:32:09.129346 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744682 2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 14:32:09.129346 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744684 2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 14:32:09.129346 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744687 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 14:32:09.129346 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744690 2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 14:32:09.129346 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744692 2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 14:32:09.129346 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744694 2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 14:32:09.129346 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744697 2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 14:32:09.129346 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744701 2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 14:32:09.129346 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744705 2559 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 14:32:09.129346 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744708 2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 14:32:09.129925 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744712 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 14:32:09.129925 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744715 2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 14:32:09.129925 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744717 2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 14:32:09.129925 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744720 2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 14:32:09.129925 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744722 2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 14:32:09.129925 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744725 2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 14:32:09.129925 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744727 2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 14:32:09.129925 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744730 2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 14:32:09.129925 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744733 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 14:32:09.129925 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744735 2559 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 14:32:09.129925 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744737 2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 14:32:09.129925 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744740 2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 14:32:09.129925 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744743 2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 14:32:09.129925 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744745 2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 14:32:09.129925 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744749 2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 14:32:09.129925 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744752 2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 14:32:09.129925 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744755 2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 14:32:09.129925 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744758 2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 14:32:09.129925 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744761 2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 14:32:09.129925 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744763 2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 14:32:09.130482 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744765 2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 14:32:09.130482 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744769 2559 feature_gate.go:328] unrecognized feature gate: Example Jul 21 14:32:09.130482 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744772 2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 14:32:09.130482 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744774 2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 14:32:09.130482 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744777 2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 14:32:09.130482 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744779 2559 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 14:32:09.130482 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744782 2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 14:32:09.130482 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744784 2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 14:32:09.130482 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744787 2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 14:32:09.130482 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744789 2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 14:32:09.130482 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744792 2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 14:32:09.130482 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744794 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 14:32:09.130482 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744797 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 14:32:09.130482 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744799 2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 14:32:09.130482 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744802 2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 14:32:09.130482 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744804 2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 14:32:09.130482 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:08.744806 2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 14:32:09.130951 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.744811 2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 14:32:09.130951 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.744919 2559 server.go:962] "Client rotation is on, will bootstrap in background" Jul 21 14:32:09.130951 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.747381 2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 21 14:32:09.130951 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.749038 2559 server.go:1019] "Starting client certificate rotation" Jul 21 14:32:09.130951 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.749142 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 14:32:09.130951 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.749194 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 14:32:09.130951 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.751855 2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 14:32:09.130951 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.752942 2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 14:32:09.130951 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.765055 2559 log.go:25] "Validated CRI v1 runtime API" Jul 21 14:32:09.130951 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.768108 2559 log.go:25] "Validated CRI v1 image API" Jul 21 14:32:09.130951 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.768967 2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 21 14:32:09.130951 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.773684 2559 fs.go:135] Filesystem UUIDs: map[010a2d92-bed8-4c99-bafe-e5f4efbb6fe3:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 cc1c8a12-ece7-469f-94c1-8987107bb34b:/dev/nvme0n1p3] Jul 21 14:32:09.131326 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.773700 2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 21 14:32:09.131326 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.780322 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 14:32:09.131498 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.780556 2559 manager.go:216] Machine: {Timestamp:2026-07-21 14:32:08.779142999 +0000 UTC m=+0.370562021 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096956 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21b225223f003f9a5dc1dbb37690db SystemUUID:ec21b225-223f-003f-9a5d-c1dbb37690db BootID:9f565664-fff3-4a98-962b-6a6298286082 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0d:cd:e8:3d:07 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0d:cd:e8:3d:07 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:76:1c:04:03:a8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 21 14:32:09.131498 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.780681 2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 21 14:32:09.131498 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.780776 2559 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 21 14:32:09.131498 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.784300 2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 21 14:32:09.131498 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.784321 2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-241.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 21 14:32:09.131498 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.785150 2559 topology_manager.go:138] "Creating topology manager with none policy" Jul 21 14:32:09.131498 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.785159 2559 container_manager_linux.go:309] "Creating device plugin manager" Jul 21 14:32:09.131498 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.785166 2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 14:32:09.131498 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.785181 2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 14:32:09.131498 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.787122 2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 21 14:32:09.131498 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.791686 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 21 14:32:09.131498 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.791791 2559 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 21 14:32:09.131498 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.791817 2559 kubelet.go:486] "Attempting to sync node with API server" Jul 21 14:32:09.131498 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.791827 2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 21 14:32:09.131498 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.791847 2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 21 14:32:09.131498 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.791856 2559 kubelet.go:398] "Adding apiserver pod source" Jul 21 14:32:09.131498 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.791865 2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 21 14:32:09.131498 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.792186 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.792203 2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.794452 2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.796696 2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.796723 2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.798247 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.798260 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.798267 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.798272 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.798281 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.798286 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.798294 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.798300 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.798306 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.798311 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.798320 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.798325 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.799218 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.799224 2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.802493 2559 server.go:1268] "Started kubelet" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.802576 2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.802674 2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.802742 2559 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.802805 2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-241.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:08.803564 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-241.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:08.803566 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.804882 2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.804927 2559 server.go:310] "Adding debug handlers to kubelet server" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:08.810136 2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:08.811607 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-241.ec2.internal.18c4548fc4af7119 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-241.ec2.internal,UID:ip-10-0-131-241.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-241.ec2.internal,},FirstTimestamp:2026-07-21 14:32:08.802447641 +0000 UTC m=+0.393866664,LastTimestamp:2026-07-21 14:32:08.802447641 +0000 UTC m=+0.393866664,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-241.ec2.internal,}" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.814320 2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.814331 2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:08.814615 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-241.ec2.internal\" not found" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.815060 2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.815061 2559 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.815083 2559 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.815134 2559 factory.go:55] Registering systemd factory Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.815150 2559 factory.go:223] Registration of the systemd container factory successfully Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.815156 2559 reconstruct.go:97] "Volume reconstruction finished" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.815167 2559 reconciler.go:29] "Reconciler: start to sync state" Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.815339 2559 factory.go:153] Registering CRI-O factory Jul 21 14:32:09.132311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.815353 2559 factory.go:223] Registration of the crio container factory successfully Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.815409 2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.815436 2559 factory.go:103] Registering Raw factory Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.815451 2559 manager.go:1196] Started watching for new ooms in manager Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.815841 2559 manager.go:349] Starting recovery of all containers Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:08.816479 2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-241.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:08.816651 2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.828115 2559 manager.go:354] Recovery completed Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.831625 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ldc8q" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.832494 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.834254 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.834283 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.834294 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.834817 2559 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.834827 2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.834843 2559 state_mem.go:36] "Initialized new in-memory state store" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.834819 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.835471 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.835492 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.835510 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.837021 2559 policy_none.go:49] "None policy: Start" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.837034 2559 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.837044 2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.839145 2559 policy_none.go:47] "Start" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.841255 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ldc8q" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:08.844094 2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-241.ec2.internal.18c4548fc694ec45 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-241.ec2.internal,UID:ip-10-0-131-241.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-241.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-241.ec2.internal,},FirstTimestamp:2026-07-21 14:32:08.834264133 +0000 UTC m=+0.425683156,LastTimestamp:2026-07-21 14:32:08.834264133 +0000 UTC m=+0.425683156,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-241.ec2.internal,}" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.895028 2559 manager.go:337] "Starting Device Plugin manager" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:08.895054 2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.895062 2559 server.go:87] "Starting device plugin registration server" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.895286 2559 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.895299 2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.895375 2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.895453 2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.895464 2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:08.896151 2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:08.896199 2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-241.ec2.internal\" not found" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.920738 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.921933 2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.921966 2559 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 21 14:32:09.291942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.921987 2559 kubelet.go:2448] "Starting kubelet main sync loop" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:08.922019 2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.924347 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.996191 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.997173 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.997197 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.997207 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:08.997255 2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-241.ec2.internal" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.009179 2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-241.ec2.internal" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:09.009197 2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-241.ec2.internal\": node \"ip-10-0-131-241.ec2.internal\" not found" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.022347 2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-241.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-241.ec2.internal"] Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.022410 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.023826 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.023851 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.023864 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.026190 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.026312 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-241.ec2.internal" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.026339 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.026827 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.026850 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.026863 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.026899 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.026917 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.026933 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.029191 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-241.ec2.internal" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.029212 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.029803 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.029831 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.029845 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:09.062590 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-241.ec2.internal\" not found" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:09.092652 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-241.ec2.internal\" not found" node="ip-10-0-131-241.ec2.internal" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:09.097831 2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-241.ec2.internal\" not found" node="ip-10-0-131-241.ec2.internal" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.116590 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eb4fd84da00f4e55709bfa044329ff2f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-241.ec2.internal\" (UID: \"eb4fd84da00f4e55709bfa044329ff2f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-241.ec2.internal" Jul 21 14:32:09.299832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.116613 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb4fd84da00f4e55709bfa044329ff2f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-241.ec2.internal\" (UID: \"eb4fd84da00f4e55709bfa044329ff2f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-241.ec2.internal" Jul 21 14:32:09.301346 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.116628 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0318e1bb0d0d8f4faaa7f8d44a8b0298-config\") pod \"kube-apiserver-proxy-ip-10-0-131-241.ec2.internal\" (UID: \"0318e1bb0d0d8f4faaa7f8d44a8b0298\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-241.ec2.internal" Jul 21 14:32:09.301346 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:09.163164 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-241.ec2.internal\" not found" Jul 21 14:32:09.301346 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.218034 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0318e1bb0d0d8f4faaa7f8d44a8b0298-config\") pod \"kube-apiserver-proxy-ip-10-0-131-241.ec2.internal\" (UID: \"0318e1bb0d0d8f4faaa7f8d44a8b0298\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-241.ec2.internal" Jul 21 14:32:09.301346 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.218056 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eb4fd84da00f4e55709bfa044329ff2f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-241.ec2.internal\" (UID: \"eb4fd84da00f4e55709bfa044329ff2f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-241.ec2.internal" Jul 21 14:32:09.301346 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.218072 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb4fd84da00f4e55709bfa044329ff2f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-241.ec2.internal\" (UID: \"eb4fd84da00f4e55709bfa044329ff2f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-241.ec2.internal" Jul 21 14:32:09.301346 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.218109 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/eb4fd84da00f4e55709bfa044329ff2f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-241.ec2.internal\" (UID: \"eb4fd84da00f4e55709bfa044329ff2f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-241.ec2.internal" Jul 21 14:32:09.301346 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.218130 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0318e1bb0d0d8f4faaa7f8d44a8b0298-config\") pod \"kube-apiserver-proxy-ip-10-0-131-241.ec2.internal\" (UID: \"0318e1bb0d0d8f4faaa7f8d44a8b0298\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-241.ec2.internal" Jul 21 14:32:09.301346 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.218138 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/eb4fd84da00f4e55709bfa044329ff2f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-241.ec2.internal\" (UID: \"eb4fd84da00f4e55709bfa044329ff2f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-241.ec2.internal" Jul 21 14:32:09.301346 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:09.263246 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-241.ec2.internal\" not found" Jul 21 14:32:09.420909 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:09.363556 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-241.ec2.internal\" not found" Jul 21 14:32:09.420909 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.396675 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-241.ec2.internal" Jul 21 14:32:09.420909 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:09.405710 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-241.ec2.internal" Jul 21 14:32:09.561459 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:09.463851 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-241.ec2.internal\" not found" Jul 21 14:32:09.564437 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:09.564214 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-241.ec2.internal\" not found" Jul 21 14:32:10.920925 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:10.856888 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-241.ec2.internal\" not found" Jul 21 14:32:11.074588 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:10.940396 2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 21 14:32:11.074588 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:10.940530 2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 14:32:11.074588 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:10.957649 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-241.ec2.internal\" not found" Jul 21 14:32:11.074588 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:11.039612 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 14:27:10 +0000 UTC" deadline="2027-12-25 15:22:00.722409406 +0000 UTC" Jul 21 14:32:11.074588 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:11.039647 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12528h49m49.682767949s" Jul 21 14:32:11.074588 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:11.058740 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-241.ec2.internal\" not found" Jul 21 14:32:11.262140 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:11.113495 2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 14:32:11.262140 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:11.115804 2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 14:32:11.262140 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:11.116693 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasSufficientMemory" Jul 21 14:32:11.262140 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:11.116719 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 14:32:11.262140 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:11.116728 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeHasSufficientPID" Jul 21 14:32:11.262140 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:11.146426 2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 14:32:11.262140 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:11.159247 2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-241.ec2.internal\" not found" Jul 21 14:32:11.262140 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:11.205678 2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 14:32:11.262140 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:11.207333 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-241.ec2.internal" Jul 21 14:32:11.262140 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:11.219422 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 14:32:11.262140 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:11.220263 2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-241.ec2.internal" Jul 21 14:32:11.262140 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:11.227122 2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 14:32:11.423452 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:11.361451 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb4fd84da00f4e55709bfa044329ff2f.slice/crio-5eb8010e02a0e273e33c1084a93ded649cb471dc2d0ea8c6491f9935c2beed3a WatchSource:0}: Error finding container 5eb8010e02a0e273e33c1084a93ded649cb471dc2d0ea8c6491f9935c2beed3a: Status 404 returned error can't find the container with id 5eb8010e02a0e273e33c1084a93ded649cb471dc2d0ea8c6491f9935c2beed3a Jul 21 14:32:11.423452 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:11.368112 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 14:32:11.896243 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:11.776586 2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:11.985892 2559 apiserver.go:52] "Watching apiserver" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:11.992167 2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:11.992485 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-lcc8w","openshift-dns/node-resolver-4wjk4","openshift-image-registry/node-ca-l5lf7","openshift-multus/network-metrics-daemon-jt8tp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-241.ec2.internal","openshift-multus/multus-6dkcz","openshift-multus/multus-additional-cni-plugins-5lwvs","openshift-network-diagnostics/network-check-target-hfzqm","openshift-network-operator/iptables-alerter-p445n","openshift-ovn-kubernetes/ovnkube-node-vvvbp","kube-system/global-pull-secret-syncer-4zv85","kube-system/konnectivity-agent-vzb6w","kube-system/kube-apiserver-proxy-ip-10-0-131-241.ec2.internal"] Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:11.996087 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:11.998780 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vzb6w" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.001020 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l5lf7" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.003190 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:12.003277 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt8tp" podUID="ff2e3b8e-ffa1-4753-973f-fd67e111bf2e" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.005306 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.006840 2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.007619 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.007687 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.007721 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.007946 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.007970 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.008129 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.008681 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.008815 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-s7l79\"" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.009119 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nnkkc\"" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.009181 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.009398 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.009430 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.009447 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.009614 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n45rr\"" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.009830 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.012205 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.012312 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.012776 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:12.012919 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzqm" podUID="68244146-2fb6-42ed-8c43-730c2f1fbc2f" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.018400 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z4bf8\"" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.018597 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 21 14:32:12.022152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.018597 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-87lhf\"" Jul 21 14:32:12.024017 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.021331 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.024017 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.023933 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4wjk4" Jul 21 14:32:12.031960 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.025522 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p445n" Jul 21 14:32:12.031960 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.025974 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-host-run-multus-certs\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.031960 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.025991 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d7de8025-df5f-4161-ab2f-392d1423c347-sys-fs\") pod \"aws-ebs-csi-driver-node-g54zk\" (UID: \"d7de8025-df5f-4161-ab2f-392d1423c347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.031960 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026009 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-cni-binary-copy\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.031960 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026025 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmdsj\" (UniqueName: \"kubernetes.io/projected/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-kube-api-access-kmdsj\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.031960 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026041 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-multus-socket-dir-parent\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.031960 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026055 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-host-var-lib-cni-multus\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.031960 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026069 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d7de8025-df5f-4161-ab2f-392d1423c347-etc-selinux\") pod \"aws-ebs-csi-driver-node-g54zk\" (UID: \"d7de8025-df5f-4161-ab2f-392d1423c347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.031960 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026084 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-cnibin\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.031960 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026098 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50a6cbf2-12aa-4865-bb4a-7da8da663354-cni-binary-copy\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.031960 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026112 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/50a6cbf2-12aa-4865-bb4a-7da8da663354-multus-daemon-config\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.031960 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026126 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d7de8025-df5f-4161-ab2f-392d1423c347-socket-dir\") pod \"aws-ebs-csi-driver-node-g54zk\" (UID: \"d7de8025-df5f-4161-ab2f-392d1423c347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.031960 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026141 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrbtz\" (UniqueName: \"kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz\") pod \"network-check-target-hfzqm\" (UID: \"68244146-2fb6-42ed-8c43-730c2f1fbc2f\") " pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:12.031960 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026155 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f443a0aa-6687-44b0-9581-4e8953060962-host\") pod \"node-ca-l5lf7\" (UID: \"f443a0aa-6687-44b0-9581-4e8953060962\") " pod="openshift-image-registry/node-ca-l5lf7" Jul 21 14:32:12.031960 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026169 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs\") pod \"network-metrics-daemon-jt8tp\" (UID: \"ff2e3b8e-ffa1-4753-973f-fd67e111bf2e\") " pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:12.031960 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026190 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-system-cni-dir\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.031960 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026209 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d7de8025-df5f-4161-ab2f-392d1423c347-registration-dir\") pod \"aws-ebs-csi-driver-node-g54zk\" (UID: \"d7de8025-df5f-4161-ab2f-392d1423c347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.033709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026223 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-host-run-k8s-cni-cncf-io\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.033709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026244 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d051a06b-b3a7-450f-bb8a-bf17d427873b-konnectivity-ca\") pod \"konnectivity-agent-vzb6w\" (UID: \"d051a06b-b3a7-450f-bb8a-bf17d427873b\") " pod="kube-system/konnectivity-agent-vzb6w" Jul 21 14:32:12.033709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026260 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mt28\" (UniqueName: \"kubernetes.io/projected/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-kube-api-access-5mt28\") pod \"network-metrics-daemon-jt8tp\" (UID: \"ff2e3b8e-ffa1-4753-973f-fd67e111bf2e\") " pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:12.033709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026274 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.033709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026291 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.033709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026304 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-system-cni-dir\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.033709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026318 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-multus-conf-dir\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.033709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026332 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d7de8025-df5f-4161-ab2f-392d1423c347-device-dir\") pod \"aws-ebs-csi-driver-node-g54zk\" (UID: \"d7de8025-df5f-4161-ab2f-392d1423c347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.033709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026346 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-host-run-netns\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.033709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026374 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f443a0aa-6687-44b0-9581-4e8953060962-serviceca\") pod \"node-ca-l5lf7\" (UID: \"f443a0aa-6687-44b0-9581-4e8953060962\") " pod="openshift-image-registry/node-ca-l5lf7" Jul 21 14:32:12.033709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026415 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsf6z\" (UniqueName: \"kubernetes.io/projected/50a6cbf2-12aa-4865-bb4a-7da8da663354-kube-api-access-qsf6z\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.033709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026431 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glzlz\" (UniqueName: \"kubernetes.io/projected/d7de8025-df5f-4161-ab2f-392d1423c347-kube-api-access-glzlz\") pod \"aws-ebs-csi-driver-node-g54zk\" (UID: \"d7de8025-df5f-4161-ab2f-392d1423c347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.033709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026449 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-cnibin\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.033709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026462 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-os-release\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.033709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026476 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-host-var-lib-cni-bin\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.033709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026489 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-host-var-lib-kubelet\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.034836 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026507 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-etc-kubernetes\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.034836 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026530 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d051a06b-b3a7-450f-bb8a-bf17d427873b-agent-certs\") pod \"konnectivity-agent-vzb6w\" (UID: \"d051a06b-b3a7-450f-bb8a-bf17d427873b\") " pod="kube-system/konnectivity-agent-vzb6w" Jul 21 14:32:12.034836 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026556 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d7de8025-df5f-4161-ab2f-392d1423c347-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g54zk\" (UID: \"d7de8025-df5f-4161-ab2f-392d1423c347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.034836 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026583 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x88gr\" (UniqueName: \"kubernetes.io/projected/f443a0aa-6687-44b0-9581-4e8953060962-kube-api-access-x88gr\") pod \"node-ca-l5lf7\" (UID: \"f443a0aa-6687-44b0-9581-4e8953060962\") " pod="openshift-image-registry/node-ca-l5lf7" Jul 21 14:32:12.034836 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026630 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-os-release\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.034836 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026645 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.034836 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026662 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-multus-cni-dir\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.034836 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.026675 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-hostroot\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.034836 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.028597 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.034836 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.029975 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:12.034836 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:12.030030 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zv85" podUID="47d4c102-9f81-49f9-901a-99fd62fd7315" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.048516 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.048549 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.048554 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zgbbv\"" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.048786 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.048815 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jvq4p\"" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.049232 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.049232 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.049279 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.049309 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.049342 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.049433 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.049482 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9wwbl\"" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.049540 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.049591 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dgwn4\"" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.049670 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.057230 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.057286 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.059402 2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.059471 2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-plz4q" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.061419 2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-plz4q" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.109043 2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.118675 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-241.ec2.internal" event={"ID":"eb4fd84da00f4e55709bfa044329ff2f","Type":"ContainerStarted","Data":"5eb8010e02a0e273e33c1084a93ded649cb471dc2d0ea8c6491f9935c2beed3a"} Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130412 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsf6z\" (UniqueName: \"kubernetes.io/projected/50a6cbf2-12aa-4865-bb4a-7da8da663354-kube-api-access-qsf6z\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130435 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glzlz\" (UniqueName: \"kubernetes.io/projected/d7de8025-df5f-4161-ab2f-392d1423c347-kube-api-access-glzlz\") pod \"aws-ebs-csi-driver-node-g54zk\" (UID: \"d7de8025-df5f-4161-ab2f-392d1423c347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130459 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl2xj\" (UniqueName: \"kubernetes.io/projected/60210dbf-9a04-4c44-a654-d6fd2cf80403-kube-api-access-fl2xj\") pod \"node-resolver-4wjk4\" (UID: \"60210dbf-9a04-4c44-a654-d6fd2cf80403\") " pod="openshift-dns/node-resolver-4wjk4" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130477 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-log-socket\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130492 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-os-release\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.177443 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130515 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60210dbf-9a04-4c44-a654-d6fd2cf80403-tmp-dir\") pod \"node-resolver-4wjk4\" (UID: \"60210dbf-9a04-4c44-a654-d6fd2cf80403\") " pod="openshift-dns/node-resolver-4wjk4" Jul 21 14:32:12.179359 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130557 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-var-lib-kubelet\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.179359 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130578 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-host\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.179359 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130610 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebd5b888-bb63-4bf0-8f9a-606b6fb115bf-host-slash\") pod \"iptables-alerter-p445n\" (UID: \"ebd5b888-bb63-4bf0-8f9a-606b6fb115bf\") " pod="openshift-network-operator/iptables-alerter-p445n" Jul 21 14:32:12.179359 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130617 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-os-release\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.179359 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130657 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b687553-a920-4035-b157-ecd4856656e0-env-overrides\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.179359 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130677 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d7de8025-df5f-4161-ab2f-392d1423c347-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g54zk\" (UID: \"d7de8025-df5f-4161-ab2f-392d1423c347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.179359 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130693 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-etc-sysctl-d\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.179359 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130712 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.179359 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130734 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-os-release\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.179359 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130758 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d7de8025-df5f-4161-ab2f-392d1423c347-kubelet-dir\") pod \"aws-ebs-csi-driver-node-g54zk\" (UID: \"d7de8025-df5f-4161-ab2f-392d1423c347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.179359 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130762 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.179359 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130823 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-multus-cni-dir\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.179359 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130835 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-os-release\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.179359 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130898 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-hostroot\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.179359 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130927 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-host-run-multus-certs\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.179359 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130937 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-hostroot\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.179359 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130946 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-etc-kubernetes\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.182153 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130956 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-host-run-multus-certs\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.182153 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130962 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c86a48f-d838-49dc-9142-cb2c9350c4b4-tmp\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.182153 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130984 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-cni-binary-copy\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.182153 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131001 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmdsj\" (UniqueName: \"kubernetes.io/projected/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-kube-api-access-kmdsj\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.182153 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.130983 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-multus-cni-dir\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.182153 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131024 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-multus-socket-dir-parent\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.182153 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131073 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-multus-socket-dir-parent\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.182153 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131099 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-host-var-lib-cni-multus\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.182153 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131122 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d7de8025-df5f-4161-ab2f-392d1423c347-etc-selinux\") pod \"aws-ebs-csi-driver-node-g54zk\" (UID: \"d7de8025-df5f-4161-ab2f-392d1423c347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.182153 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131146 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-etc-sysconfig\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.182153 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131161 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-host-var-lib-cni-multus\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.182153 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131169 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5c86a48f-d838-49dc-9142-cb2c9350c4b4-etc-tuned\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.182153 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131211 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50a6cbf2-12aa-4865-bb4a-7da8da663354-cni-binary-copy\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.182153 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131227 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-etc-modprobe-d\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.182153 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131234 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d7de8025-df5f-4161-ab2f-392d1423c347-etc-selinux\") pod \"aws-ebs-csi-driver-node-g54zk\" (UID: \"d7de8025-df5f-4161-ab2f-392d1423c347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.182153 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131241 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-sys\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.182153 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131255 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-lib-modules\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.183009 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131269 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff75g\" (UniqueName: \"kubernetes.io/projected/5c86a48f-d838-49dc-9142-cb2c9350c4b4-kube-api-access-ff75g\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.183009 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131283 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-host-kubelet\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.183009 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131296 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-host-slash\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.183009 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131306 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.183009 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131333 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/47d4c102-9f81-49f9-901a-99fd62fd7315-kubelet-config\") pod \"global-pull-secret-syncer-4zv85\" (UID: \"47d4c102-9f81-49f9-901a-99fd62fd7315\") " pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:12.183009 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131351 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f443a0aa-6687-44b0-9581-4e8953060962-host\") pod \"node-ca-l5lf7\" (UID: \"f443a0aa-6687-44b0-9581-4e8953060962\") " pod="openshift-image-registry/node-ca-l5lf7" Jul 21 14:32:12.183009 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131367 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d7de8025-df5f-4161-ab2f-392d1423c347-registration-dir\") pod \"aws-ebs-csi-driver-node-g54zk\" (UID: \"d7de8025-df5f-4161-ab2f-392d1423c347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.183009 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131380 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-systemd-units\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.183009 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131402 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-run-openvswitch\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.183009 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131409 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f443a0aa-6687-44b0-9581-4e8953060962-host\") pod \"node-ca-l5lf7\" (UID: \"f443a0aa-6687-44b0-9581-4e8953060962\") " pod="openshift-image-registry/node-ca-l5lf7" Jul 21 14:32:12.183009 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131428 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-node-log\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.183009 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131436 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d7de8025-df5f-4161-ab2f-392d1423c347-registration-dir\") pod \"aws-ebs-csi-driver-node-g54zk\" (UID: \"d7de8025-df5f-4161-ab2f-392d1423c347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.183009 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131442 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-host-cni-netd\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.183009 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131466 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbqh6\" (UniqueName: \"kubernetes.io/projected/5b687553-a920-4035-b157-ecd4856656e0-kube-api-access-vbqh6\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.183009 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131492 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-host-run-k8s-cni-cncf-io\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.183009 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131508 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d051a06b-b3a7-450f-bb8a-bf17d427873b-konnectivity-ca\") pod \"konnectivity-agent-vzb6w\" (UID: \"d051a06b-b3a7-450f-bb8a-bf17d427873b\") " pod="kube-system/konnectivity-agent-vzb6w" Jul 21 14:32:12.183009 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131533 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.185312 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131544 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-host-run-k8s-cni-cncf-io\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.185312 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131604 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-system-cni-dir\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.185312 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131636 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d7de8025-df5f-4161-ab2f-392d1423c347-device-dir\") pod \"aws-ebs-csi-driver-node-g54zk\" (UID: \"d7de8025-df5f-4161-ab2f-392d1423c347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.185312 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131661 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ebd5b888-bb63-4bf0-8f9a-606b6fb115bf-iptables-alerter-script\") pod \"iptables-alerter-p445n\" (UID: \"ebd5b888-bb63-4bf0-8f9a-606b6fb115bf\") " pod="openshift-network-operator/iptables-alerter-p445n" Jul 21 14:32:12.185312 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131678 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-run-systemd\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.185312 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131686 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-system-cni-dir\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.185312 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131696 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-host-run-netns\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.185312 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131702 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50a6cbf2-12aa-4865-bb4a-7da8da663354-cni-binary-copy\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.185312 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131712 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d7de8025-df5f-4161-ab2f-392d1423c347-device-dir\") pod \"aws-ebs-csi-driver-node-g54zk\" (UID: \"d7de8025-df5f-4161-ab2f-392d1423c347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.185312 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131726 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f443a0aa-6687-44b0-9581-4e8953060962-serviceca\") pod \"node-ca-l5lf7\" (UID: \"f443a0aa-6687-44b0-9581-4e8953060962\") " pod="openshift-image-registry/node-ca-l5lf7" Jul 21 14:32:12.185312 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131752 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-host-run-netns\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.185312 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131809 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-run\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.185312 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131875 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-cnibin\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.185312 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131908 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-host-var-lib-cni-bin\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.185312 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131933 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-host-var-lib-kubelet\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.185312 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131986 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-host-var-lib-kubelet\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.185312 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131997 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-host-var-lib-cni-bin\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.185312 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131995 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-etc-kubernetes\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.186177 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.131987 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-cnibin\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.186177 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132027 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/60210dbf-9a04-4c44-a654-d6fd2cf80403-hosts-file\") pod \"node-resolver-4wjk4\" (UID: \"60210dbf-9a04-4c44-a654-d6fd2cf80403\") " pod="openshift-dns/node-resolver-4wjk4" Jul 21 14:32:12.186177 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132046 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-etc-kubernetes\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.186177 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132047 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.186177 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132047 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d051a06b-b3a7-450f-bb8a-bf17d427873b-konnectivity-ca\") pod \"konnectivity-agent-vzb6w\" (UID: \"d051a06b-b3a7-450f-bb8a-bf17d427873b\") " pod="kube-system/konnectivity-agent-vzb6w" Jul 21 14:32:12.186177 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132078 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d051a06b-b3a7-450f-bb8a-bf17d427873b-agent-certs\") pod \"konnectivity-agent-vzb6w\" (UID: \"d051a06b-b3a7-450f-bb8a-bf17d427873b\") " pod="kube-system/konnectivity-agent-vzb6w" Jul 21 14:32:12.186177 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132115 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b687553-a920-4035-b157-ecd4856656e0-ovnkube-config\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.186177 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132136 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f443a0aa-6687-44b0-9581-4e8953060962-serviceca\") pod \"node-ca-l5lf7\" (UID: \"f443a0aa-6687-44b0-9581-4e8953060962\") " pod="openshift-image-registry/node-ca-l5lf7" Jul 21 14:32:12.186177 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132136 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/47d4c102-9f81-49f9-901a-99fd62fd7315-dbus\") pod \"global-pull-secret-syncer-4zv85\" (UID: \"47d4c102-9f81-49f9-901a-99fd62fd7315\") " pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:12.186177 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132176 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x88gr\" (UniqueName: \"kubernetes.io/projected/f443a0aa-6687-44b0-9581-4e8953060962-kube-api-access-x88gr\") pod \"node-ca-l5lf7\" (UID: \"f443a0aa-6687-44b0-9581-4e8953060962\") " pod="openshift-image-registry/node-ca-l5lf7" Jul 21 14:32:12.186177 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132196 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d7de8025-df5f-4161-ab2f-392d1423c347-sys-fs\") pod \"aws-ebs-csi-driver-node-g54zk\" (UID: \"d7de8025-df5f-4161-ab2f-392d1423c347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.186177 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132219 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b687553-a920-4035-b157-ecd4856656e0-ovn-node-metrics-cert\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.186177 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132246 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-var-lib-openvswitch\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.186177 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132264 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d7de8025-df5f-4161-ab2f-392d1423c347-sys-fs\") pod \"aws-ebs-csi-driver-node-g54zk\" (UID: \"d7de8025-df5f-4161-ab2f-392d1423c347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.186177 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132268 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-etc-openvswitch\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.186177 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132292 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-host-run-ovn-kubernetes\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.186177 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132311 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-cni-binary-copy\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.188324 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132320 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-cnibin\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.188324 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132330 2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 21 14:32:12.188324 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132344 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/50a6cbf2-12aa-4865-bb4a-7da8da663354-multus-daemon-config\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.188324 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132364 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-cnibin\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.188324 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132367 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d7de8025-df5f-4161-ab2f-392d1423c347-socket-dir\") pod \"aws-ebs-csi-driver-node-g54zk\" (UID: \"d7de8025-df5f-4161-ab2f-392d1423c347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.188324 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132397 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-etc-sysctl-conf\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.188324 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132420 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-host-run-netns\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.188324 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132437 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-run-ovn\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.188324 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132445 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d7de8025-df5f-4161-ab2f-392d1423c347-socket-dir\") pod \"aws-ebs-csi-driver-node-g54zk\" (UID: \"d7de8025-df5f-4161-ab2f-392d1423c347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.188324 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132453 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrbtz\" (UniqueName: \"kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz\") pod \"network-check-target-hfzqm\" (UID: \"68244146-2fb6-42ed-8c43-730c2f1fbc2f\") " pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:12.188324 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132508 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs\") pod \"network-metrics-daemon-jt8tp\" (UID: \"ff2e3b8e-ffa1-4753-973f-fd67e111bf2e\") " pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:12.188324 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132553 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-system-cni-dir\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.188324 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:12.132581 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:32:12.188324 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132616 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-etc-systemd\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.188324 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132638 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-system-cni-dir\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.188324 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:12.132648 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs podName:ff2e3b8e-ffa1-4753-973f-fd67e111bf2e nodeName:}" failed. No retries permitted until 2026-07-21 14:32:12.63262988 +0000 UTC m=+3.031775048 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs") pod "network-metrics-daemon-jt8tp" (UID: "ff2e3b8e-ffa1-4753-973f-fd67e111bf2e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:32:12.188324 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132674 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k527\" (UniqueName: \"kubernetes.io/projected/ebd5b888-bb63-4bf0-8f9a-606b6fb115bf-kube-api-access-2k527\") pod \"iptables-alerter-p445n\" (UID: \"ebd5b888-bb63-4bf0-8f9a-606b6fb115bf\") " pod="openshift-network-operator/iptables-alerter-p445n" Jul 21 14:32:12.189205 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132699 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b687553-a920-4035-b157-ecd4856656e0-ovnkube-script-lib\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.189205 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132729 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mt28\" (UniqueName: \"kubernetes.io/projected/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-kube-api-access-5mt28\") pod \"network-metrics-daemon-jt8tp\" (UID: \"ff2e3b8e-ffa1-4753-973f-fd67e111bf2e\") " pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:12.189205 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132735 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/50a6cbf2-12aa-4865-bb4a-7da8da663354-multus-daemon-config\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.189205 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132755 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.189205 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132779 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-multus-conf-dir\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.189205 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132808 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-host-cni-bin\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.189205 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132828 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret\") pod \"global-pull-secret-syncer-4zv85\" (UID: \"47d4c102-9f81-49f9-901a-99fd62fd7315\") " pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:12.189205 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132844 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50a6cbf2-12aa-4865-bb4a-7da8da663354-multus-conf-dir\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.189205 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.132881 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.189205 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.136048 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d051a06b-b3a7-450f-bb8a-bf17d427873b-agent-certs\") pod \"konnectivity-agent-vzb6w\" (UID: \"d051a06b-b3a7-450f-bb8a-bf17d427873b\") " pod="kube-system/konnectivity-agent-vzb6w" Jul 21 14:32:12.189205 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.137587 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glzlz\" (UniqueName: \"kubernetes.io/projected/d7de8025-df5f-4161-ab2f-392d1423c347-kube-api-access-glzlz\") pod \"aws-ebs-csi-driver-node-g54zk\" (UID: \"d7de8025-df5f-4161-ab2f-392d1423c347\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.189205 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:12.137726 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 14:32:12.189205 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:12.137746 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 14:32:12.189205 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:12.137760 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jrbtz for pod openshift-network-diagnostics/network-check-target-hfzqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:32:12.189205 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:12.137835 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz podName:68244146-2fb6-42ed-8c43-730c2f1fbc2f nodeName:}" failed. No retries permitted until 2026-07-21 14:32:12.637818923 +0000 UTC m=+3.036964083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jrbtz" (UniqueName: "kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz") pod "network-check-target-hfzqm" (UID: "68244146-2fb6-42ed-8c43-730c2f1fbc2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:32:12.189205 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.137867 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsf6z\" (UniqueName: \"kubernetes.io/projected/50a6cbf2-12aa-4865-bb4a-7da8da663354-kube-api-access-qsf6z\") pod \"multus-6dkcz\" (UID: \"50a6cbf2-12aa-4865-bb4a-7da8da663354\") " pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.189205 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.138745 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmdsj\" (UniqueName: \"kubernetes.io/projected/8dcb8d95-8dc6-44a6-96b7-40f6453a7a79-kube-api-access-kmdsj\") pod \"multus-additional-cni-plugins-5lwvs\" (UID: \"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79\") " pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.192029 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.139065 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x88gr\" (UniqueName: \"kubernetes.io/projected/f443a0aa-6687-44b0-9581-4e8953060962-kube-api-access-x88gr\") pod \"node-ca-l5lf7\" (UID: \"f443a0aa-6687-44b0-9581-4e8953060962\") " pod="openshift-image-registry/node-ca-l5lf7" Jul 21 14:32:12.192029 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.140105 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mt28\" (UniqueName: \"kubernetes.io/projected/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-kube-api-access-5mt28\") pod \"network-metrics-daemon-jt8tp\" (UID: \"ff2e3b8e-ffa1-4753-973f-fd67e111bf2e\") " pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:12.323090 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233309 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl2xj\" (UniqueName: \"kubernetes.io/projected/60210dbf-9a04-4c44-a654-d6fd2cf80403-kube-api-access-fl2xj\") pod \"node-resolver-4wjk4\" (UID: \"60210dbf-9a04-4c44-a654-d6fd2cf80403\") " pod="openshift-dns/node-resolver-4wjk4" Jul 21 14:32:12.323090 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233332 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-log-socket\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.323090 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233349 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60210dbf-9a04-4c44-a654-d6fd2cf80403-tmp-dir\") pod \"node-resolver-4wjk4\" (UID: \"60210dbf-9a04-4c44-a654-d6fd2cf80403\") " pod="openshift-dns/node-resolver-4wjk4" Jul 21 14:32:12.323090 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233363 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-var-lib-kubelet\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.323090 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233378 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-host\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.323090 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233413 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-log-socket\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.323090 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233421 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-var-lib-kubelet\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.323090 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233470 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebd5b888-bb63-4bf0-8f9a-606b6fb115bf-host-slash\") pod \"iptables-alerter-p445n\" (UID: \"ebd5b888-bb63-4bf0-8f9a-606b6fb115bf\") " pod="openshift-network-operator/iptables-alerter-p445n" Jul 21 14:32:12.323090 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233495 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b687553-a920-4035-b157-ecd4856656e0-env-overrides\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.323090 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233519 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-etc-sysctl-d\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.323090 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233531 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ebd5b888-bb63-4bf0-8f9a-606b6fb115bf-host-slash\") pod \"iptables-alerter-p445n\" (UID: \"ebd5b888-bb63-4bf0-8f9a-606b6fb115bf\") " pod="openshift-network-operator/iptables-alerter-p445n" Jul 21 14:32:12.323090 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233541 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-host\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.323090 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233545 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.323090 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233576 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-etc-kubernetes\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.323090 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233593 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-etc-sysctl-d\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.323090 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233596 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c86a48f-d838-49dc-9142-cb2c9350c4b4-tmp\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.323090 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233624 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-etc-kubernetes\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.326333 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233629 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.326333 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233635 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-etc-sysconfig\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.326333 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233674 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-etc-sysconfig\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.326333 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233729 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5c86a48f-d838-49dc-9142-cb2c9350c4b4-etc-tuned\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.326333 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233759 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-etc-modprobe-d\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.326333 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233785 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-sys\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.326333 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233824 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-lib-modules\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.326333 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233843 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/60210dbf-9a04-4c44-a654-d6fd2cf80403-tmp-dir\") pod \"node-resolver-4wjk4\" (UID: \"60210dbf-9a04-4c44-a654-d6fd2cf80403\") " pod="openshift-dns/node-resolver-4wjk4" Jul 21 14:32:12.326333 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233847 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff75g\" (UniqueName: \"kubernetes.io/projected/5c86a48f-d838-49dc-9142-cb2c9350c4b4-kube-api-access-ff75g\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.326333 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233861 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-sys\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.326333 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233877 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-host-kubelet\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.326333 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233880 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-etc-modprobe-d\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.326333 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233919 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-host-slash\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.326333 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233941 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-lib-modules\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.326333 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233952 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-host-kubelet\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.326333 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233979 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/47d4c102-9f81-49f9-901a-99fd62fd7315-kubelet-config\") pod \"global-pull-secret-syncer-4zv85\" (UID: \"47d4c102-9f81-49f9-901a-99fd62fd7315\") " pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:12.326333 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.233988 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-host-slash\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.326333 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234002 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5b687553-a920-4035-b157-ecd4856656e0-env-overrides\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.327651 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234045 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-systemd-units\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.327651 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234049 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/47d4c102-9f81-49f9-901a-99fd62fd7315-kubelet-config\") pod \"global-pull-secret-syncer-4zv85\" (UID: \"47d4c102-9f81-49f9-901a-99fd62fd7315\") " pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:12.327651 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234078 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-systemd-units\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.327651 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234080 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-run-openvswitch\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.327651 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234105 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-node-log\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.327651 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234128 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-host-cni-netd\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.327651 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234146 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-run-openvswitch\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.327651 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234153 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbqh6\" (UniqueName: \"kubernetes.io/projected/5b687553-a920-4035-b157-ecd4856656e0-kube-api-access-vbqh6\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.327651 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234164 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-node-log\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.327651 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234191 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-host-cni-netd\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.327651 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234191 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ebd5b888-bb63-4bf0-8f9a-606b6fb115bf-iptables-alerter-script\") pod \"iptables-alerter-p445n\" (UID: \"ebd5b888-bb63-4bf0-8f9a-606b6fb115bf\") " pod="openshift-network-operator/iptables-alerter-p445n" Jul 21 14:32:12.327651 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234238 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-run-systemd\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.327651 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234264 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-run\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.327651 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234289 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/60210dbf-9a04-4c44-a654-d6fd2cf80403-hosts-file\") pod \"node-resolver-4wjk4\" (UID: \"60210dbf-9a04-4c44-a654-d6fd2cf80403\") " pod="openshift-dns/node-resolver-4wjk4" Jul 21 14:32:12.327651 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234294 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-run-systemd\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.327651 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234313 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b687553-a920-4035-b157-ecd4856656e0-ovnkube-config\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.327651 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234351 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-run\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.327651 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234356 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/60210dbf-9a04-4c44-a654-d6fd2cf80403-hosts-file\") pod \"node-resolver-4wjk4\" (UID: \"60210dbf-9a04-4c44-a654-d6fd2cf80403\") " pod="openshift-dns/node-resolver-4wjk4" Jul 21 14:32:12.328542 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234357 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/47d4c102-9f81-49f9-901a-99fd62fd7315-dbus\") pod \"global-pull-secret-syncer-4zv85\" (UID: \"47d4c102-9f81-49f9-901a-99fd62fd7315\") " pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:12.328542 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234391 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b687553-a920-4035-b157-ecd4856656e0-ovn-node-metrics-cert\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.328542 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234430 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-var-lib-openvswitch\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.328542 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234445 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/47d4c102-9f81-49f9-901a-99fd62fd7315-dbus\") pod \"global-pull-secret-syncer-4zv85\" (UID: \"47d4c102-9f81-49f9-901a-99fd62fd7315\") " pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:12.328542 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234454 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-etc-openvswitch\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.328542 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234496 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-etc-openvswitch\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.328542 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234518 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-host-run-ovn-kubernetes\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.328542 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234550 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-etc-sysctl-conf\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.328542 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234554 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-var-lib-openvswitch\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.328542 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234575 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-host-run-netns\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.328542 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234618 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-host-run-ovn-kubernetes\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.328542 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234645 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-run-ovn\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.328542 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234665 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-host-run-netns\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.328542 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234696 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-etc-sysctl-conf\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.328542 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234702 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-etc-systemd\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.328542 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234713 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-run-ovn\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.328542 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234702 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ebd5b888-bb63-4bf0-8f9a-606b6fb115bf-iptables-alerter-script\") pod \"iptables-alerter-p445n\" (UID: \"ebd5b888-bb63-4bf0-8f9a-606b6fb115bf\") " pod="openshift-network-operator/iptables-alerter-p445n" Jul 21 14:32:12.332170 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234750 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k527\" (UniqueName: \"kubernetes.io/projected/ebd5b888-bb63-4bf0-8f9a-606b6fb115bf-kube-api-access-2k527\") pod \"iptables-alerter-p445n\" (UID: \"ebd5b888-bb63-4bf0-8f9a-606b6fb115bf\") " pod="openshift-network-operator/iptables-alerter-p445n" Jul 21 14:32:12.332170 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234754 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5c86a48f-d838-49dc-9142-cb2c9350c4b4-etc-systemd\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.332170 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234808 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b687553-a920-4035-b157-ecd4856656e0-ovnkube-script-lib\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.332170 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234840 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-host-cni-bin\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.332170 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234855 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5b687553-a920-4035-b157-ecd4856656e0-ovnkube-config\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.332170 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234864 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret\") pod \"global-pull-secret-syncer-4zv85\" (UID: \"47d4c102-9f81-49f9-901a-99fd62fd7315\") " pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:12.332170 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.234906 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5b687553-a920-4035-b157-ecd4856656e0-host-cni-bin\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.332170 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:12.234947 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 14:32:12.332170 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:12.235021 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret podName:47d4c102-9f81-49f9-901a-99fd62fd7315 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:12.735009201 +0000 UTC m=+3.134154362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret") pod "global-pull-secret-syncer-4zv85" (UID: "47d4c102-9f81-49f9-901a-99fd62fd7315") : object "kube-system"/"original-pull-secret" not registered Jul 21 14:32:12.332170 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.235268 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5b687553-a920-4035-b157-ecd4856656e0-ovnkube-script-lib\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.332170 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.235858 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5c86a48f-d838-49dc-9142-cb2c9350c4b4-etc-tuned\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.332170 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.235926 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5c86a48f-d838-49dc-9142-cb2c9350c4b4-tmp\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.332170 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.236330 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b687553-a920-4035-b157-ecd4856656e0-ovn-node-metrics-cert\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.332170 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.240489 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff75g\" (UniqueName: \"kubernetes.io/projected/5c86a48f-d838-49dc-9142-cb2c9350c4b4-kube-api-access-ff75g\") pod \"tuned-lcc8w\" (UID: \"5c86a48f-d838-49dc-9142-cb2c9350c4b4\") " pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.332170 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.240669 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl2xj\" (UniqueName: \"kubernetes.io/projected/60210dbf-9a04-4c44-a654-d6fd2cf80403-kube-api-access-fl2xj\") pod \"node-resolver-4wjk4\" (UID: \"60210dbf-9a04-4c44-a654-d6fd2cf80403\") " pod="openshift-dns/node-resolver-4wjk4" Jul 21 14:32:12.332170 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.242000 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbqh6\" (UniqueName: \"kubernetes.io/projected/5b687553-a920-4035-b157-ecd4856656e0-kube-api-access-vbqh6\") pod \"ovnkube-node-vvvbp\" (UID: \"5b687553-a920-4035-b157-ecd4856656e0\") " pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.332170 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.242385 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k527\" (UniqueName: \"kubernetes.io/projected/ebd5b888-bb63-4bf0-8f9a-606b6fb115bf-kube-api-access-2k527\") pod \"iptables-alerter-p445n\" (UID: \"ebd5b888-bb63-4bf0-8f9a-606b6fb115bf\") " pod="openshift-network-operator/iptables-alerter-p445n" Jul 21 14:32:12.332170 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.321369 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6dkcz" Jul 21 14:32:12.333292 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.327657 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vzb6w" Jul 21 14:32:12.333292 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:12.331660 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50a6cbf2_12aa_4865_bb4a_7da8da663354.slice/crio-49a035baaba07aa4c4155330e3d93a4bac1c66684df5ade017c7025ca7e36b98 WatchSource:0}: Error finding container 49a035baaba07aa4c4155330e3d93a4bac1c66684df5ade017c7025ca7e36b98: Status 404 returned error can't find the container with id 49a035baaba07aa4c4155330e3d93a4bac1c66684df5ade017c7025ca7e36b98 Jul 21 14:32:12.333292 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.333196 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l5lf7" Jul 21 14:32:12.444111 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.339681 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" Jul 21 14:32:12.444111 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:12.341901 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf443a0aa_6687_44b0_9581_4e8953060962.slice/crio-f53a014f341595814677355eeffc3c95bce9a4519bbfd1ec7a2f05be72981d41 WatchSource:0}: Error finding container f53a014f341595814677355eeffc3c95bce9a4519bbfd1ec7a2f05be72981d41: Status 404 returned error can't find the container with id f53a014f341595814677355eeffc3c95bce9a4519bbfd1ec7a2f05be72981d41 Jul 21 14:32:12.444111 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.343391 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5lwvs" Jul 21 14:32:12.444111 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.349437 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" Jul 21 14:32:12.444111 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:12.352198 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dcb8d95_8dc6_44a6_96b7_40f6453a7a79.slice/crio-cb6d2843b871543d7e858d12f0b7f7d00b53f1362fe31071017f6926d4dcde4c WatchSource:0}: Error finding container cb6d2843b871543d7e858d12f0b7f7d00b53f1362fe31071017f6926d4dcde4c: Status 404 returned error can't find the container with id cb6d2843b871543d7e858d12f0b7f7d00b53f1362fe31071017f6926d4dcde4c Jul 21 14:32:12.444111 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.354721 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4wjk4" Jul 21 14:32:12.444111 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:12.357421 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c86a48f_d838_49dc_9142_cb2c9350c4b4.slice/crio-d61fbc2ccc19182b3bee45b4eb025733d2f8026170d159ae9c85bc3aa01c0d75 WatchSource:0}: Error finding container d61fbc2ccc19182b3bee45b4eb025733d2f8026170d159ae9c85bc3aa01c0d75: Status 404 returned error can't find the container with id d61fbc2ccc19182b3bee45b4eb025733d2f8026170d159ae9c85bc3aa01c0d75 Jul 21 14:32:12.444111 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.367679 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-p445n" Jul 21 14:32:12.444111 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.372270 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:12.444111 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:12.375918 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebd5b888_bb63_4bf0_8f9a_606b6fb115bf.slice/crio-e4bc70f72b8b61460638676a6ccd6c6f472703346c1b2eef77f6713d18891b28 WatchSource:0}: Error finding container e4bc70f72b8b61460638676a6ccd6c6f472703346c1b2eef77f6713d18891b28: Status 404 returned error can't find the container with id e4bc70f72b8b61460638676a6ccd6c6f472703346c1b2eef77f6713d18891b28 Jul 21 14:32:12.444111 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:12.380385 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b687553_a920_4035_b157_ecd4856656e0.slice/crio-28e5023c317176f55f413e047b02ea91e0723224a136e3708263b0c756b2871e WatchSource:0}: Error finding container 28e5023c317176f55f413e047b02ea91e0723224a136e3708263b0c756b2871e: Status 404 returned error can't find the container with id 28e5023c317176f55f413e047b02ea91e0723224a136e3708263b0c756b2871e Jul 21 14:32:12.571243 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:12.531315 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0318e1bb0d0d8f4faaa7f8d44a8b0298.slice/crio-7a029e54eb85daf48b46a2db072ae6441818a7bbfeaa455f4b811dd2723fb00e WatchSource:0}: Error finding container 7a029e54eb85daf48b46a2db072ae6441818a7bbfeaa455f4b811dd2723fb00e: Status 404 returned error can't find the container with id 7a029e54eb85daf48b46a2db072ae6441818a7bbfeaa455f4b811dd2723fb00e Jul 21 14:32:12.637538 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.637505 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs\") pod \"network-metrics-daemon-jt8tp\" (UID: \"ff2e3b8e-ffa1-4753-973f-fd67e111bf2e\") " pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:12.637697 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:12.637627 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:32:12.637697 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:12.637676 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs podName:ff2e3b8e-ffa1-4753-973f-fd67e111bf2e nodeName:}" failed. No retries permitted until 2026-07-21 14:32:13.637663475 +0000 UTC m=+4.036808635 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs") pod "network-metrics-daemon-jt8tp" (UID: "ff2e3b8e-ffa1-4753-973f-fd67e111bf2e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:32:12.738077 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.738013 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrbtz\" (UniqueName: \"kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz\") pod \"network-check-target-hfzqm\" (UID: \"68244146-2fb6-42ed-8c43-730c2f1fbc2f\") " pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:12.738077 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:12.738057 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret\") pod \"global-pull-secret-syncer-4zv85\" (UID: \"47d4c102-9f81-49f9-901a-99fd62fd7315\") " pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:12.738226 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:12.738159 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 14:32:12.738226 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:12.738192 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 14:32:12.738226 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:12.738217 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret podName:47d4c102-9f81-49f9-901a-99fd62fd7315 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:13.738201652 +0000 UTC m=+4.137346814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret") pod "global-pull-secret-syncer-4zv85" (UID: "47d4c102-9f81-49f9-901a-99fd62fd7315") : object "kube-system"/"original-pull-secret" not registered Jul 21 14:32:12.738226 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:12.738217 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 14:32:12.738385 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:12.738234 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jrbtz for pod openshift-network-diagnostics/network-check-target-hfzqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:32:12.738385 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:12.738262 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz podName:68244146-2fb6-42ed-8c43-730c2f1fbc2f nodeName:}" failed. No retries permitted until 2026-07-21 14:32:13.738255279 +0000 UTC m=+4.137400435 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jrbtz" (UniqueName: "kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz") pod "network-check-target-hfzqm" (UID: "68244146-2fb6-42ed-8c43-730c2f1fbc2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:32:13.066122 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:13.065953 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 14:27:12 +0000 UTC" deadline="2028-04-17 07:37:50.530743996 +0000 UTC" Jul 21 14:32:13.066122 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:13.066015 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15257h5m37.464733503s" Jul 21 14:32:13.115461 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:13.114995 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:13.115461 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:13.115116 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzqm" podUID="68244146-2fb6-42ed-8c43-730c2f1fbc2f" Jul 21 14:32:13.124050 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:13.123979 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4wjk4" event={"ID":"60210dbf-9a04-4c44-a654-d6fd2cf80403","Type":"ContainerStarted","Data":"d8012433a7af9fedbfc71717ddfe5e05b479b5e840aec31a774f4f71914af8f6"} Jul 21 14:32:13.130375 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:13.130302 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6dkcz" event={"ID":"50a6cbf2-12aa-4865-bb4a-7da8da663354","Type":"ContainerStarted","Data":"49a035baaba07aa4c4155330e3d93a4bac1c66684df5ade017c7025ca7e36b98"} Jul 21 14:32:13.131678 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:13.131638 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-241.ec2.internal" event={"ID":"0318e1bb0d0d8f4faaa7f8d44a8b0298","Type":"ContainerStarted","Data":"7a029e54eb85daf48b46a2db072ae6441818a7bbfeaa455f4b811dd2723fb00e"} Jul 21 14:32:13.133427 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:13.133390 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" event={"ID":"5b687553-a920-4035-b157-ecd4856656e0","Type":"ContainerStarted","Data":"28e5023c317176f55f413e047b02ea91e0723224a136e3708263b0c756b2871e"} Jul 21 14:32:13.135031 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:13.135008 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p445n" event={"ID":"ebd5b888-bb63-4bf0-8f9a-606b6fb115bf","Type":"ContainerStarted","Data":"e4bc70f72b8b61460638676a6ccd6c6f472703346c1b2eef77f6713d18891b28"} Jul 21 14:32:13.138023 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:13.137998 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" event={"ID":"5c86a48f-d838-49dc-9142-cb2c9350c4b4","Type":"ContainerStarted","Data":"d61fbc2ccc19182b3bee45b4eb025733d2f8026170d159ae9c85bc3aa01c0d75"} Jul 21 14:32:13.143733 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:13.143707 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lwvs" event={"ID":"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79","Type":"ContainerStarted","Data":"cb6d2843b871543d7e858d12f0b7f7d00b53f1362fe31071017f6926d4dcde4c"} Jul 21 14:32:13.152240 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:13.152217 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" event={"ID":"d7de8025-df5f-4161-ab2f-392d1423c347","Type":"ContainerStarted","Data":"38b5ccdf1dddb3460a516036ef0315dacce649b6e55b7990fa29cf10dbe2be97"} Jul 21 14:32:13.155527 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:13.155503 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l5lf7" event={"ID":"f443a0aa-6687-44b0-9581-4e8953060962","Type":"ContainerStarted","Data":"f53a014f341595814677355eeffc3c95bce9a4519bbfd1ec7a2f05be72981d41"} Jul 21 14:32:13.158356 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:13.158331 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vzb6w" event={"ID":"d051a06b-b3a7-450f-bb8a-bf17d427873b","Type":"ContainerStarted","Data":"8631a21da6f9883afd9b7938e1bb927f83959ec6069e47d4e6d72e0d6838d5f6"} Jul 21 14:32:13.645642 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:13.645076 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs\") pod \"network-metrics-daemon-jt8tp\" (UID: \"ff2e3b8e-ffa1-4753-973f-fd67e111bf2e\") " pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:13.645642 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:13.645237 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:32:13.645642 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:13.645303 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs podName:ff2e3b8e-ffa1-4753-973f-fd67e111bf2e nodeName:}" failed. No retries permitted until 2026-07-21 14:32:15.645283511 +0000 UTC m=+6.044428671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs") pod "network-metrics-daemon-jt8tp" (UID: "ff2e3b8e-ffa1-4753-973f-fd67e111bf2e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:32:13.746124 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:13.746086 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrbtz\" (UniqueName: \"kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz\") pod \"network-check-target-hfzqm\" (UID: \"68244146-2fb6-42ed-8c43-730c2f1fbc2f\") " pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:13.746304 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:13.746149 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret\") pod \"global-pull-secret-syncer-4zv85\" (UID: \"47d4c102-9f81-49f9-901a-99fd62fd7315\") " pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:13.746304 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:13.746295 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 14:32:13.746465 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:13.746356 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret podName:47d4c102-9f81-49f9-901a-99fd62fd7315 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:15.746336728 +0000 UTC m=+6.145481888 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret") pod "global-pull-secret-syncer-4zv85" (UID: "47d4c102-9f81-49f9-901a-99fd62fd7315") : object "kube-system"/"original-pull-secret" not registered Jul 21 14:32:13.746853 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:13.746835 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 14:32:13.746929 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:13.746859 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 14:32:13.746929 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:13.746885 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jrbtz for pod openshift-network-diagnostics/network-check-target-hfzqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:32:13.747037 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:13.746934 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz podName:68244146-2fb6-42ed-8c43-730c2f1fbc2f nodeName:}" failed. No retries permitted until 2026-07-21 14:32:15.746919992 +0000 UTC m=+6.146065176 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jrbtz" (UniqueName: "kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz") pod "network-check-target-hfzqm" (UID: "68244146-2fb6-42ed-8c43-730c2f1fbc2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:32:14.067014 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:14.066921 2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 14:27:12 +0000 UTC" deadline="2028-04-04 12:55:41.621787488 +0000 UTC" Jul 21 14:32:14.067014 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:14.066960 2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14950h23m27.554831511s" Jul 21 14:32:14.117897 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:14.117867 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:14.118070 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:14.118010 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt8tp" podUID="ff2e3b8e-ffa1-4753-973f-fd67e111bf2e" Jul 21 14:32:14.118130 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:14.118089 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:14.118177 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:14.118158 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zv85" podUID="47d4c102-9f81-49f9-901a-99fd62fd7315" Jul 21 14:32:15.115314 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:15.115272 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:15.115881 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:15.115417 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzqm" podUID="68244146-2fb6-42ed-8c43-730c2f1fbc2f" Jul 21 14:32:15.663378 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:15.662877 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs\") pod \"network-metrics-daemon-jt8tp\" (UID: \"ff2e3b8e-ffa1-4753-973f-fd67e111bf2e\") " pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:15.663378 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:15.663110 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:32:15.663378 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:15.663173 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs podName:ff2e3b8e-ffa1-4753-973f-fd67e111bf2e nodeName:}" failed. No retries permitted until 2026-07-21 14:32:19.663154998 +0000 UTC m=+10.062300156 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs") pod "network-metrics-daemon-jt8tp" (UID: "ff2e3b8e-ffa1-4753-973f-fd67e111bf2e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:32:15.763379 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:15.763328 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrbtz\" (UniqueName: \"kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz\") pod \"network-check-target-hfzqm\" (UID: \"68244146-2fb6-42ed-8c43-730c2f1fbc2f\") " pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:15.763569 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:15.763392 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret\") pod \"global-pull-secret-syncer-4zv85\" (UID: \"47d4c102-9f81-49f9-901a-99fd62fd7315\") " pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:15.763569 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:15.763510 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 14:32:15.763677 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:15.763571 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret podName:47d4c102-9f81-49f9-901a-99fd62fd7315 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:19.763552715 +0000 UTC m=+10.162697875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret") pod "global-pull-secret-syncer-4zv85" (UID: "47d4c102-9f81-49f9-901a-99fd62fd7315") : object "kube-system"/"original-pull-secret" not registered Jul 21 14:32:15.764153 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:15.764001 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 14:32:15.764153 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:15.764024 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 14:32:15.764153 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:15.764038 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jrbtz for pod openshift-network-diagnostics/network-check-target-hfzqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:32:15.764153 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:15.764086 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz podName:68244146-2fb6-42ed-8c43-730c2f1fbc2f nodeName:}" failed. No retries permitted until 2026-07-21 14:32:19.764070501 +0000 UTC m=+10.163215658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jrbtz" (UniqueName: "kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz") pod "network-check-target-hfzqm" (UID: "68244146-2fb6-42ed-8c43-730c2f1fbc2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:32:16.116879 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:16.116604 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:16.116879 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:16.116611 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:16.116879 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:16.116757 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zv85" podUID="47d4c102-9f81-49f9-901a-99fd62fd7315" Jul 21 14:32:16.116879 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:16.116835 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt8tp" podUID="ff2e3b8e-ffa1-4753-973f-fd67e111bf2e" Jul 21 14:32:17.114879 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:17.114847 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:17.115058 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:17.114977 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzqm" podUID="68244146-2fb6-42ed-8c43-730c2f1fbc2f" Jul 21 14:32:18.115523 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:18.115385 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:18.115523 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:18.115527 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zv85" podUID="47d4c102-9f81-49f9-901a-99fd62fd7315" Jul 21 14:32:18.116082 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:18.115924 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:18.116082 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:18.116028 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt8tp" podUID="ff2e3b8e-ffa1-4753-973f-fd67e111bf2e" Jul 21 14:32:19.114928 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:19.114893 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:19.115105 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:19.115034 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzqm" podUID="68244146-2fb6-42ed-8c43-730c2f1fbc2f" Jul 21 14:32:19.695490 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:19.695457 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs\") pod \"network-metrics-daemon-jt8tp\" (UID: \"ff2e3b8e-ffa1-4753-973f-fd67e111bf2e\") " pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:19.696004 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:19.695617 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:32:19.696004 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:19.695694 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs podName:ff2e3b8e-ffa1-4753-973f-fd67e111bf2e nodeName:}" failed. No retries permitted until 2026-07-21 14:32:27.695675248 +0000 UTC m=+18.094820419 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs") pod "network-metrics-daemon-jt8tp" (UID: "ff2e3b8e-ffa1-4753-973f-fd67e111bf2e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:32:19.796965 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:19.796167 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrbtz\" (UniqueName: \"kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz\") pod \"network-check-target-hfzqm\" (UID: \"68244146-2fb6-42ed-8c43-730c2f1fbc2f\") " pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:19.796965 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:19.796232 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret\") pod \"global-pull-secret-syncer-4zv85\" (UID: \"47d4c102-9f81-49f9-901a-99fd62fd7315\") " pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:19.796965 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:19.796387 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 14:32:19.796965 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:19.796453 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret podName:47d4c102-9f81-49f9-901a-99fd62fd7315 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:27.796433159 +0000 UTC m=+18.195578320 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret") pod "global-pull-secret-syncer-4zv85" (UID: "47d4c102-9f81-49f9-901a-99fd62fd7315") : object "kube-system"/"original-pull-secret" not registered Jul 21 14:32:19.796965 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:19.796863 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 14:32:19.796965 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:19.796883 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 14:32:19.796965 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:19.796895 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jrbtz for pod openshift-network-diagnostics/network-check-target-hfzqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:32:19.796965 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:19.796937 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz podName:68244146-2fb6-42ed-8c43-730c2f1fbc2f nodeName:}" failed. No retries permitted until 2026-07-21 14:32:27.796923687 +0000 UTC m=+18.196068844 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jrbtz" (UniqueName: "kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz") pod "network-check-target-hfzqm" (UID: "68244146-2fb6-42ed-8c43-730c2f1fbc2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:32:20.115955 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:20.115912 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:20.116135 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:20.116060 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt8tp" podUID="ff2e3b8e-ffa1-4753-973f-fd67e111bf2e" Jul 21 14:32:20.116281 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:20.116257 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:20.116390 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:20.116353 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zv85" podUID="47d4c102-9f81-49f9-901a-99fd62fd7315" Jul 21 14:32:21.114808 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:21.114762 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:21.115363 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:21.114906 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzqm" podUID="68244146-2fb6-42ed-8c43-730c2f1fbc2f" Jul 21 14:32:22.115480 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:22.115419 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:22.115885 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:22.115544 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt8tp" podUID="ff2e3b8e-ffa1-4753-973f-fd67e111bf2e" Jul 21 14:32:22.115885 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:22.115424 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:22.115885 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:22.115687 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zv85" podUID="47d4c102-9f81-49f9-901a-99fd62fd7315" Jul 21 14:32:23.115372 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:23.115337 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:23.115511 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:23.115432 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzqm" podUID="68244146-2fb6-42ed-8c43-730c2f1fbc2f" Jul 21 14:32:24.115084 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:24.115047 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:24.115267 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:24.115045 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:24.115267 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:24.115169 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zv85" podUID="47d4c102-9f81-49f9-901a-99fd62fd7315" Jul 21 14:32:24.115377 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:24.115272 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt8tp" podUID="ff2e3b8e-ffa1-4753-973f-fd67e111bf2e" Jul 21 14:32:25.115290 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:25.115218 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:25.115710 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:25.115345 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzqm" podUID="68244146-2fb6-42ed-8c43-730c2f1fbc2f" Jul 21 14:32:26.115221 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:26.115187 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:26.115407 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:26.115231 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:26.115407 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:26.115326 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt8tp" podUID="ff2e3b8e-ffa1-4753-973f-fd67e111bf2e" Jul 21 14:32:26.115839 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:26.115457 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zv85" podUID="47d4c102-9f81-49f9-901a-99fd62fd7315" Jul 21 14:32:27.114748 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:27.114716 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:27.114952 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:27.114833 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzqm" podUID="68244146-2fb6-42ed-8c43-730c2f1fbc2f" Jul 21 14:32:27.758427 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:27.758388 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs\") pod \"network-metrics-daemon-jt8tp\" (UID: \"ff2e3b8e-ffa1-4753-973f-fd67e111bf2e\") " pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:27.758824 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:27.758547 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:32:27.758824 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:27.758614 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs podName:ff2e3b8e-ffa1-4753-973f-fd67e111bf2e nodeName:}" failed. No retries permitted until 2026-07-21 14:32:43.758598954 +0000 UTC m=+34.157744110 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs") pod "network-metrics-daemon-jt8tp" (UID: "ff2e3b8e-ffa1-4753-973f-fd67e111bf2e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:32:27.859575 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:27.859539 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrbtz\" (UniqueName: \"kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz\") pod \"network-check-target-hfzqm\" (UID: \"68244146-2fb6-42ed-8c43-730c2f1fbc2f\") " pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:27.859749 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:27.859595 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret\") pod \"global-pull-secret-syncer-4zv85\" (UID: \"47d4c102-9f81-49f9-901a-99fd62fd7315\") " pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:27.859749 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:27.859713 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 14:32:27.859749 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:27.859740 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 14:32:27.859749 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:27.859750 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jrbtz for pod openshift-network-diagnostics/network-check-target-hfzqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:32:27.859972 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:27.859750 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 14:32:27.859972 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:27.859830 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz podName:68244146-2fb6-42ed-8c43-730c2f1fbc2f nodeName:}" failed. No retries permitted until 2026-07-21 14:32:43.859810202 +0000 UTC m=+34.258955378 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jrbtz" (UniqueName: "kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz") pod "network-check-target-hfzqm" (UID: "68244146-2fb6-42ed-8c43-730c2f1fbc2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:32:27.859972 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:27.859854 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret podName:47d4c102-9f81-49f9-901a-99fd62fd7315 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:43.8598429 +0000 UTC m=+34.258988057 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret") pod "global-pull-secret-syncer-4zv85" (UID: "47d4c102-9f81-49f9-901a-99fd62fd7315") : object "kube-system"/"original-pull-secret" not registered Jul 21 14:32:28.114730 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:28.114650 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:28.115178 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:28.115121 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zv85" podUID="47d4c102-9f81-49f9-901a-99fd62fd7315" Jul 21 14:32:28.115317 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:28.115303 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:28.115515 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:28.115497 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt8tp" podUID="ff2e3b8e-ffa1-4753-973f-fd67e111bf2e" Jul 21 14:32:29.114472 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:29.114440 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:29.114941 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:29.114549 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzqm" podUID="68244146-2fb6-42ed-8c43-730c2f1fbc2f" Jul 21 14:32:30.116119 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:30.116091 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:30.116554 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:30.116194 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zv85" podUID="47d4c102-9f81-49f9-901a-99fd62fd7315" Jul 21 14:32:30.116554 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:30.116252 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:30.116554 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:30.116372 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt8tp" podUID="ff2e3b8e-ffa1-4753-973f-fd67e111bf2e" Jul 21 14:32:31.115376 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:31.115342 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:31.115526 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:31.115455 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzqm" podUID="68244146-2fb6-42ed-8c43-730c2f1fbc2f" Jul 21 14:32:32.115327 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:32.115273 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:32.115781 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:32.115423 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt8tp" podUID="ff2e3b8e-ffa1-4753-973f-fd67e111bf2e" Jul 21 14:32:32.115781 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:32.115277 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:32.115903 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:32.115885 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zv85" podUID="47d4c102-9f81-49f9-901a-99fd62fd7315" Jul 21 14:32:33.115927 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:33.115504 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:33.116317 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:33.116048 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzqm" podUID="68244146-2fb6-42ed-8c43-730c2f1fbc2f" Jul 21 14:32:33.230605 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:33.230523 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-241.ec2.internal" event={"ID":"0318e1bb0d0d8f4faaa7f8d44a8b0298","Type":"ContainerStarted","Data":"3a2879ea376aeaeba99519e52c677d604deeec97e91520e0fac6e5788f81fe63"} Jul 21 14:32:33.233008 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:33.232982 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" event={"ID":"5b687553-a920-4035-b157-ecd4856656e0","Type":"ContainerStarted","Data":"05bac552db05b6d5b7578e8bdc8192e7fda27a0fa9c7ff6d004c14e3a13fdba0"} Jul 21 14:32:33.233072 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:33.233062 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" event={"ID":"5b687553-a920-4035-b157-ecd4856656e0","Type":"ContainerStarted","Data":"76eab6bb03e17a0c25dc3f1b5f4705ccfa54a70148baad8a64e83689454796dd"} Jul 21 14:32:33.233129 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:33.233115 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" event={"ID":"5b687553-a920-4035-b157-ecd4856656e0","Type":"ContainerStarted","Data":"0c8dc277dd06ac198b9b86d36e01f6859bb1b5dfd490fc8a9c4cfd50334f56d5"} Jul 21 14:32:33.233183 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:33.233169 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" event={"ID":"5b687553-a920-4035-b157-ecd4856656e0","Type":"ContainerStarted","Data":"71d9820124a5445ddc805c01c00d8ef379d6c6f6898039d333a204b35bfc856c"} Jul 21 14:32:33.234642 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:33.234617 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" event={"ID":"5c86a48f-d838-49dc-9142-cb2c9350c4b4","Type":"ContainerStarted","Data":"58015e39fa073f30fa7bde68311e60fa23505856559983b86b015764b75a701d"} Jul 21 14:32:33.236899 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:33.236872 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6dkcz" event={"ID":"50a6cbf2-12aa-4865-bb4a-7da8da663354","Type":"ContainerStarted","Data":"ac0cec5e799586ec056c4e827cdde1e1ba7d814425352f897c0546e326d1ed06"} Jul 21 14:32:33.247994 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:33.247922 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-241.ec2.internal" podStartSLOduration=22.247902057 podStartE2EDuration="22.247902057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:32:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:32:33.246769171 +0000 UTC m=+23.645914353" watchObservedRunningTime="2026-07-21 14:32:33.247902057 +0000 UTC m=+23.647047236" Jul 21 14:32:33.283300 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:33.283226 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6dkcz" podStartSLOduration=2.8375907590000002 podStartE2EDuration="23.283210209s" totalImagesPullingTime="20.44561945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:32:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:32:33.268339002 +0000 UTC m=+23.667484181" watchObservedRunningTime="2026-07-21 14:32:33.283210209 +0000 UTC m=+23.682355385" Jul 21 14:32:33.283947 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:33.283908 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lcc8w" podStartSLOduration=2.911528349 podStartE2EDuration="23.283896803s" totalImagesPullingTime="20.372368454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:32:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:32:33.283405822 +0000 UTC m=+23.682551020" watchObservedRunningTime="2026-07-21 14:32:33.283896803 +0000 UTC m=+23.683041984" Jul 21 14:32:34.114836 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:34.114805 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:34.115020 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:34.114921 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zv85" podUID="47d4c102-9f81-49f9-901a-99fd62fd7315" Jul 21 14:32:34.115020 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:34.114957 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:34.115095 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:34.115031 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt8tp" podUID="ff2e3b8e-ffa1-4753-973f-fd67e111bf2e" Jul 21 14:32:34.240585 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:34.240552 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" event={"ID":"d7de8025-df5f-4161-ab2f-392d1423c347","Type":"ContainerStarted","Data":"46543c9f35b7ce9ff83b4d5ca79c6ac2ae1f536478d27960ab39eff84f343959"} Jul 21 14:32:34.242010 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:34.241981 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l5lf7" event={"ID":"f443a0aa-6687-44b0-9581-4e8953060962","Type":"ContainerStarted","Data":"45e016624ebf971bd72e6bd5d4a8d92d468065a5493b1a5805d5d5e5a59efcc6"} Jul 21 14:32:34.243537 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:34.243505 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vzb6w" event={"ID":"d051a06b-b3a7-450f-bb8a-bf17d427873b","Type":"ContainerStarted","Data":"3b0304b7c0d8694c8bffd6c65e983fb13edcf395249a05e2d6a60c858a1dc17d"} Jul 21 14:32:34.245083 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:34.245060 2559 generic.go:356] "Generic (PLEG): container finished" podID="eb4fd84da00f4e55709bfa044329ff2f" containerID="31d035455ac6a05624d107432ad4bb9e78e2637484aa5b8d703265fcac3d1a62" exitCode=0 Jul 21 14:32:34.245174 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:34.245136 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-241.ec2.internal" event={"ID":"eb4fd84da00f4e55709bfa044329ff2f","Type":"ContainerDied","Data":"31d035455ac6a05624d107432ad4bb9e78e2637484aa5b8d703265fcac3d1a62"} Jul 21 14:32:34.246911 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:34.246886 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4wjk4" event={"ID":"60210dbf-9a04-4c44-a654-d6fd2cf80403","Type":"ContainerStarted","Data":"fc650f3172acd86e6f6425079ef665b20c58150e6364613a0b57a49283caf8a1"} Jul 21 14:32:34.250303 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:34.250284 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" event={"ID":"5b687553-a920-4035-b157-ecd4856656e0","Type":"ContainerStarted","Data":"10412c35c235fa9b5e4609f65928b9742c1b2488d65a9b3f53969ea847c277a8"} Jul 21 14:32:34.250389 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:34.250342 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" event={"ID":"5b687553-a920-4035-b157-ecd4856656e0","Type":"ContainerStarted","Data":"75ce711fda05f5f478af37509b8470bb322b20a99a15141177bc589be3e28a95"} Jul 21 14:32:34.251678 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:34.251657 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-p445n" event={"ID":"ebd5b888-bb63-4bf0-8f9a-606b6fb115bf","Type":"ContainerStarted","Data":"243c2006e08d65b6f504c10b55d681a9aee5d36ce8106424c99789f9e3714718"} Jul 21 14:32:34.253605 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:34.253565 2559 generic.go:356] "Generic (PLEG): container finished" podID="8dcb8d95-8dc6-44a6-96b7-40f6453a7a79" containerID="8594af27193c42e14c4c2ffcfa3c6851491907ae923b738c314e504c6a78748b" exitCode=0 Jul 21 14:32:34.253709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:34.253654 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lwvs" event={"ID":"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79","Type":"ContainerDied","Data":"8594af27193c42e14c4c2ffcfa3c6851491907ae923b738c314e504c6a78748b"} Jul 21 14:32:34.256437 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:34.256392 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l5lf7" podStartSLOduration=3.881226485 podStartE2EDuration="24.256379979s" totalImagesPullingTime="20.375153494s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:32:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:32:34.256005956 +0000 UTC m=+24.655151136" watchObservedRunningTime="2026-07-21 14:32:34.256379979 +0000 UTC m=+24.655525169" Jul 21 14:32:34.291314 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:34.291278 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4wjk4" podStartSLOduration=3.942382436 podStartE2EDuration="24.29126387s" totalImagesPullingTime="20.348881434s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:32:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:32:34.291169408 +0000 UTC m=+24.690314587" watchObservedRunningTime="2026-07-21 14:32:34.29126387 +0000 UTC m=+24.690409049" Jul 21 14:32:34.334736 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:34.334601 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-p445n" podStartSLOduration=3.992855098 podStartE2EDuration="24.334589214s" totalImagesPullingTime="20.341734116s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:32:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:32:34.334416115 +0000 UTC m=+24.733561295" watchObservedRunningTime="2026-07-21 14:32:34.334589214 +0000 UTC m=+24.733734392" Jul 21 14:32:34.335343 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:34.334948 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vzb6w" podStartSLOduration=3.954385748 podStartE2EDuration="24.334938636s" totalImagesPullingTime="20.380552888s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:32:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:32:34.319996269 +0000 UTC m=+24.719141448" watchObservedRunningTime="2026-07-21 14:32:34.334938636 +0000 UTC m=+24.734083820" Jul 21 14:32:34.939180 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:34.939147 2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 21 14:32:35.103444 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:35.103320 2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T14:32:34.939168645Z","UUID":"259e7947-348b-402f-8562-5730fe50e767","Handler":null,"Name":"","Endpoint":""} Jul 21 14:32:35.104676 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:35.104659 2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 21 14:32:35.104766 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:35.104697 2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 21 14:32:35.115083 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:35.115054 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:35.115208 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:35.115165 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzqm" podUID="68244146-2fb6-42ed-8c43-730c2f1fbc2f" Jul 21 14:32:35.257918 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:35.257877 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-241.ec2.internal" event={"ID":"eb4fd84da00f4e55709bfa044329ff2f","Type":"ContainerStarted","Data":"68e0236b8b63eecbf4064004a6bb2f1f20d4a281a2b2d923822c505b092963ce"} Jul 21 14:32:35.259594 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:35.259569 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" event={"ID":"d7de8025-df5f-4161-ab2f-392d1423c347","Type":"ContainerStarted","Data":"3c3b8bb9cb400a48377814f0f365db229be6df056b41a891481d172a7cd9fb4d"} Jul 21 14:32:35.271436 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:35.271392 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-241.ec2.internal" podStartSLOduration=24.271380336 podStartE2EDuration="24.271380336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:32:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:32:35.271345836 +0000 UTC m=+25.670491016" watchObservedRunningTime="2026-07-21 14:32:35.271380336 +0000 UTC m=+25.670525516" Jul 21 14:32:36.115258 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:36.115226 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:36.115449 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:36.115353 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zv85" podUID="47d4c102-9f81-49f9-901a-99fd62fd7315" Jul 21 14:32:36.115449 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:36.115406 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:36.115559 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:36.115541 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt8tp" podUID="ff2e3b8e-ffa1-4753-973f-fd67e111bf2e" Jul 21 14:32:36.266357 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:36.266319 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" event={"ID":"5b687553-a920-4035-b157-ecd4856656e0","Type":"ContainerStarted","Data":"b323293c5a3117f8a9206077f59d1772b26b267a2767be90d5d8eca405debf1a"} Jul 21 14:32:37.115209 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:37.115134 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:37.115379 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:37.115250 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzqm" podUID="68244146-2fb6-42ed-8c43-730c2f1fbc2f" Jul 21 14:32:37.270285 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:37.270254 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" event={"ID":"d7de8025-df5f-4161-ab2f-392d1423c347","Type":"ContainerStarted","Data":"b9b14e8513291513885a7b8f363a2b657c1702f18f3083b7fd8f0eed372fad91"} Jul 21 14:32:37.288849 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:37.288647 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-g54zk" podStartSLOduration=3.483201966 podStartE2EDuration="27.28862822s" totalImagesPullingTime="23.805426254s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:32:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:32:37.286693444 +0000 UTC m=+27.685838623" watchObservedRunningTime="2026-07-21 14:32:37.28862822 +0000 UTC m=+27.687773400" Jul 21 14:32:38.115538 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:38.115313 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:38.115709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:38.115330 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:38.115709 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:38.115654 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zv85" podUID="47d4c102-9f81-49f9-901a-99fd62fd7315" Jul 21 14:32:38.115817 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:38.115707 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt8tp" podUID="ff2e3b8e-ffa1-4753-973f-fd67e111bf2e" Jul 21 14:32:38.277219 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:38.277174 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" event={"ID":"5b687553-a920-4035-b157-ecd4856656e0","Type":"ContainerStarted","Data":"7f583aff81274a9bfe62361bef3a6877a087a169af0b93053f9cdf4049a2142d"} Jul 21 14:32:38.277772 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:38.277751 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:38.277866 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:38.277843 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:38.277937 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:38.277891 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:38.295687 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:38.295663 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:38.296095 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:38.296073 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:32:38.303567 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:38.303526 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" podStartSLOduration=7.899181449 podStartE2EDuration="28.303513555s" totalImagesPullingTime="20.404332106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:32:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:32:38.30229677 +0000 UTC m=+28.701441950" watchObservedRunningTime="2026-07-21 14:32:38.303513555 +0000 UTC m=+28.702658712" Jul 21 14:32:38.965327 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:38.965277 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vzb6w" Jul 21 14:32:38.966304 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:38.966276 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vzb6w" Jul 21 14:32:39.115058 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:39.115030 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:39.115242 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:39.115141 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzqm" podUID="68244146-2fb6-42ed-8c43-730c2f1fbc2f" Jul 21 14:32:39.280512 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:39.280445 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vzb6w" Jul 21 14:32:39.281127 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:39.280522 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vzb6w" Jul 21 14:32:39.951933 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:39.951902 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4zv85"] Jul 21 14:32:39.952186 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:39.952123 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:39.952338 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:39.952317 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zv85" podUID="47d4c102-9f81-49f9-901a-99fd62fd7315" Jul 21 14:32:39.955812 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:39.955771 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jt8tp"] Jul 21 14:32:39.955946 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:39.955928 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:39.956114 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:39.956091 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt8tp" podUID="ff2e3b8e-ffa1-4753-973f-fd67e111bf2e" Jul 21 14:32:39.956398 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:39.956378 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hfzqm"] Jul 21 14:32:39.956398 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:39.956468 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:39.956398 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:39.956557 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzqm" podUID="68244146-2fb6-42ed-8c43-730c2f1fbc2f" Jul 21 14:32:41.114752 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:41.114678 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:41.115293 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:41.114678 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:41.115293 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:41.114774 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzqm" podUID="68244146-2fb6-42ed-8c43-730c2f1fbc2f" Jul 21 14:32:41.115293 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:41.114863 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zv85" podUID="47d4c102-9f81-49f9-901a-99fd62fd7315" Jul 21 14:32:41.115293 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:41.114678 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:41.115293 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:41.114963 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt8tp" podUID="ff2e3b8e-ffa1-4753-973f-fd67e111bf2e" Jul 21 14:32:41.286439 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:41.286407 2559 generic.go:356] "Generic (PLEG): container finished" podID="8dcb8d95-8dc6-44a6-96b7-40f6453a7a79" containerID="96b328dc6c548860c667691cbaa9348a9544969288d431388996860c8524a67a" exitCode=0 Jul 21 14:32:41.286578 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:41.286454 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lwvs" event={"ID":"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79","Type":"ContainerDied","Data":"96b328dc6c548860c667691cbaa9348a9544969288d431388996860c8524a67a"} Jul 21 14:32:42.291317 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:42.291101 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lwvs" event={"ID":"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79","Type":"ContainerStarted","Data":"f4e0c5f8fdcd23abc4a25443cf64830afee9af9ab7466e212a7db06c1da4587e"} Jul 21 14:32:43.114976 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:43.114942 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:43.115174 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:43.114942 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:43.115174 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:43.115076 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt8tp" podUID="ff2e3b8e-ffa1-4753-973f-fd67e111bf2e" Jul 21 14:32:43.115174 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:43.114955 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:43.115311 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:43.115181 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzqm" podUID="68244146-2fb6-42ed-8c43-730c2f1fbc2f" Jul 21 14:32:43.115311 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:43.115116 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zv85" podUID="47d4c102-9f81-49f9-901a-99fd62fd7315" Jul 21 14:32:43.294819 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:43.294775 2559 generic.go:356] "Generic (PLEG): container finished" podID="8dcb8d95-8dc6-44a6-96b7-40f6453a7a79" containerID="f4e0c5f8fdcd23abc4a25443cf64830afee9af9ab7466e212a7db06c1da4587e" exitCode=0 Jul 21 14:32:43.295179 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:43.294834 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lwvs" event={"ID":"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79","Type":"ContainerDied","Data":"f4e0c5f8fdcd23abc4a25443cf64830afee9af9ab7466e212a7db06c1da4587e"} Jul 21 14:32:43.777358 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:43.777315 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs\") pod \"network-metrics-daemon-jt8tp\" (UID: \"ff2e3b8e-ffa1-4753-973f-fd67e111bf2e\") " pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:43.777526 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:43.777489 2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:32:43.777566 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:43.777555 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs podName:ff2e3b8e-ffa1-4753-973f-fd67e111bf2e nodeName:}" failed. No retries permitted until 2026-07-21 14:33:15.77753522 +0000 UTC m=+66.176680378 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs") pod "network-metrics-daemon-jt8tp" (UID: "ff2e3b8e-ffa1-4753-973f-fd67e111bf2e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 14:32:43.878180 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:43.878140 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrbtz\" (UniqueName: \"kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz\") pod \"network-check-target-hfzqm\" (UID: \"68244146-2fb6-42ed-8c43-730c2f1fbc2f\") " pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:43.878343 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:43.878204 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret\") pod \"global-pull-secret-syncer-4zv85\" (UID: \"47d4c102-9f81-49f9-901a-99fd62fd7315\") " pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:43.878343 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:43.878314 2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 14:32:43.878435 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:43.878348 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 14:32:43.878435 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:43.878372 2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 14:32:43.878435 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:43.878380 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret podName:47d4c102-9f81-49f9-901a-99fd62fd7315 nodeName:}" failed. No retries permitted until 2026-07-21 14:33:15.878362652 +0000 UTC m=+66.277507832 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret") pod "global-pull-secret-syncer-4zv85" (UID: "47d4c102-9f81-49f9-901a-99fd62fd7315") : object "kube-system"/"original-pull-secret" not registered Jul 21 14:32:43.878435 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:43.878382 2559 projected.go:196] Error preparing data for projected volume kube-api-access-jrbtz for pod openshift-network-diagnostics/network-check-target-hfzqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:32:43.878435 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:43.878420 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz podName:68244146-2fb6-42ed-8c43-730c2f1fbc2f nodeName:}" failed. No retries permitted until 2026-07-21 14:33:15.878413077 +0000 UTC m=+66.277558234 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jrbtz" (UniqueName: "kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz") pod "network-check-target-hfzqm" (UID: "68244146-2fb6-42ed-8c43-730c2f1fbc2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 14:32:44.300002 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:44.299911 2559 generic.go:356] "Generic (PLEG): container finished" podID="8dcb8d95-8dc6-44a6-96b7-40f6453a7a79" containerID="7ebe9c1275432b37dd1ad59929d3f95c9a26dfad61d2f11b88ea6e8dd48d2964" exitCode=0 Jul 21 14:32:44.300002 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:44.299964 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lwvs" event={"ID":"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79","Type":"ContainerDied","Data":"7ebe9c1275432b37dd1ad59929d3f95c9a26dfad61d2f11b88ea6e8dd48d2964"} Jul 21 14:32:45.114597 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.114566 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:45.114765 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.114621 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:45.114765 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.114632 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:45.114765 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:45.114706 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-4zv85" podUID="47d4c102-9f81-49f9-901a-99fd62fd7315" Jul 21 14:32:45.114883 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:45.114778 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jt8tp" podUID="ff2e3b8e-ffa1-4753-973f-fd67e111bf2e" Jul 21 14:32:45.114883 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:45.114855 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hfzqm" podUID="68244146-2fb6-42ed-8c43-730c2f1fbc2f" Jul 21 14:32:45.370382 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.370302 2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-241.ec2.internal" event="NodeReady" Jul 21 14:32:45.370718 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.370410 2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 21 14:32:45.403053 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.403019 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-spzgj"] Jul 21 14:32:45.405591 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.405571 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-d7bdd865-vschb"] Jul 21 14:32:45.405725 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.405709 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-spzgj" Jul 21 14:32:45.408160 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.408139 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 21 14:32:45.408319 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.408140 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 21 14:32:45.408319 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.408268 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.408548 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.408523 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 21 14:32:45.408652 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.408635 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 21 14:32:45.408732 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.408717 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kxsvh\"" Jul 21 14:32:45.410550 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.410521 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 21 14:32:45.411071 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.411048 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 21 14:32:45.411071 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.411061 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 21 14:32:45.411218 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.411083 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gcwlj\"" Jul 21 14:32:45.413335 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.412966 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 21 14:32:45.417723 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.417703 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 21 14:32:45.417820 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.417739 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz"] Jul 21 14:32:45.420427 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.420408 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7ntq"] Jul 21 14:32:45.420576 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.420541 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz" Jul 21 14:32:45.423269 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.423249 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-spzgj"] Jul 21 14:32:45.423344 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.423277 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nrtkq\"" Jul 21 14:32:45.423344 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.423340 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7ntq" Jul 21 14:32:45.423609 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.423588 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 21 14:32:45.423760 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.423746 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 21 14:32:45.424428 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.424409 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 21 14:32:45.424505 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.424443 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 21 14:32:45.426231 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.426211 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 21 14:32:45.426333 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.426236 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 21 14:32:45.426333 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.426284 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-f2rck\"" Jul 21 14:32:45.426523 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.426506 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 21 14:32:45.426749 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.426730 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 21 14:32:45.436029 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.435655 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7ntq"] Jul 21 14:32:45.436150 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.436087 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz"] Jul 21 14:32:45.437011 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.436992 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-f7lm7"] Jul 21 14:32:45.445539 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.445508 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vsq44"] Jul 21 14:32:45.445684 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.445666 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f7lm7" Jul 21 14:32:45.448143 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.448123 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 21 14:32:45.448248 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.448123 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 21 14:32:45.448248 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.448129 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t2qjq\"" Jul 21 14:32:45.448972 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.448955 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-vw9pf"] Jul 21 14:32:45.449076 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.449061 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vsq44" Jul 21 14:32:45.451260 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.451241 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 21 14:32:45.451365 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.451345 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lv5h4\"" Jul 21 14:32:45.451498 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.451349 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 21 14:32:45.451498 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.451432 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 21 14:32:45.451636 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.451621 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wvnfr"] Jul 21 14:32:45.451721 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.451709 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-vw9pf" Jul 21 14:32:45.454467 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.454451 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 21 14:32:45.454626 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.454583 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fphzx"] Jul 21 14:32:45.454909 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.454887 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wvnfr" Jul 21 14:32:45.456876 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.456850 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 21 14:32:45.456958 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.456943 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 21 14:32:45.457286 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.457237 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-6fqsw\"" Jul 21 14:32:45.457483 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.457466 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 21 14:32:45.458427 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.458280 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 21 14:32:45.458510 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.458470 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 21 14:32:45.458832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.458777 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-56b4b5f45d-9tkdk"] Jul 21 14:32:45.458924 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.458853 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tqvch\"" Jul 21 14:32:45.459135 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.459120 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fphzx" Jul 21 14:32:45.462490 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.462462 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d8gqr"] Jul 21 14:32:45.462630 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.462461 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 21 14:32:45.462803 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.462766 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-z6q7m\"" Jul 21 14:32:45.463016 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.462996 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 21 14:32:45.463090 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.463062 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 21 14:32:45.463267 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.463250 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 21 14:32:45.463488 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.463451 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 21 14:32:45.463589 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.463493 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:45.465397 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.465372 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 21 14:32:45.465397 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.465383 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-ghtx2"] Jul 21 14:32:45.465511 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.465494 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d8gqr" Jul 21 14:32:45.466046 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.466026 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 21 14:32:45.466278 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.466258 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ftqxk\"" Jul 21 14:32:45.466344 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.466312 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 21 14:32:45.466457 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.466436 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 21 14:32:45.466527 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.466508 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 21 14:32:45.466693 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.466675 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 21 14:32:45.467649 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.467632 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 21 14:32:45.468408 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.468392 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 21 14:32:45.469486 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.469466 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d7bdd865-vschb"] Jul 21 14:32:45.469572 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.469500 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vsq44"] Jul 21 14:32:45.469572 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.469526 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f7lm7"] Jul 21 14:32:45.469572 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.469551 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-vw9pf"] Jul 21 14:32:45.469572 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.469569 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fphzx"] Jul 21 14:32:45.469893 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.469590 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wvnfr"] Jul 21 14:32:45.469893 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.469609 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-ghtx2"] Jul 21 14:32:45.469893 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.469628 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56b4b5f45d-9tkdk"] Jul 21 14:32:45.469893 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.469881 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-ghtx2" Jul 21 14:32:45.471185 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.471097 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 21 14:32:45.471185 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.471160 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-prcnc\"" Jul 21 14:32:45.471824 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.471784 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d8gqr"] Jul 21 14:32:45.472355 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.472336 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 14:32:45.472447 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.472336 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-7fgbp\"" Jul 21 14:32:45.472447 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.472367 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 14:32:45.490785 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.490763 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7acd8006-41bc-43da-a1b0-7f03cda70beb-config\") pod \"console-operator-565b7b569d-spzgj\" (UID: \"7acd8006-41bc-43da-a1b0-7f03cda70beb\") " pod="openshift-console-operator/console-operator-565b7b569d-spzgj" Jul 21 14:32:45.490899 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.490815 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jm8l5\" (UniqueName: \"kubernetes.io/projected/7acd8006-41bc-43da-a1b0-7f03cda70beb-kube-api-access-jm8l5\") pod \"console-operator-565b7b569d-spzgj\" (UID: \"7acd8006-41bc-43da-a1b0-7f03cda70beb\") " pod="openshift-console-operator/console-operator-565b7b569d-spzgj" Jul 21 14:32:45.490933 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.490894 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7acd8006-41bc-43da-a1b0-7f03cda70beb-serving-cert\") pod \"console-operator-565b7b569d-spzgj\" (UID: \"7acd8006-41bc-43da-a1b0-7f03cda70beb\") " pod="openshift-console-operator/console-operator-565b7b569d-spzgj" Jul 21 14:32:45.490933 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.490929 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7acd8006-41bc-43da-a1b0-7f03cda70beb-trusted-ca\") pod \"console-operator-565b7b569d-spzgj\" (UID: \"7acd8006-41bc-43da-a1b0-7f03cda70beb\") " pod="openshift-console-operator/console-operator-565b7b569d-spzgj" Jul 21 14:32:45.591665 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.591631 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7acd8006-41bc-43da-a1b0-7f03cda70beb-config\") pod \"console-operator-565b7b569d-spzgj\" (UID: \"7acd8006-41bc-43da-a1b0-7f03cda70beb\") " pod="openshift-console-operator/console-operator-565b7b569d-spzgj" Jul 21 14:32:45.591860 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.591674 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7dfb5b2b-90f4-445d-a231-09b16bfd3358-trusted-ca\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.591860 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.591693 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7dfb5b2b-90f4-445d-a231-09b16bfd3358-ca-trust-extracted\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.591860 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.591712 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxfwt\" (UniqueName: \"kubernetes.io/projected/7993f7cc-616e-4593-a05d-896b58ccce86-kube-api-access-rxfwt\") pod \"service-ca-operator-5bcbc94c78-fphzx\" (UID: \"7993f7cc-616e-4593-a05d-896b58ccce86\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fphzx" Jul 21 14:32:45.591860 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.591728 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-stats-auth\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:45.591860 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.591749 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jm8l5\" (UniqueName: \"kubernetes.io/projected/7acd8006-41bc-43da-a1b0-7f03cda70beb-kube-api-access-jm8l5\") pod \"console-operator-565b7b569d-spzgj\" (UID: \"7acd8006-41bc-43da-a1b0-7f03cda70beb\") " pod="openshift-console-operator/console-operator-565b7b569d-spzgj" Jul 21 14:32:45.591860 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.591811 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a34dc857-ae97-433e-a10e-29e3c0f87f48-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vsq44\" (UID: \"a34dc857-ae97-433e-a10e-29e3c0f87f48\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vsq44" Jul 21 14:32:45.591860 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.591845 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5ff6a0d-5a95-42e2-883a-0b73c40eb285-cert\") pod \"ingress-canary-d8gqr\" (UID: \"a5ff6a0d-5a95-42e2-883a-0b73c40eb285\") " pod="openshift-ingress-canary/ingress-canary-d8gqr" Jul 21 14:32:45.592126 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.591873 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-certificates\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.592126 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.591891 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vl5w\" (UniqueName: \"kubernetes.io/projected/fbc0f993-9ad3-4e74-9efd-f4697e056f73-kube-api-access-7vl5w\") pod \"kube-storage-version-migrator-operator-7658d9b749-h7ntq\" (UID: \"fbc0f993-9ad3-4e74-9efd-f4697e056f73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7ntq" Jul 21 14:32:45.592126 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.591908 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.592126 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.591928 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-metrics-tls\") pod \"dns-default-f7lm7\" (UID: \"a04bb16e-8ec8-442b-b0f2-1a8448f6e490\") " pod="openshift-dns/dns-default-f7lm7" Jul 21 14:32:45.592126 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.591956 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7acd8006-41bc-43da-a1b0-7f03cda70beb-serving-cert\") pod \"console-operator-565b7b569d-spzgj\" (UID: \"7acd8006-41bc-43da-a1b0-7f03cda70beb\") " pod="openshift-console-operator/console-operator-565b7b569d-spzgj" Jul 21 14:32:45.592126 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.591974 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj4j7\" (UniqueName: \"kubernetes.io/projected/d8634880-5487-4cab-a0e5-99c821dfa8f9-kube-api-access-mj4j7\") pod \"insights-operator-555d9d7885-vw9pf\" (UID: \"d8634880-5487-4cab-a0e5-99c821dfa8f9\") " pod="openshift-insights/insights-operator-555d9d7885-vw9pf" Jul 21 14:32:45.592126 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592005 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2wtt\" (UniqueName: \"kubernetes.io/projected/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-kube-api-access-k2wtt\") pod \"dns-default-f7lm7\" (UID: \"a04bb16e-8ec8-442b-b0f2-1a8448f6e490\") " pod="openshift-dns/dns-default-f7lm7" Jul 21 14:32:45.592126 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592037 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c0543a5-61bd-497a-848f-6bb12c29f60d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-ll6gz\" (UID: \"4c0543a5-61bd-497a-848f-6bb12c29f60d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz" Jul 21 14:32:45.592393 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592143 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7993f7cc-616e-4593-a05d-896b58ccce86-config\") pod \"service-ca-operator-5bcbc94c78-fphzx\" (UID: \"7993f7cc-616e-4593-a05d-896b58ccce86\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fphzx" Jul 21 14:32:45.592393 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592184 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-service-ca-bundle\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:45.592393 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592213 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-metrics-certs\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:45.592393 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592243 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzk9k\" (UniqueName: \"kubernetes.io/projected/4a55c7ed-23d4-44d5-9e9a-982469a93dd2-kube-api-access-gzk9k\") pod \"volume-data-source-validator-78cf4c6f6-wvnfr\" (UID: \"4a55c7ed-23d4-44d5-9e9a-982469a93dd2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wvnfr" Jul 21 14:32:45.592393 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592268 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8czx\" (UniqueName: \"kubernetes.io/projected/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-kube-api-access-v8czx\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:45.592393 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592330 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fbc0f993-9ad3-4e74-9efd-f4697e056f73-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-h7ntq\" (UID: \"fbc0f993-9ad3-4e74-9efd-f4697e056f73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7ntq" Jul 21 14:32:45.592393 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592341 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7acd8006-41bc-43da-a1b0-7f03cda70beb-config\") pod \"console-operator-565b7b569d-spzgj\" (UID: \"7acd8006-41bc-43da-a1b0-7f03cda70beb\") " pod="openshift-console-operator/console-operator-565b7b569d-spzgj" Jul 21 14:32:45.592393 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592366 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx9w6\" (UniqueName: \"kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-kube-api-access-hx9w6\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.592744 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592399 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7dfb5b2b-90f4-445d-a231-09b16bfd3358-installation-pull-secrets\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.592744 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592420 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d8634880-5487-4cab-a0e5-99c821dfa8f9-snapshots\") pod \"insights-operator-555d9d7885-vw9pf\" (UID: \"d8634880-5487-4cab-a0e5-99c821dfa8f9\") " pod="openshift-insights/insights-operator-555d9d7885-vw9pf" Jul 21 14:32:45.592744 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592437 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8634880-5487-4cab-a0e5-99c821dfa8f9-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-vw9pf\" (UID: \"d8634880-5487-4cab-a0e5-99c821dfa8f9\") " pod="openshift-insights/insights-operator-555d9d7885-vw9pf" Jul 21 14:32:45.592744 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592452 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fbc0f993-9ad3-4e74-9efd-f4697e056f73-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-h7ntq\" (UID: \"fbc0f993-9ad3-4e74-9efd-f4697e056f73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7ntq" Jul 21 14:32:45.592744 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592488 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8634880-5487-4cab-a0e5-99c821dfa8f9-tmp\") pod \"insights-operator-555d9d7885-vw9pf\" (UID: \"d8634880-5487-4cab-a0e5-99c821dfa8f9\") " pod="openshift-insights/insights-operator-555d9d7885-vw9pf" Jul 21 14:32:45.592744 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592529 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8634880-5487-4cab-a0e5-99c821dfa8f9-serving-cert\") pod \"insights-operator-555d9d7885-vw9pf\" (UID: \"d8634880-5487-4cab-a0e5-99c821dfa8f9\") " pod="openshift-insights/insights-operator-555d9d7885-vw9pf" Jul 21 14:32:45.592744 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592567 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-tmp-dir\") pod \"dns-default-f7lm7\" (UID: \"a04bb16e-8ec8-442b-b0f2-1a8448f6e490\") " pod="openshift-dns/dns-default-f7lm7" Jul 21 14:32:45.592744 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592591 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4c0543a5-61bd-497a-848f-6bb12c29f60d-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-ll6gz\" (UID: \"4c0543a5-61bd-497a-848f-6bb12c29f60d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz" Jul 21 14:32:45.592744 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592631 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6486q\" (UniqueName: \"kubernetes.io/projected/4c0543a5-61bd-497a-848f-6bb12c29f60d-kube-api-access-6486q\") pod \"cluster-monitoring-operator-76cf8966f8-ll6gz\" (UID: \"4c0543a5-61bd-497a-848f-6bb12c29f60d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz" Jul 21 14:32:45.592744 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592667 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-config-volume\") pod \"dns-default-f7lm7\" (UID: \"a04bb16e-8ec8-442b-b0f2-1a8448f6e490\") " pod="openshift-dns/dns-default-f7lm7" Jul 21 14:32:45.592744 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592692 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7dfb5b2b-90f4-445d-a231-09b16bfd3358-image-registry-private-configuration\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.593273 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592750 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7acd8006-41bc-43da-a1b0-7f03cda70beb-trusted-ca\") pod \"console-operator-565b7b569d-spzgj\" (UID: \"7acd8006-41bc-43da-a1b0-7f03cda70beb\") " pod="openshift-console-operator/console-operator-565b7b569d-spzgj" Jul 21 14:32:45.593273 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592776 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d72fj\" (UniqueName: \"kubernetes.io/projected/f271e332-c1a1-4c1d-81b1-e65885a56930-kube-api-access-d72fj\") pod \"network-check-source-7bc5b6bf85-ghtx2\" (UID: \"f271e332-c1a1-4c1d-81b1-e65885a56930\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-ghtx2" Jul 21 14:32:45.593273 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592820 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8634880-5487-4cab-a0e5-99c821dfa8f9-service-ca-bundle\") pod \"insights-operator-555d9d7885-vw9pf\" (UID: \"d8634880-5487-4cab-a0e5-99c821dfa8f9\") " pod="openshift-insights/insights-operator-555d9d7885-vw9pf" Jul 21 14:32:45.593273 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592851 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7993f7cc-616e-4593-a05d-896b58ccce86-serving-cert\") pod \"service-ca-operator-5bcbc94c78-fphzx\" (UID: \"7993f7cc-616e-4593-a05d-896b58ccce86\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fphzx" Jul 21 14:32:45.593273 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592877 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-bound-sa-token\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.593273 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592903 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnqk7\" (UniqueName: \"kubernetes.io/projected/a34dc857-ae97-433e-a10e-29e3c0f87f48-kube-api-access-wnqk7\") pod \"cluster-samples-operator-79b7c55f87-vsq44\" (UID: \"a34dc857-ae97-433e-a10e-29e3c0f87f48\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vsq44" Jul 21 14:32:45.593273 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592926 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-default-certificate\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:45.593273 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.592950 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9pgd\" (UniqueName: \"kubernetes.io/projected/a5ff6a0d-5a95-42e2-883a-0b73c40eb285-kube-api-access-q9pgd\") pod \"ingress-canary-d8gqr\" (UID: \"a5ff6a0d-5a95-42e2-883a-0b73c40eb285\") " pod="openshift-ingress-canary/ingress-canary-d8gqr" Jul 21 14:32:45.593651 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.593517 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7acd8006-41bc-43da-a1b0-7f03cda70beb-trusted-ca\") pod \"console-operator-565b7b569d-spzgj\" (UID: \"7acd8006-41bc-43da-a1b0-7f03cda70beb\") " pod="openshift-console-operator/console-operator-565b7b569d-spzgj" Jul 21 14:32:45.596219 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.596194 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7acd8006-41bc-43da-a1b0-7f03cda70beb-serving-cert\") pod \"console-operator-565b7b569d-spzgj\" (UID: \"7acd8006-41bc-43da-a1b0-7f03cda70beb\") " pod="openshift-console-operator/console-operator-565b7b569d-spzgj" Jul 21 14:32:45.599432 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.599409 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jm8l5\" (UniqueName: \"kubernetes.io/projected/7acd8006-41bc-43da-a1b0-7f03cda70beb-kube-api-access-jm8l5\") pod \"console-operator-565b7b569d-spzgj\" (UID: \"7acd8006-41bc-43da-a1b0-7f03cda70beb\") " pod="openshift-console-operator/console-operator-565b7b569d-spzgj" Jul 21 14:32:45.602681 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.602652 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vzb6w_d051a06b-b3a7-450f-bb8a-bf17d427873b/konnectivity-agent/0.log" limit=1024 Jul 21 14:32:45.681583 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.681493 2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-vzb6w_d051a06b-b3a7-450f-bb8a-bf17d427873b/konnectivity-agent/0.log" limit=1024 Jul 21 14:32:45.693515 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.693481 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7dfb5b2b-90f4-445d-a231-09b16bfd3358-trusted-ca\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.693515 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.693515 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7dfb5b2b-90f4-445d-a231-09b16bfd3358-ca-trust-extracted\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.693687 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.693535 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxfwt\" (UniqueName: \"kubernetes.io/projected/7993f7cc-616e-4593-a05d-896b58ccce86-kube-api-access-rxfwt\") pod \"service-ca-operator-5bcbc94c78-fphzx\" (UID: \"7993f7cc-616e-4593-a05d-896b58ccce86\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fphzx" Jul 21 14:32:45.693687 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.693573 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-stats-auth\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:45.693687 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.693591 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a34dc857-ae97-433e-a10e-29e3c0f87f48-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vsq44\" (UID: \"a34dc857-ae97-433e-a10e-29e3c0f87f48\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vsq44" Jul 21 14:32:45.693687 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.693609 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5ff6a0d-5a95-42e2-883a-0b73c40eb285-cert\") pod \"ingress-canary-d8gqr\" (UID: \"a5ff6a0d-5a95-42e2-883a-0b73c40eb285\") " pod="openshift-ingress-canary/ingress-canary-d8gqr" Jul 21 14:32:45.693687 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.693631 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-certificates\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.693687 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.693655 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vl5w\" (UniqueName: \"kubernetes.io/projected/fbc0f993-9ad3-4e74-9efd-f4697e056f73-kube-api-access-7vl5w\") pod \"kube-storage-version-migrator-operator-7658d9b749-h7ntq\" (UID: \"fbc0f993-9ad3-4e74-9efd-f4697e056f73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7ntq" Jul 21 14:32:45.693687 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.693678 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.694065 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.693702 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-metrics-tls\") pod \"dns-default-f7lm7\" (UID: \"a04bb16e-8ec8-442b-b0f2-1a8448f6e490\") " pod="openshift-dns/dns-default-f7lm7" Jul 21 14:32:45.694065 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.693741 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj4j7\" (UniqueName: \"kubernetes.io/projected/d8634880-5487-4cab-a0e5-99c821dfa8f9-kube-api-access-mj4j7\") pod \"insights-operator-555d9d7885-vw9pf\" (UID: \"d8634880-5487-4cab-a0e5-99c821dfa8f9\") " pod="openshift-insights/insights-operator-555d9d7885-vw9pf" Jul 21 14:32:45.694065 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.693766 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2wtt\" (UniqueName: \"kubernetes.io/projected/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-kube-api-access-k2wtt\") pod \"dns-default-f7lm7\" (UID: \"a04bb16e-8ec8-442b-b0f2-1a8448f6e490\") " pod="openshift-dns/dns-default-f7lm7" Jul 21 14:32:45.694065 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.693820 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c0543a5-61bd-497a-848f-6bb12c29f60d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-ll6gz\" (UID: \"4c0543a5-61bd-497a-848f-6bb12c29f60d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz" Jul 21 14:32:45.694065 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.693852 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7993f7cc-616e-4593-a05d-896b58ccce86-config\") pod \"service-ca-operator-5bcbc94c78-fphzx\" (UID: \"7993f7cc-616e-4593-a05d-896b58ccce86\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fphzx" Jul 21 14:32:45.694065 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.693878 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-service-ca-bundle\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:45.694065 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.693902 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-metrics-certs\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:45.694065 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:45.693930 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 14:32:45.694065 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.693935 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzk9k\" (UniqueName: \"kubernetes.io/projected/4a55c7ed-23d4-44d5-9e9a-982469a93dd2-kube-api-access-gzk9k\") pod \"volume-data-source-validator-78cf4c6f6-wvnfr\" (UID: \"4a55c7ed-23d4-44d5-9e9a-982469a93dd2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wvnfr" Jul 21 14:32:45.694065 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.693960 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8czx\" (UniqueName: \"kubernetes.io/projected/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-kube-api-access-v8czx\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:45.694065 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.693967 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7dfb5b2b-90f4-445d-a231-09b16bfd3358-ca-trust-extracted\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.694065 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:45.693999 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-metrics-tls podName:a04bb16e-8ec8-442b-b0f2-1a8448f6e490 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:46.193981366 +0000 UTC m=+36.593126523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-metrics-tls") pod "dns-default-f7lm7" (UID: "a04bb16e-8ec8-442b-b0f2-1a8448f6e490") : secret "dns-default-metrics-tls" not found Jul 21 14:32:45.694065 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.694023 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fbc0f993-9ad3-4e74-9efd-f4697e056f73-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-h7ntq\" (UID: \"fbc0f993-9ad3-4e74-9efd-f4697e056f73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7ntq" Jul 21 14:32:45.694065 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:45.694056 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 14:32:45.694709 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:45.694121 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34dc857-ae97-433e-a10e-29e3c0f87f48-samples-operator-tls podName:a34dc857-ae97-433e-a10e-29e3c0f87f48 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:46.194104064 +0000 UTC m=+36.593249235 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a34dc857-ae97-433e-a10e-29e3c0f87f48-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vsq44" (UID: "a34dc857-ae97-433e-a10e-29e3c0f87f48") : secret "samples-operator-tls" not found Jul 21 14:32:45.694709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.694059 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx9w6\" (UniqueName: \"kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-kube-api-access-hx9w6\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.694709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.694164 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7dfb5b2b-90f4-445d-a231-09b16bfd3358-installation-pull-secrets\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.694709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.694204 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d8634880-5487-4cab-a0e5-99c821dfa8f9-snapshots\") pod \"insights-operator-555d9d7885-vw9pf\" (UID: \"d8634880-5487-4cab-a0e5-99c821dfa8f9\") " pod="openshift-insights/insights-operator-555d9d7885-vw9pf" Jul 21 14:32:45.694709 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:45.694229 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 14:32:45.694709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.694238 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8634880-5487-4cab-a0e5-99c821dfa8f9-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-vw9pf\" (UID: \"d8634880-5487-4cab-a0e5-99c821dfa8f9\") " pod="openshift-insights/insights-operator-555d9d7885-vw9pf" Jul 21 14:32:45.694709 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:45.694246 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d7bdd865-vschb: secret "image-registry-tls" not found Jul 21 14:32:45.694709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.694264 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fbc0f993-9ad3-4e74-9efd-f4697e056f73-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-h7ntq\" (UID: \"fbc0f993-9ad3-4e74-9efd-f4697e056f73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7ntq" Jul 21 14:32:45.694709 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:45.694282 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls podName:7dfb5b2b-90f4-445d-a231-09b16bfd3358 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:46.194269721 +0000 UTC m=+36.593414907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls") pod "image-registry-d7bdd865-vschb" (UID: "7dfb5b2b-90f4-445d-a231-09b16bfd3358") : secret "image-registry-tls" not found Jul 21 14:32:45.694709 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:45.694327 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-service-ca-bundle podName:ebc3dc3f-3b6d-4745-bad2-b20b2c84f417 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:46.194312181 +0000 UTC m=+36.593457338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-service-ca-bundle") pod "router-default-56b4b5f45d-9tkdk" (UID: "ebc3dc3f-3b6d-4745-bad2-b20b2c84f417") : configmap references non-existent config key: service-ca.crt Jul 21 14:32:45.694709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.694314 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8634880-5487-4cab-a0e5-99c821dfa8f9-tmp\") pod \"insights-operator-555d9d7885-vw9pf\" (UID: \"d8634880-5487-4cab-a0e5-99c821dfa8f9\") " pod="openshift-insights/insights-operator-555d9d7885-vw9pf" Jul 21 14:32:45.694709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.694360 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8634880-5487-4cab-a0e5-99c821dfa8f9-serving-cert\") pod \"insights-operator-555d9d7885-vw9pf\" (UID: \"d8634880-5487-4cab-a0e5-99c821dfa8f9\") " pod="openshift-insights/insights-operator-555d9d7885-vw9pf" Jul 21 14:32:45.694709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.694391 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-tmp-dir\") pod \"dns-default-f7lm7\" (UID: \"a04bb16e-8ec8-442b-b0f2-1a8448f6e490\") " pod="openshift-dns/dns-default-f7lm7" Jul 21 14:32:45.694709 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:45.694408 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 14:32:45.694709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.694423 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4c0543a5-61bd-497a-848f-6bb12c29f60d-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-ll6gz\" (UID: \"4c0543a5-61bd-497a-848f-6bb12c29f60d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz" Jul 21 14:32:45.695458 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:45.694442 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-metrics-certs podName:ebc3dc3f-3b6d-4745-bad2-b20b2c84f417 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:46.194430981 +0000 UTC m=+36.593576141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-metrics-certs") pod "router-default-56b4b5f45d-9tkdk" (UID: "ebc3dc3f-3b6d-4745-bad2-b20b2c84f417") : secret "router-metrics-certs-default" not found Jul 21 14:32:45.695458 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.694485 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6486q\" (UniqueName: \"kubernetes.io/projected/4c0543a5-61bd-497a-848f-6bb12c29f60d-kube-api-access-6486q\") pod \"cluster-monitoring-operator-76cf8966f8-ll6gz\" (UID: \"4c0543a5-61bd-497a-848f-6bb12c29f60d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz" Jul 21 14:32:45.695458 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.694486 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7993f7cc-616e-4593-a05d-896b58ccce86-config\") pod \"service-ca-operator-5bcbc94c78-fphzx\" (UID: \"7993f7cc-616e-4593-a05d-896b58ccce86\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fphzx" Jul 21 14:32:45.695458 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.694523 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-config-volume\") pod \"dns-default-f7lm7\" (UID: \"a04bb16e-8ec8-442b-b0f2-1a8448f6e490\") " pod="openshift-dns/dns-default-f7lm7" Jul 21 14:32:45.695458 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.694705 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-certificates\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.695458 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:45.694872 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 14:32:45.695458 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:45.694928 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c0543a5-61bd-497a-848f-6bb12c29f60d-cluster-monitoring-operator-tls podName:4c0543a5-61bd-497a-848f-6bb12c29f60d nodeName:}" failed. No retries permitted until 2026-07-21 14:32:46.194913193 +0000 UTC m=+36.594058373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4c0543a5-61bd-497a-848f-6bb12c29f60d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-ll6gz" (UID: "4c0543a5-61bd-497a-848f-6bb12c29f60d") : secret "cluster-monitoring-operator-tls" not found Jul 21 14:32:45.695458 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.695197 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7dfb5b2b-90f4-445d-a231-09b16bfd3358-trusted-ca\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.695458 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.695273 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fbc0f993-9ad3-4e74-9efd-f4697e056f73-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-h7ntq\" (UID: \"fbc0f993-9ad3-4e74-9efd-f4697e056f73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7ntq" Jul 21 14:32:45.695458 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.695347 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-config-volume\") pod \"dns-default-f7lm7\" (UID: \"a04bb16e-8ec8-442b-b0f2-1a8448f6e490\") " pod="openshift-dns/dns-default-f7lm7" Jul 21 14:32:45.695458 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.695452 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/4c0543a5-61bd-497a-848f-6bb12c29f60d-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-ll6gz\" (UID: \"4c0543a5-61bd-497a-848f-6bb12c29f60d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz" Jul 21 14:32:45.695984 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.694551 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7dfb5b2b-90f4-445d-a231-09b16bfd3358-image-registry-private-configuration\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.695984 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.695592 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-tmp-dir\") pod \"dns-default-f7lm7\" (UID: \"a04bb16e-8ec8-442b-b0f2-1a8448f6e490\") " pod="openshift-dns/dns-default-f7lm7" Jul 21 14:32:45.695984 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.695669 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d72fj\" (UniqueName: \"kubernetes.io/projected/f271e332-c1a1-4c1d-81b1-e65885a56930-kube-api-access-d72fj\") pod \"network-check-source-7bc5b6bf85-ghtx2\" (UID: \"f271e332-c1a1-4c1d-81b1-e65885a56930\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-ghtx2" Jul 21 14:32:45.695984 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.695702 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8634880-5487-4cab-a0e5-99c821dfa8f9-service-ca-bundle\") pod \"insights-operator-555d9d7885-vw9pf\" (UID: \"d8634880-5487-4cab-a0e5-99c821dfa8f9\") " pod="openshift-insights/insights-operator-555d9d7885-vw9pf" Jul 21 14:32:45.695984 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.695743 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7993f7cc-616e-4593-a05d-896b58ccce86-serving-cert\") pod \"service-ca-operator-5bcbc94c78-fphzx\" (UID: \"7993f7cc-616e-4593-a05d-896b58ccce86\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fphzx" Jul 21 14:32:45.695984 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.695772 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-bound-sa-token\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.695984 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.695818 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnqk7\" (UniqueName: \"kubernetes.io/projected/a34dc857-ae97-433e-a10e-29e3c0f87f48-kube-api-access-wnqk7\") pod \"cluster-samples-operator-79b7c55f87-vsq44\" (UID: \"a34dc857-ae97-433e-a10e-29e3c0f87f48\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vsq44" Jul 21 14:32:45.695984 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.695883 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-default-certificate\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:45.695984 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.695913 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9pgd\" (UniqueName: \"kubernetes.io/projected/a5ff6a0d-5a95-42e2-883a-0b73c40eb285-kube-api-access-q9pgd\") pod \"ingress-canary-d8gqr\" (UID: \"a5ff6a0d-5a95-42e2-883a-0b73c40eb285\") " pod="openshift-ingress-canary/ingress-canary-d8gqr" Jul 21 14:32:45.695984 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.695920 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d8634880-5487-4cab-a0e5-99c821dfa8f9-snapshots\") pod \"insights-operator-555d9d7885-vw9pf\" (UID: \"d8634880-5487-4cab-a0e5-99c821dfa8f9\") " pod="openshift-insights/insights-operator-555d9d7885-vw9pf" Jul 21 14:32:45.697054 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.697031 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-stats-auth\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:45.697195 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.697119 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8634880-5487-4cab-a0e5-99c821dfa8f9-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-vw9pf\" (UID: \"d8634880-5487-4cab-a0e5-99c821dfa8f9\") " pod="openshift-insights/insights-operator-555d9d7885-vw9pf" Jul 21 14:32:45.697347 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.697312 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8634880-5487-4cab-a0e5-99c821dfa8f9-service-ca-bundle\") pod \"insights-operator-555d9d7885-vw9pf\" (UID: \"d8634880-5487-4cab-a0e5-99c821dfa8f9\") " pod="openshift-insights/insights-operator-555d9d7885-vw9pf" Jul 21 14:32:45.697887 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.697845 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fbc0f993-9ad3-4e74-9efd-f4697e056f73-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-h7ntq\" (UID: \"fbc0f993-9ad3-4e74-9efd-f4697e056f73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7ntq" Jul 21 14:32:45.697975 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.697929 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5ff6a0d-5a95-42e2-883a-0b73c40eb285-cert\") pod \"ingress-canary-d8gqr\" (UID: \"a5ff6a0d-5a95-42e2-883a-0b73c40eb285\") " pod="openshift-ingress-canary/ingress-canary-d8gqr" Jul 21 14:32:45.698202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.698180 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d8634880-5487-4cab-a0e5-99c821dfa8f9-tmp\") pod \"insights-operator-555d9d7885-vw9pf\" (UID: \"d8634880-5487-4cab-a0e5-99c821dfa8f9\") " pod="openshift-insights/insights-operator-555d9d7885-vw9pf" Jul 21 14:32:45.698361 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.698337 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7dfb5b2b-90f4-445d-a231-09b16bfd3358-installation-pull-secrets\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.698401 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.698368 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d8634880-5487-4cab-a0e5-99c821dfa8f9-serving-cert\") pod \"insights-operator-555d9d7885-vw9pf\" (UID: \"d8634880-5487-4cab-a0e5-99c821dfa8f9\") " pod="openshift-insights/insights-operator-555d9d7885-vw9pf" Jul 21 14:32:45.699323 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.699298 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-default-certificate\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:45.699323 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.699319 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7993f7cc-616e-4593-a05d-896b58ccce86-serving-cert\") pod \"service-ca-operator-5bcbc94c78-fphzx\" (UID: \"7993f7cc-616e-4593-a05d-896b58ccce86\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fphzx" Jul 21 14:32:45.699457 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.699419 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7dfb5b2b-90f4-445d-a231-09b16bfd3358-image-registry-private-configuration\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.703947 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.703904 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6486q\" (UniqueName: \"kubernetes.io/projected/4c0543a5-61bd-497a-848f-6bb12c29f60d-kube-api-access-6486q\") pod \"cluster-monitoring-operator-76cf8966f8-ll6gz\" (UID: \"4c0543a5-61bd-497a-848f-6bb12c29f60d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz" Jul 21 14:32:45.704043 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.703956 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8czx\" (UniqueName: \"kubernetes.io/projected/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-kube-api-access-v8czx\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:45.704239 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.704189 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vl5w\" (UniqueName: \"kubernetes.io/projected/fbc0f993-9ad3-4e74-9efd-f4697e056f73-kube-api-access-7vl5w\") pod \"kube-storage-version-migrator-operator-7658d9b749-h7ntq\" (UID: \"fbc0f993-9ad3-4e74-9efd-f4697e056f73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7ntq" Jul 21 14:32:45.704670 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.704617 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2wtt\" (UniqueName: \"kubernetes.io/projected/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-kube-api-access-k2wtt\") pod \"dns-default-f7lm7\" (UID: \"a04bb16e-8ec8-442b-b0f2-1a8448f6e490\") " pod="openshift-dns/dns-default-f7lm7" Jul 21 14:32:45.704774 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.704742 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzk9k\" (UniqueName: \"kubernetes.io/projected/4a55c7ed-23d4-44d5-9e9a-982469a93dd2-kube-api-access-gzk9k\") pod \"volume-data-source-validator-78cf4c6f6-wvnfr\" (UID: \"4a55c7ed-23d4-44d5-9e9a-982469a93dd2\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wvnfr" Jul 21 14:32:45.705627 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.705278 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx9w6\" (UniqueName: \"kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-kube-api-access-hx9w6\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.705627 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.705574 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxfwt\" (UniqueName: \"kubernetes.io/projected/7993f7cc-616e-4593-a05d-896b58ccce86-kube-api-access-rxfwt\") pod \"service-ca-operator-5bcbc94c78-fphzx\" (UID: \"7993f7cc-616e-4593-a05d-896b58ccce86\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fphzx" Jul 21 14:32:45.706560 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.706507 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj4j7\" (UniqueName: \"kubernetes.io/projected/d8634880-5487-4cab-a0e5-99c821dfa8f9-kube-api-access-mj4j7\") pod \"insights-operator-555d9d7885-vw9pf\" (UID: \"d8634880-5487-4cab-a0e5-99c821dfa8f9\") " pod="openshift-insights/insights-operator-555d9d7885-vw9pf" Jul 21 14:32:45.706676 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.706651 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-bound-sa-token\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:45.706908 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.706885 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnqk7\" (UniqueName: \"kubernetes.io/projected/a34dc857-ae97-433e-a10e-29e3c0f87f48-kube-api-access-wnqk7\") pod \"cluster-samples-operator-79b7c55f87-vsq44\" (UID: \"a34dc857-ae97-433e-a10e-29e3c0f87f48\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vsq44" Jul 21 14:32:45.707061 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.707043 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d72fj\" (UniqueName: \"kubernetes.io/projected/f271e332-c1a1-4c1d-81b1-e65885a56930-kube-api-access-d72fj\") pod \"network-check-source-7bc5b6bf85-ghtx2\" (UID: \"f271e332-c1a1-4c1d-81b1-e65885a56930\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-ghtx2" Jul 21 14:32:45.707212 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.707194 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9pgd\" (UniqueName: \"kubernetes.io/projected/a5ff6a0d-5a95-42e2-883a-0b73c40eb285-kube-api-access-q9pgd\") pod \"ingress-canary-d8gqr\" (UID: \"a5ff6a0d-5a95-42e2-883a-0b73c40eb285\") " pod="openshift-ingress-canary/ingress-canary-d8gqr" Jul 21 14:32:45.716925 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.716906 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-spzgj" Jul 21 14:32:45.737073 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.737046 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7ntq" Jul 21 14:32:45.779174 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.778972 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-vw9pf" Jul 21 14:32:45.781150 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.781123 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wvnfr" Jul 21 14:32:45.791308 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.791093 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fphzx" Jul 21 14:32:45.801868 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.801684 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d8gqr" Jul 21 14:32:45.807674 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.807611 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-ghtx2" Jul 21 14:32:45.887973 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.887830 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-spzgj"] Jul 21 14:32:45.894934 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:45.894903 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7acd8006_41bc_43da_a1b0_7f03cda70beb.slice/crio-c08ce0c9dbbf660746149730fd53e56c8ee8a7d03c3f41f500769922b7fc9e8f WatchSource:0}: Error finding container c08ce0c9dbbf660746149730fd53e56c8ee8a7d03c3f41f500769922b7fc9e8f: Status 404 returned error can't find the container with id c08ce0c9dbbf660746149730fd53e56c8ee8a7d03c3f41f500769922b7fc9e8f Jul 21 14:32:45.909748 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:45.908679 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7ntq"] Jul 21 14:32:46.014903 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:46.014873 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-vw9pf"] Jul 21 14:32:46.019958 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:46.018585 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wvnfr"] Jul 21 14:32:46.019958 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:46.018974 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8634880_5487_4cab_a0e5_99c821dfa8f9.slice/crio-48c0cb47e8ebb3ea70d0eb932279510c16688c915d7a592a5488fe1743693b36 WatchSource:0}: Error finding container 48c0cb47e8ebb3ea70d0eb932279510c16688c915d7a592a5488fe1743693b36: Status 404 returned error can't find the container with id 48c0cb47e8ebb3ea70d0eb932279510c16688c915d7a592a5488fe1743693b36 Jul 21 14:32:46.020192 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:46.020162 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fphzx"] Jul 21 14:32:46.050329 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:46.050296 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d8gqr"] Jul 21 14:32:46.054644 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:46.054613 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5ff6a0d_5a95_42e2_883a_0b73c40eb285.slice/crio-1350e564624ffbeee062ecb2e78bf7dc7849efb53308cb6fc4ea7ddb3fcc1a6f WatchSource:0}: Error finding container 1350e564624ffbeee062ecb2e78bf7dc7849efb53308cb6fc4ea7ddb3fcc1a6f: Status 404 returned error can't find the container with id 1350e564624ffbeee062ecb2e78bf7dc7849efb53308cb6fc4ea7ddb3fcc1a6f Jul 21 14:32:46.062771 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:46.062731 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-ghtx2"] Jul 21 14:32:46.065401 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:46.065375 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf271e332_c1a1_4c1d_81b1_e65885a56930.slice/crio-da786770b15421c0a7052e0b5e01e5ee285efbc4581028c15a9e8248f5deac35 WatchSource:0}: Error finding container da786770b15421c0a7052e0b5e01e5ee285efbc4581028c15a9e8248f5deac35: Status 404 returned error can't find the container with id da786770b15421c0a7052e0b5e01e5ee285efbc4581028c15a9e8248f5deac35 Jul 21 14:32:46.119583 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:46.119559 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:32:46.122087 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:46.122066 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c99qd\"" Jul 21 14:32:46.200967 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:46.200888 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c0543a5-61bd-497a-848f-6bb12c29f60d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-ll6gz\" (UID: \"4c0543a5-61bd-497a-848f-6bb12c29f60d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz" Jul 21 14:32:46.200967 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:46.200935 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-service-ca-bundle\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:46.200967 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:46.200961 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-metrics-certs\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:46.201283 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:46.201039 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a34dc857-ae97-433e-a10e-29e3c0f87f48-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vsq44\" (UID: \"a34dc857-ae97-433e-a10e-29e3c0f87f48\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vsq44" Jul 21 14:32:46.201283 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:46.201057 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 14:32:46.201283 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:46.201071 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:46.201283 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:46.201094 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-service-ca-bundle podName:ebc3dc3f-3b6d-4745-bad2-b20b2c84f417 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:47.201071775 +0000 UTC m=+37.600216943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-service-ca-bundle") pod "router-default-56b4b5f45d-9tkdk" (UID: "ebc3dc3f-3b6d-4745-bad2-b20b2c84f417") : configmap references non-existent config key: service-ca.crt Jul 21 14:32:46.201283 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:46.201154 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 14:32:46.201283 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:46.201161 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 14:32:46.201283 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:46.201157 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 14:32:46.201283 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:46.201196 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d7bdd865-vschb: secret "image-registry-tls" not found Jul 21 14:32:46.201283 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:46.201182 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c0543a5-61bd-497a-848f-6bb12c29f60d-cluster-monitoring-operator-tls podName:4c0543a5-61bd-497a-848f-6bb12c29f60d nodeName:}" failed. No retries permitted until 2026-07-21 14:32:47.201161248 +0000 UTC m=+37.600306417 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4c0543a5-61bd-497a-848f-6bb12c29f60d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-ll6gz" (UID: "4c0543a5-61bd-497a-848f-6bb12c29f60d") : secret "cluster-monitoring-operator-tls" not found Jul 21 14:32:46.201283 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:46.201247 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-metrics-tls\") pod \"dns-default-f7lm7\" (UID: \"a04bb16e-8ec8-442b-b0f2-1a8448f6e490\") " pod="openshift-dns/dns-default-f7lm7" Jul 21 14:32:46.201687 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:46.201309 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 14:32:46.201687 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:46.201315 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34dc857-ae97-433e-a10e-29e3c0f87f48-samples-operator-tls podName:a34dc857-ae97-433e-a10e-29e3c0f87f48 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:47.201303815 +0000 UTC m=+37.600448973 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a34dc857-ae97-433e-a10e-29e3c0f87f48-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vsq44" (UID: "a34dc857-ae97-433e-a10e-29e3c0f87f48") : secret "samples-operator-tls" not found Jul 21 14:32:46.201687 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:46.201334 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-metrics-certs podName:ebc3dc3f-3b6d-4745-bad2-b20b2c84f417 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:47.201324546 +0000 UTC m=+37.600469706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-metrics-certs") pod "router-default-56b4b5f45d-9tkdk" (UID: "ebc3dc3f-3b6d-4745-bad2-b20b2c84f417") : secret "router-metrics-certs-default" not found Jul 21 14:32:46.201687 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:46.201357 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls podName:7dfb5b2b-90f4-445d-a231-09b16bfd3358 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:47.201347676 +0000 UTC m=+37.600492833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls") pod "image-registry-d7bdd865-vschb" (UID: "7dfb5b2b-90f4-445d-a231-09b16bfd3358") : secret "image-registry-tls" not found Jul 21 14:32:46.201687 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:46.201374 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-metrics-tls podName:a04bb16e-8ec8-442b-b0f2-1a8448f6e490 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:47.201368149 +0000 UTC m=+37.600513306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-metrics-tls") pod "dns-default-f7lm7" (UID: "a04bb16e-8ec8-442b-b0f2-1a8448f6e490") : secret "dns-default-metrics-tls" not found Jul 21 14:32:46.308258 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:46.308222 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d8gqr" event={"ID":"a5ff6a0d-5a95-42e2-883a-0b73c40eb285","Type":"ContainerStarted","Data":"1350e564624ffbeee062ecb2e78bf7dc7849efb53308cb6fc4ea7ddb3fcc1a6f"} Jul 21 14:32:46.309683 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:46.309649 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-vw9pf" event={"ID":"d8634880-5487-4cab-a0e5-99c821dfa8f9","Type":"ContainerStarted","Data":"48c0cb47e8ebb3ea70d0eb932279510c16688c915d7a592a5488fe1743693b36"} Jul 21 14:32:46.311042 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:46.311003 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7ntq" event={"ID":"fbc0f993-9ad3-4e74-9efd-f4697e056f73","Type":"ContainerStarted","Data":"778537be6c026130677d91c8d105ed0c621020f57e2367d209412a806e69531d"} Jul 21 14:32:46.312217 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:46.312186 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-spzgj" event={"ID":"7acd8006-41bc-43da-a1b0-7f03cda70beb","Type":"ContainerStarted","Data":"c08ce0c9dbbf660746149730fd53e56c8ee8a7d03c3f41f500769922b7fc9e8f"} Jul 21 14:32:46.313622 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:46.313589 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-ghtx2" event={"ID":"f271e332-c1a1-4c1d-81b1-e65885a56930","Type":"ContainerStarted","Data":"da786770b15421c0a7052e0b5e01e5ee285efbc4581028c15a9e8248f5deac35"} Jul 21 14:32:46.314857 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:46.314822 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wvnfr" event={"ID":"4a55c7ed-23d4-44d5-9e9a-982469a93dd2","Type":"ContainerStarted","Data":"cc0a76451a1898030ad30079a4d95b827631b646ea7356d843bedadb92f64483"} Jul 21 14:32:46.315997 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:46.315973 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fphzx" event={"ID":"7993f7cc-616e-4593-a05d-896b58ccce86","Type":"ContainerStarted","Data":"89a3a268a7ec3d4a5c85a87ad3e3cbfd7eb5ea4271c940f742aca9eed043fdb4"} Jul 21 14:32:47.115434 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:47.115402 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:32:47.116309 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:47.115894 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:32:47.119364 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:47.119336 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 14:32:47.119570 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:47.119554 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 14:32:47.120065 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:47.120049 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cprh8\"" Jul 21 14:32:47.213711 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:47.213671 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c0543a5-61bd-497a-848f-6bb12c29f60d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-ll6gz\" (UID: \"4c0543a5-61bd-497a-848f-6bb12c29f60d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz" Jul 21 14:32:47.213919 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:47.213732 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-service-ca-bundle\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:47.213919 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:47.213759 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-metrics-certs\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:47.213919 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:47.213881 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a34dc857-ae97-433e-a10e-29e3c0f87f48-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vsq44\" (UID: \"a34dc857-ae97-433e-a10e-29e3c0f87f48\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vsq44" Jul 21 14:32:47.213919 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:47.213913 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:47.214133 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:47.213937 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-metrics-tls\") pod \"dns-default-f7lm7\" (UID: \"a04bb16e-8ec8-442b-b0f2-1a8448f6e490\") " pod="openshift-dns/dns-default-f7lm7" Jul 21 14:32:47.214133 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:47.214079 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 14:32:47.214236 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:47.214141 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-metrics-tls podName:a04bb16e-8ec8-442b-b0f2-1a8448f6e490 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:49.214123681 +0000 UTC m=+39.613268841 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-metrics-tls") pod "dns-default-f7lm7" (UID: "a04bb16e-8ec8-442b-b0f2-1a8448f6e490") : secret "dns-default-metrics-tls" not found Jul 21 14:32:47.214567 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:47.214548 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 14:32:47.214647 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:47.214607 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c0543a5-61bd-497a-848f-6bb12c29f60d-cluster-monitoring-operator-tls podName:4c0543a5-61bd-497a-848f-6bb12c29f60d nodeName:}" failed. No retries permitted until 2026-07-21 14:32:49.214592057 +0000 UTC m=+39.613737218 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4c0543a5-61bd-497a-848f-6bb12c29f60d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-ll6gz" (UID: "4c0543a5-61bd-497a-848f-6bb12c29f60d") : secret "cluster-monitoring-operator-tls" not found Jul 21 14:32:47.214713 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:47.214676 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-service-ca-bundle podName:ebc3dc3f-3b6d-4745-bad2-b20b2c84f417 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:49.214665843 +0000 UTC m=+39.613811006 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-service-ca-bundle") pod "router-default-56b4b5f45d-9tkdk" (UID: "ebc3dc3f-3b6d-4745-bad2-b20b2c84f417") : configmap references non-existent config key: service-ca.crt Jul 21 14:32:47.214776 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:47.214734 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 14:32:47.214776 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:47.214765 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-metrics-certs podName:ebc3dc3f-3b6d-4745-bad2-b20b2c84f417 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:49.21475523 +0000 UTC m=+39.613900392 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-metrics-certs") pod "router-default-56b4b5f45d-9tkdk" (UID: "ebc3dc3f-3b6d-4745-bad2-b20b2c84f417") : secret "router-metrics-certs-default" not found Jul 21 14:32:47.214914 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:47.214846 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 14:32:47.214914 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:47.214878 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34dc857-ae97-433e-a10e-29e3c0f87f48-samples-operator-tls podName:a34dc857-ae97-433e-a10e-29e3c0f87f48 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:49.214867489 +0000 UTC m=+39.614012646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a34dc857-ae97-433e-a10e-29e3c0f87f48-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vsq44" (UID: "a34dc857-ae97-433e-a10e-29e3c0f87f48") : secret "samples-operator-tls" not found Jul 21 14:32:47.215022 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:47.214941 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 14:32:47.215022 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:47.214952 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d7bdd865-vschb: secret "image-registry-tls" not found Jul 21 14:32:47.215022 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:47.214982 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls podName:7dfb5b2b-90f4-445d-a231-09b16bfd3358 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:49.214971205 +0000 UTC m=+39.614116366 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls") pod "image-registry-d7bdd865-vschb" (UID: "7dfb5b2b-90f4-445d-a231-09b16bfd3358") : secret "image-registry-tls" not found Jul 21 14:32:49.236160 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:49.236121 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a34dc857-ae97-433e-a10e-29e3c0f87f48-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vsq44\" (UID: \"a34dc857-ae97-433e-a10e-29e3c0f87f48\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vsq44" Jul 21 14:32:49.236160 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:49.236175 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:49.236776 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:49.236200 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-metrics-tls\") pod \"dns-default-f7lm7\" (UID: \"a04bb16e-8ec8-442b-b0f2-1a8448f6e490\") " pod="openshift-dns/dns-default-f7lm7" Jul 21 14:32:49.236776 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:49.236244 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c0543a5-61bd-497a-848f-6bb12c29f60d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-ll6gz\" (UID: \"4c0543a5-61bd-497a-848f-6bb12c29f60d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz" Jul 21 14:32:49.236776 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:49.236265 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 14:32:49.236776 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:49.236282 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-service-ca-bundle\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:49.236776 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:49.236306 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-metrics-certs\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:49.236776 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:49.236330 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34dc857-ae97-433e-a10e-29e3c0f87f48-samples-operator-tls podName:a34dc857-ae97-433e-a10e-29e3c0f87f48 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:53.236311503 +0000 UTC m=+43.635456684 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a34dc857-ae97-433e-a10e-29e3c0f87f48-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vsq44" (UID: "a34dc857-ae97-433e-a10e-29e3c0f87f48") : secret "samples-operator-tls" not found Jul 21 14:32:49.236776 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:49.236366 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 14:32:49.236776 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:49.236397 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-metrics-certs podName:ebc3dc3f-3b6d-4745-bad2-b20b2c84f417 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:53.236388279 +0000 UTC m=+43.635533436 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-metrics-certs") pod "router-default-56b4b5f45d-9tkdk" (UID: "ebc3dc3f-3b6d-4745-bad2-b20b2c84f417") : secret "router-metrics-certs-default" not found Jul 21 14:32:49.236776 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:49.236454 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 14:32:49.236776 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:49.236464 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d7bdd865-vschb: secret "image-registry-tls" not found Jul 21 14:32:49.236776 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:49.236513 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls podName:7dfb5b2b-90f4-445d-a231-09b16bfd3358 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:53.236483325 +0000 UTC m=+43.635628497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls") pod "image-registry-d7bdd865-vschb" (UID: "7dfb5b2b-90f4-445d-a231-09b16bfd3358") : secret "image-registry-tls" not found Jul 21 14:32:49.237256 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:49.236809 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 14:32:49.237256 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:49.236868 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c0543a5-61bd-497a-848f-6bb12c29f60d-cluster-monitoring-operator-tls podName:4c0543a5-61bd-497a-848f-6bb12c29f60d nodeName:}" failed. No retries permitted until 2026-07-21 14:32:53.236851579 +0000 UTC m=+43.635996754 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4c0543a5-61bd-497a-848f-6bb12c29f60d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-ll6gz" (UID: "4c0543a5-61bd-497a-848f-6bb12c29f60d") : secret "cluster-monitoring-operator-tls" not found Jul 21 14:32:49.237256 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:49.236941 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-service-ca-bundle podName:ebc3dc3f-3b6d-4745-bad2-b20b2c84f417 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:53.236931067 +0000 UTC m=+43.636076238 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-service-ca-bundle") pod "router-default-56b4b5f45d-9tkdk" (UID: "ebc3dc3f-3b6d-4745-bad2-b20b2c84f417") : configmap references non-existent config key: service-ca.crt Jul 21 14:32:49.238687 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:49.238664 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 14:32:49.238908 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:49.238733 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-metrics-tls podName:a04bb16e-8ec8-442b-b0f2-1a8448f6e490 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:53.238716789 +0000 UTC m=+43.637861951 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-metrics-tls") pod "dns-default-f7lm7" (UID: "a04bb16e-8ec8-442b-b0f2-1a8448f6e490") : secret "dns-default-metrics-tls" not found Jul 21 14:32:53.272547 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:53.272366 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a34dc857-ae97-433e-a10e-29e3c0f87f48-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vsq44\" (UID: \"a34dc857-ae97-433e-a10e-29e3c0f87f48\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vsq44" Jul 21 14:32:53.273118 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:53.272558 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:32:53.273118 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:53.272578 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-metrics-tls\") pod \"dns-default-f7lm7\" (UID: \"a04bb16e-8ec8-442b-b0f2-1a8448f6e490\") " pod="openshift-dns/dns-default-f7lm7" Jul 21 14:32:53.273118 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:53.272609 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c0543a5-61bd-497a-848f-6bb12c29f60d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-ll6gz\" (UID: \"4c0543a5-61bd-497a-848f-6bb12c29f60d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz" Jul 21 14:32:53.273118 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:53.272522 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 14:32:53.273118 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:53.272632 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-service-ca-bundle\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:53.273118 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:53.272650 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-metrics-certs\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:32:53.273118 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:53.272652 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 14:32:53.273118 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:53.272671 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d7bdd865-vschb: secret "image-registry-tls" not found Jul 21 14:32:53.273118 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:53.272710 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34dc857-ae97-433e-a10e-29e3c0f87f48-samples-operator-tls podName:a34dc857-ae97-433e-a10e-29e3c0f87f48 nodeName:}" failed. No retries permitted until 2026-07-21 14:33:01.272681951 +0000 UTC m=+51.671827120 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a34dc857-ae97-433e-a10e-29e3c0f87f48-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vsq44" (UID: "a34dc857-ae97-433e-a10e-29e3c0f87f48") : secret "samples-operator-tls" not found Jul 21 14:32:53.273118 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:53.272715 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 14:32:53.273118 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:53.272738 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 14:32:53.273118 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:53.272753 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 14:32:53.273118 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:53.272763 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-metrics-tls podName:a04bb16e-8ec8-442b-b0f2-1a8448f6e490 nodeName:}" failed. No retries permitted until 2026-07-21 14:33:01.272747185 +0000 UTC m=+51.671892343 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-metrics-tls") pod "dns-default-f7lm7" (UID: "a04bb16e-8ec8-442b-b0f2-1a8448f6e490") : secret "dns-default-metrics-tls" not found Jul 21 14:32:53.273118 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:53.272784 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls podName:7dfb5b2b-90f4-445d-a231-09b16bfd3358 nodeName:}" failed. No retries permitted until 2026-07-21 14:33:01.272777321 +0000 UTC m=+51.671922478 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls") pod "image-registry-d7bdd865-vschb" (UID: "7dfb5b2b-90f4-445d-a231-09b16bfd3358") : secret "image-registry-tls" not found Jul 21 14:32:53.273118 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:53.272816 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c0543a5-61bd-497a-848f-6bb12c29f60d-cluster-monitoring-operator-tls podName:4c0543a5-61bd-497a-848f-6bb12c29f60d nodeName:}" failed. No retries permitted until 2026-07-21 14:33:01.272811124 +0000 UTC m=+51.671956281 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4c0543a5-61bd-497a-848f-6bb12c29f60d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-ll6gz" (UID: "4c0543a5-61bd-497a-848f-6bb12c29f60d") : secret "cluster-monitoring-operator-tls" not found Jul 21 14:32:53.273118 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:53.272829 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-service-ca-bundle podName:ebc3dc3f-3b6d-4745-bad2-b20b2c84f417 nodeName:}" failed. No retries permitted until 2026-07-21 14:33:01.272823935 +0000 UTC m=+51.671969091 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-service-ca-bundle") pod "router-default-56b4b5f45d-9tkdk" (UID: "ebc3dc3f-3b6d-4745-bad2-b20b2c84f417") : configmap references non-existent config key: service-ca.crt Jul 21 14:32:53.273639 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:53.272839 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-metrics-certs podName:ebc3dc3f-3b6d-4745-bad2-b20b2c84f417 nodeName:}" failed. No retries permitted until 2026-07-21 14:33:01.272834071 +0000 UTC m=+51.671979229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-metrics-certs") pod "router-default-56b4b5f45d-9tkdk" (UID: "ebc3dc3f-3b6d-4745-bad2-b20b2c84f417") : secret "router-metrics-certs-default" not found Jul 21 14:32:57.354700 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.354666 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wvnfr" event={"ID":"4a55c7ed-23d4-44d5-9e9a-982469a93dd2","Type":"ContainerStarted","Data":"b935933cf15821b2c7f0d1650063736bdf2f29d0a49a5f079e293eba32e99e4f"} Jul 21 14:32:57.356461 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.356438 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fphzx" event={"ID":"7993f7cc-616e-4593-a05d-896b58ccce86","Type":"ContainerStarted","Data":"9b019f5a0ebf5c676f3df787edb3876a470a7d76690f317d4b331d19fb553956"} Jul 21 14:32:57.360150 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.360124 2559 generic.go:356] "Generic (PLEG): container finished" podID="8dcb8d95-8dc6-44a6-96b7-40f6453a7a79" containerID="3c4c15d301cbece0f6071ac1ce6165fee3d3ec3e405a8464be7f7f93b94808ad" exitCode=0 Jul 21 14:32:57.360291 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.360204 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lwvs" event={"ID":"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79","Type":"ContainerDied","Data":"3c4c15d301cbece0f6071ac1ce6165fee3d3ec3e405a8464be7f7f93b94808ad"} Jul 21 14:32:57.362441 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.362410 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d8gqr" event={"ID":"a5ff6a0d-5a95-42e2-883a-0b73c40eb285","Type":"ContainerStarted","Data":"14e9c620ac3316070b7bbefa9d0128a72d71d6bd253a76778a1e2321d92aecba"} Jul 21 14:32:57.364437 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.364389 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-vw9pf" event={"ID":"d8634880-5487-4cab-a0e5-99c821dfa8f9","Type":"ContainerStarted","Data":"edeab628a9feec3156dad0d408705a3ad13f6d9cce0df854f70e43f69c2c3715"} Jul 21 14:32:57.366122 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.366098 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7ntq" event={"ID":"fbc0f993-9ad3-4e74-9efd-f4697e056f73","Type":"ContainerStarted","Data":"5e11e85c6fb3ef3ad5185995b99044106ba3aed5dfa01423b64b0dfc05529cd7"} Jul 21 14:32:57.368859 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.368839 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/0.log" Jul 21 14:32:57.368945 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.368878 2559 generic.go:356] "Generic (PLEG): container finished" podID="7acd8006-41bc-43da-a1b0-7f03cda70beb" containerID="cf1f5361e26ce62ffa8b8421305710807ca945e3e0dbbf065fcd9b58c4202408" exitCode=255 Jul 21 14:32:57.368997 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.368954 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-spzgj" event={"ID":"7acd8006-41bc-43da-a1b0-7f03cda70beb","Type":"ContainerDied","Data":"cf1f5361e26ce62ffa8b8421305710807ca945e3e0dbbf065fcd9b58c4202408"} Jul 21 14:32:57.369213 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.369199 2559 scope.go:117] "RemoveContainer" containerID="cf1f5361e26ce62ffa8b8421305710807ca945e3e0dbbf065fcd9b58c4202408" Jul 21 14:32:57.370421 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.370401 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-ghtx2" event={"ID":"f271e332-c1a1-4c1d-81b1-e65885a56930","Type":"ContainerStarted","Data":"7209f570364bae732266e981afee25760c45d5a0089bc13f7ddd8ca727d31fed"} Jul 21 14:32:57.372169 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.372122 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-wvnfr" podStartSLOduration=7.338492945 podStartE2EDuration="15.372106293s" totalImagesPullingTime="8.033613348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:32:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:32:57.371398506 +0000 UTC m=+47.770543684" watchObservedRunningTime="2026-07-21 14:32:57.372106293 +0000 UTC m=+47.771251475" Jul 21 14:32:57.391306 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.391254 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-vw9pf" podStartSLOduration=5.002029991 podStartE2EDuration="15.391237657s" totalImagesPullingTime="10.389207666s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:32:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:32:57.389681279 +0000 UTC m=+47.788826456" watchObservedRunningTime="2026-07-21 14:32:57.391237657 +0000 UTC m=+47.790382816" Jul 21 14:32:57.425841 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.425524 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7ntq" podStartSLOduration=4.972657777 podStartE2EDuration="15.425501145s" totalImagesPullingTime="10.452843368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:32:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:32:57.406865446 +0000 UTC m=+47.806010627" watchObservedRunningTime="2026-07-21 14:32:57.425501145 +0000 UTC m=+47.824646325" Jul 21 14:32:57.476198 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.476153 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fphzx" podStartSLOduration=5.093979995 podStartE2EDuration="15.476137036s" totalImagesPullingTime="10.382157041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:32:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:32:57.454324472 +0000 UTC m=+47.853469651" watchObservedRunningTime="2026-07-21 14:32:57.476137036 +0000 UTC m=+47.875282259" Jul 21 14:32:57.476587 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.476559 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d8gqr" podStartSLOduration=2.122276424 podStartE2EDuration="12.476549463s" totalImagesPullingTime="10.354273039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:32:57.474996087 +0000 UTC m=+47.874141267" watchObservedRunningTime="2026-07-21 14:32:57.476549463 +0000 UTC m=+47.875694642" Jul 21 14:32:57.508813 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.508375 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-ghtx2" podStartSLOduration=5.164606437 podStartE2EDuration="15.508353867s" totalImagesPullingTime="10.34374743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:32:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:32:57.507127834 +0000 UTC m=+47.906273016" watchObservedRunningTime="2026-07-21 14:32:57.508353867 +0000 UTC m=+47.907499048" Jul 21 14:32:57.801564 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.801521 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kmthf"] Jul 21 14:32:57.819848 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.819811 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kmthf"] Jul 21 14:32:57.820032 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.819928 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:32:57.823207 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.822375 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 21 14:32:57.823207 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.822388 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wkr9m\"" Jul 21 14:32:57.823207 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.822579 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 21 14:32:57.920154 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.920070 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72e5392d-2e8f-4991-89c7-5944c96ba071-data-volume\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:32:57.920154 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.920114 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72e5392d-2e8f-4991-89c7-5944c96ba071-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:32:57.920333 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.920275 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72e5392d-2e8f-4991-89c7-5944c96ba071-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:32:57.920366 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.920339 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tphml\" (UniqueName: \"kubernetes.io/projected/72e5392d-2e8f-4991-89c7-5944c96ba071-kube-api-access-tphml\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:32:57.920401 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:57.920388 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72e5392d-2e8f-4991-89c7-5944c96ba071-crio-socket\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:32:58.021636 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.021595 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72e5392d-2e8f-4991-89c7-5944c96ba071-crio-socket\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:32:58.021840 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.021664 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72e5392d-2e8f-4991-89c7-5944c96ba071-data-volume\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:32:58.021840 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.021712 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72e5392d-2e8f-4991-89c7-5944c96ba071-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:32:58.021840 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.021786 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/72e5392d-2e8f-4991-89c7-5944c96ba071-crio-socket\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:32:58.022003 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:58.021868 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 14:32:58.022003 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:58.021931 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72e5392d-2e8f-4991-89c7-5944c96ba071-insights-runtime-extractor-tls podName:72e5392d-2e8f-4991-89c7-5944c96ba071 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:58.521913687 +0000 UTC m=+48.921058861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72e5392d-2e8f-4991-89c7-5944c96ba071-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kmthf" (UID: "72e5392d-2e8f-4991-89c7-5944c96ba071") : secret "insights-runtime-extractor-tls" not found Jul 21 14:32:58.022003 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.021994 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72e5392d-2e8f-4991-89c7-5944c96ba071-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:32:58.022142 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.022049 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tphml\" (UniqueName: \"kubernetes.io/projected/72e5392d-2e8f-4991-89c7-5944c96ba071-kube-api-access-tphml\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:32:58.022142 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.022053 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/72e5392d-2e8f-4991-89c7-5944c96ba071-data-volume\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:32:58.022142 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:58.022102 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 14:32:58.022280 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:58.022152 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72e5392d-2e8f-4991-89c7-5944c96ba071-kube-rbac-proxy-cm podName:72e5392d-2e8f-4991-89c7-5944c96ba071 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:58.522136931 +0000 UTC m=+48.921282095 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72e5392d-2e8f-4991-89c7-5944c96ba071-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kmthf" (UID: "72e5392d-2e8f-4991-89c7-5944c96ba071") : configmap "kube-rbac-proxy" not found Jul 21 14:32:58.033881 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.033847 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tphml\" (UniqueName: \"kubernetes.io/projected/72e5392d-2e8f-4991-89c7-5944c96ba071-kube-api-access-tphml\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:32:58.377517 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.377329 2559 generic.go:356] "Generic (PLEG): container finished" podID="8dcb8d95-8dc6-44a6-96b7-40f6453a7a79" containerID="59e5104f34c54fb2289f6b4dbed5dd4599e96592d5ac00c1fa567589e6be4fe0" exitCode=0 Jul 21 14:32:58.377517 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.377463 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lwvs" event={"ID":"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79","Type":"ContainerDied","Data":"59e5104f34c54fb2289f6b4dbed5dd4599e96592d5ac00c1fa567589e6be4fe0"} Jul 21 14:32:58.379280 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.379261 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 14:32:58.379682 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.379666 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/0.log" Jul 21 14:32:58.379739 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.379702 2559 generic.go:356] "Generic (PLEG): container finished" podID="7acd8006-41bc-43da-a1b0-7f03cda70beb" containerID="53f01cf0298cd9c515f738a3361933de2d418bf64ce1dfef16f037b6989c7a3c" exitCode=255 Jul 21 14:32:58.379782 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.379770 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-spzgj" event={"ID":"7acd8006-41bc-43da-a1b0-7f03cda70beb","Type":"ContainerDied","Data":"53f01cf0298cd9c515f738a3361933de2d418bf64ce1dfef16f037b6989c7a3c"} Jul 21 14:32:58.379860 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.379832 2559 scope.go:117] "RemoveContainer" containerID="cf1f5361e26ce62ffa8b8421305710807ca945e3e0dbbf065fcd9b58c4202408" Jul 21 14:32:58.380043 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.380022 2559 scope.go:117] "RemoveContainer" containerID="53f01cf0298cd9c515f738a3361933de2d418bf64ce1dfef16f037b6989c7a3c" Jul 21 14:32:58.380217 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:58.380194 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-spzgj_openshift-console-operator(7acd8006-41bc-43da-a1b0-7f03cda70beb)\"" pod="openshift-console-operator/console-operator-565b7b569d-spzgj" podUID="7acd8006-41bc-43da-a1b0-7f03cda70beb" Jul 21 14:32:58.482449 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.482422 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wb7sd"] Jul 21 14:32:58.503385 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.503355 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wb7sd"] Jul 21 14:32:58.503556 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.503512 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wb7sd" Jul 21 14:32:58.506845 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.506635 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 21 14:32:58.506845 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.506640 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 21 14:32:58.506845 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.506827 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-k7p8t\"" Jul 21 14:32:58.527861 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.527836 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72e5392d-2e8f-4991-89c7-5944c96ba071-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:32:58.527986 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.527877 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tg9vj\" (UniqueName: \"kubernetes.io/projected/fefe4553-2a78-4118-96cc-c1b16d020e76-kube-api-access-tg9vj\") pod \"migrator-7cc9c7ffd7-wb7sd\" (UID: \"fefe4553-2a78-4118-96cc-c1b16d020e76\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wb7sd" Jul 21 14:32:58.527986 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.527950 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72e5392d-2e8f-4991-89c7-5944c96ba071-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:32:58.528099 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:58.528003 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 14:32:58.528099 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:58.528035 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 14:32:58.528099 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:58.528084 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72e5392d-2e8f-4991-89c7-5944c96ba071-insights-runtime-extractor-tls podName:72e5392d-2e8f-4991-89c7-5944c96ba071 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:59.528063771 +0000 UTC m=+49.927208944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72e5392d-2e8f-4991-89c7-5944c96ba071-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kmthf" (UID: "72e5392d-2e8f-4991-89c7-5944c96ba071") : secret "insights-runtime-extractor-tls" not found Jul 21 14:32:58.528252 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:58.528105 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72e5392d-2e8f-4991-89c7-5944c96ba071-kube-rbac-proxy-cm podName:72e5392d-2e8f-4991-89c7-5944c96ba071 nodeName:}" failed. No retries permitted until 2026-07-21 14:32:59.528094662 +0000 UTC m=+49.927239827 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72e5392d-2e8f-4991-89c7-5944c96ba071-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kmthf" (UID: "72e5392d-2e8f-4991-89c7-5944c96ba071") : configmap "kube-rbac-proxy" not found Jul 21 14:32:58.628949 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.628882 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tg9vj\" (UniqueName: \"kubernetes.io/projected/fefe4553-2a78-4118-96cc-c1b16d020e76-kube-api-access-tg9vj\") pod \"migrator-7cc9c7ffd7-wb7sd\" (UID: \"fefe4553-2a78-4118-96cc-c1b16d020e76\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wb7sd" Jul 21 14:32:58.637204 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.637180 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tg9vj\" (UniqueName: \"kubernetes.io/projected/fefe4553-2a78-4118-96cc-c1b16d020e76-kube-api-access-tg9vj\") pod \"migrator-7cc9c7ffd7-wb7sd\" (UID: \"fefe4553-2a78-4118-96cc-c1b16d020e76\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wb7sd" Jul 21 14:32:58.778123 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.778064 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-qpqqq"] Jul 21 14:32:58.798808 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.798772 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-qpqqq"] Jul 21 14:32:58.798956 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.798879 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qpqqq" Jul 21 14:32:58.801255 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.801234 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wkktv\"" Jul 21 14:32:58.801390 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.801269 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 21 14:32:58.801464 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.801434 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 21 14:32:58.814638 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.814619 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wb7sd" Jul 21 14:32:58.831057 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.831023 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/34992709-e4d4-4cae-8d06-0989d2a64a0c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-qpqqq\" (UID: \"34992709-e4d4-4cae-8d06-0989d2a64a0c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qpqqq" Jul 21 14:32:58.831164 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.831072 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/34992709-e4d4-4cae-8d06-0989d2a64a0c-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-qpqqq\" (UID: \"34992709-e4d4-4cae-8d06-0989d2a64a0c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qpqqq" Jul 21 14:32:58.890842 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.890821 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4wjk4_60210dbf-9a04-4c44-a654-d6fd2cf80403/dns-node-resolver/0.log" Jul 21 14:32:58.932549 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.932521 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/34992709-e4d4-4cae-8d06-0989d2a64a0c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-qpqqq\" (UID: \"34992709-e4d4-4cae-8d06-0989d2a64a0c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qpqqq" Jul 21 14:32:58.932688 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.932561 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/34992709-e4d4-4cae-8d06-0989d2a64a0c-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-qpqqq\" (UID: \"34992709-e4d4-4cae-8d06-0989d2a64a0c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qpqqq" Jul 21 14:32:58.932688 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:58.932672 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 14:32:58.932753 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:58.932743 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34992709-e4d4-4cae-8d06-0989d2a64a0c-networking-console-plugin-cert podName:34992709-e4d4-4cae-8d06-0989d2a64a0c nodeName:}" failed. No retries permitted until 2026-07-21 14:32:59.432723907 +0000 UTC m=+49.831869096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/34992709-e4d4-4cae-8d06-0989d2a64a0c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-qpqqq" (UID: "34992709-e4d4-4cae-8d06-0989d2a64a0c") : secret "networking-console-plugin-cert" not found Jul 21 14:32:58.933271 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.933254 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/34992709-e4d4-4cae-8d06-0989d2a64a0c-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-qpqqq\" (UID: \"34992709-e4d4-4cae-8d06-0989d2a64a0c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qpqqq" Jul 21 14:32:58.957770 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:58.957735 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wb7sd"] Jul 21 14:32:58.960806 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:32:58.960766 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfefe4553_2a78_4118_96cc_c1b16d020e76.slice/crio-0f505558daf1e420bfd0345204326542c6e50f2c691755aad46ab2e565b74eb5 WatchSource:0}: Error finding container 0f505558daf1e420bfd0345204326542c6e50f2c691755aad46ab2e565b74eb5: Status 404 returned error can't find the container with id 0f505558daf1e420bfd0345204326542c6e50f2c691755aad46ab2e565b74eb5 Jul 21 14:32:59.384491 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:59.384466 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 14:32:59.384993 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:59.384889 2559 scope.go:117] "RemoveContainer" containerID="53f01cf0298cd9c515f738a3361933de2d418bf64ce1dfef16f037b6989c7a3c" Jul 21 14:32:59.385113 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:59.385084 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-spzgj_openshift-console-operator(7acd8006-41bc-43da-a1b0-7f03cda70beb)\"" pod="openshift-console-operator/console-operator-565b7b569d-spzgj" podUID="7acd8006-41bc-43da-a1b0-7f03cda70beb" Jul 21 14:32:59.387625 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:59.387603 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5lwvs" event={"ID":"8dcb8d95-8dc6-44a6-96b7-40f6453a7a79","Type":"ContainerStarted","Data":"7638a2500f9b8e38bc866a15dcce2dd71b16267302794d764ba32af842093cd8"} Jul 21 14:32:59.388671 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:59.388648 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wb7sd" event={"ID":"fefe4553-2a78-4118-96cc-c1b16d020e76","Type":"ContainerStarted","Data":"0f505558daf1e420bfd0345204326542c6e50f2c691755aad46ab2e565b74eb5"} Jul 21 14:32:59.421788 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:59.421706 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5lwvs" podStartSLOduration=8.80644679 podStartE2EDuration="49.421691578s" totalImagesPullingTime="40.615244788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:32:10 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:32:59.421388511 +0000 UTC m=+49.820533700" watchObservedRunningTime="2026-07-21 14:32:59.421691578 +0000 UTC m=+49.820836735" Jul 21 14:32:59.437552 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:59.437504 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/34992709-e4d4-4cae-8d06-0989d2a64a0c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-qpqqq\" (UID: \"34992709-e4d4-4cae-8d06-0989d2a64a0c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qpqqq" Jul 21 14:32:59.437715 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:59.437574 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 14:32:59.437715 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:59.437638 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34992709-e4d4-4cae-8d06-0989d2a64a0c-networking-console-plugin-cert podName:34992709-e4d4-4cae-8d06-0989d2a64a0c nodeName:}" failed. No retries permitted until 2026-07-21 14:33:00.437618963 +0000 UTC m=+50.836764134 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/34992709-e4d4-4cae-8d06-0989d2a64a0c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-qpqqq" (UID: "34992709-e4d4-4cae-8d06-0989d2a64a0c") : secret "networking-console-plugin-cert" not found Jul 21 14:32:59.538118 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:59.538081 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72e5392d-2e8f-4991-89c7-5944c96ba071-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:32:59.538335 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:32:59.538185 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72e5392d-2e8f-4991-89c7-5944c96ba071-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:32:59.538335 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:59.538253 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 14:32:59.538335 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:59.538296 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 14:32:59.538335 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:59.538332 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72e5392d-2e8f-4991-89c7-5944c96ba071-insights-runtime-extractor-tls podName:72e5392d-2e8f-4991-89c7-5944c96ba071 nodeName:}" failed. No retries permitted until 2026-07-21 14:33:01.538311376 +0000 UTC m=+51.937456533 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72e5392d-2e8f-4991-89c7-5944c96ba071-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kmthf" (UID: "72e5392d-2e8f-4991-89c7-5944c96ba071") : secret "insights-runtime-extractor-tls" not found Jul 21 14:32:59.538540 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:32:59.538353 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72e5392d-2e8f-4991-89c7-5944c96ba071-kube-rbac-proxy-cm podName:72e5392d-2e8f-4991-89c7-5944c96ba071 nodeName:}" failed. No retries permitted until 2026-07-21 14:33:01.538341972 +0000 UTC m=+51.937487128 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72e5392d-2e8f-4991-89c7-5944c96ba071-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kmthf" (UID: "72e5392d-2e8f-4991-89c7-5944c96ba071") : configmap "kube-rbac-proxy" not found Jul 21 14:33:00.290521 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:00.290488 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l5lf7_f443a0aa-6687-44b0-9581-4e8953060962/node-ca/0.log" Jul 21 14:33:00.446429 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:00.446389 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/34992709-e4d4-4cae-8d06-0989d2a64a0c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-qpqqq\" (UID: \"34992709-e4d4-4cae-8d06-0989d2a64a0c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qpqqq" Jul 21 14:33:00.446875 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:00.446516 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 14:33:00.446875 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:00.446585 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34992709-e4d4-4cae-8d06-0989d2a64a0c-networking-console-plugin-cert podName:34992709-e4d4-4cae-8d06-0989d2a64a0c nodeName:}" failed. No retries permitted until 2026-07-21 14:33:02.446566493 +0000 UTC m=+52.845711651 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/34992709-e4d4-4cae-8d06-0989d2a64a0c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-qpqqq" (UID: "34992709-e4d4-4cae-8d06-0989d2a64a0c") : secret "networking-console-plugin-cert" not found Jul 21 14:33:00.696314 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:00.696224 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d8gqr_a5ff6a0d-5a95-42e2-883a-0b73c40eb285/serve-healthcheck-canary/0.log" Jul 21 14:33:01.354371 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:01.354341 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a34dc857-ae97-433e-a10e-29e3c0f87f48-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vsq44\" (UID: \"a34dc857-ae97-433e-a10e-29e3c0f87f48\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vsq44" Jul 21 14:33:01.354522 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:01.354379 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:33:01.354522 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:01.354404 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-metrics-tls\") pod \"dns-default-f7lm7\" (UID: \"a04bb16e-8ec8-442b-b0f2-1a8448f6e490\") " pod="openshift-dns/dns-default-f7lm7" Jul 21 14:33:01.354522 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:01.354493 2559 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 21 14:33:01.354522 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:01.354509 2559 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 21 14:33:01.354748 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:01.354528 2559 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-d7bdd865-vschb: secret "image-registry-tls" not found Jul 21 14:33:01.354748 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:01.354541 2559 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 14:33:01.354748 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:01.354562 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a34dc857-ae97-433e-a10e-29e3c0f87f48-samples-operator-tls podName:a34dc857-ae97-433e-a10e-29e3c0f87f48 nodeName:}" failed. No retries permitted until 2026-07-21 14:33:17.354546319 +0000 UTC m=+67.753691494 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/a34dc857-ae97-433e-a10e-29e3c0f87f48-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-vsq44" (UID: "a34dc857-ae97-433e-a10e-29e3c0f87f48") : secret "samples-operator-tls" not found Jul 21 14:33:01.354748 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:01.354588 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-metrics-tls podName:a04bb16e-8ec8-442b-b0f2-1a8448f6e490 nodeName:}" failed. No retries permitted until 2026-07-21 14:33:17.354581413 +0000 UTC m=+67.753726569 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-metrics-tls") pod "dns-default-f7lm7" (UID: "a04bb16e-8ec8-442b-b0f2-1a8448f6e490") : secret "dns-default-metrics-tls" not found Jul 21 14:33:01.354748 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:01.354601 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls podName:7dfb5b2b-90f4-445d-a231-09b16bfd3358 nodeName:}" failed. No retries permitted until 2026-07-21 14:33:17.354593894 +0000 UTC m=+67.753739051 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls") pod "image-registry-d7bdd865-vschb" (UID: "7dfb5b2b-90f4-445d-a231-09b16bfd3358") : secret "image-registry-tls" not found Jul 21 14:33:01.354748 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:01.354619 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c0543a5-61bd-497a-848f-6bb12c29f60d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-ll6gz\" (UID: \"4c0543a5-61bd-497a-848f-6bb12c29f60d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz" Jul 21 14:33:01.354748 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:01.354654 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-service-ca-bundle\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:33:01.354748 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:01.354675 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-metrics-certs\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:33:01.354748 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:01.354732 2559 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 21 14:33:01.355089 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:01.354764 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-service-ca-bundle podName:ebc3dc3f-3b6d-4745-bad2-b20b2c84f417 nodeName:}" failed. No retries permitted until 2026-07-21 14:33:17.354752044 +0000 UTC m=+67.753897200 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-service-ca-bundle") pod "router-default-56b4b5f45d-9tkdk" (UID: "ebc3dc3f-3b6d-4745-bad2-b20b2c84f417") : configmap references non-existent config key: service-ca.crt Jul 21 14:33:01.355089 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:01.354778 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c0543a5-61bd-497a-848f-6bb12c29f60d-cluster-monitoring-operator-tls podName:4c0543a5-61bd-497a-848f-6bb12c29f60d nodeName:}" failed. No retries permitted until 2026-07-21 14:33:17.354771008 +0000 UTC m=+67.753916165 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/4c0543a5-61bd-497a-848f-6bb12c29f60d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-ll6gz" (UID: "4c0543a5-61bd-497a-848f-6bb12c29f60d") : secret "cluster-monitoring-operator-tls" not found Jul 21 14:33:01.355089 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:01.354781 2559 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 21 14:33:01.355089 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:01.354830 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-metrics-certs podName:ebc3dc3f-3b6d-4745-bad2-b20b2c84f417 nodeName:}" failed. No retries permitted until 2026-07-21 14:33:17.35481936 +0000 UTC m=+67.753964534 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-metrics-certs") pod "router-default-56b4b5f45d-9tkdk" (UID: "ebc3dc3f-3b6d-4745-bad2-b20b2c84f417") : secret "router-metrics-certs-default" not found Jul 21 14:33:01.396299 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:01.396219 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wb7sd" event={"ID":"fefe4553-2a78-4118-96cc-c1b16d020e76","Type":"ContainerStarted","Data":"b2b5592b39dacbad80d39a7a6066eea91ef65ca346d08a8729a539666dcde9d7"} Jul 21 14:33:01.396299 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:01.396278 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wb7sd" event={"ID":"fefe4553-2a78-4118-96cc-c1b16d020e76","Type":"ContainerStarted","Data":"711c1ee60fab26418bd8a5703d94fe75d6163135cbeedce665e5fcd874d6f41f"} Jul 21 14:33:01.414363 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:01.414315 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-wb7sd" podStartSLOduration=1.262212615 podStartE2EDuration="3.414301121s" totalImagesPullingTime="2.152088506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:33:01.413554507 +0000 UTC m=+51.812699699" watchObservedRunningTime="2026-07-21 14:33:01.414301121 +0000 UTC m=+51.813446311" Jul 21 14:33:01.557227 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:01.557185 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72e5392d-2e8f-4991-89c7-5944c96ba071-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:33:01.557620 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:01.557333 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 14:33:01.557620 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:01.557384 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72e5392d-2e8f-4991-89c7-5944c96ba071-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:33:01.557620 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:01.557399 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72e5392d-2e8f-4991-89c7-5944c96ba071-insights-runtime-extractor-tls podName:72e5392d-2e8f-4991-89c7-5944c96ba071 nodeName:}" failed. No retries permitted until 2026-07-21 14:33:05.557384634 +0000 UTC m=+55.956529794 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72e5392d-2e8f-4991-89c7-5944c96ba071-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kmthf" (UID: "72e5392d-2e8f-4991-89c7-5944c96ba071") : secret "insights-runtime-extractor-tls" not found Jul 21 14:33:01.557620 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:01.557438 2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 14:33:01.557620 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:01.557488 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/72e5392d-2e8f-4991-89c7-5944c96ba071-kube-rbac-proxy-cm podName:72e5392d-2e8f-4991-89c7-5944c96ba071 nodeName:}" failed. No retries permitted until 2026-07-21 14:33:05.557478203 +0000 UTC m=+55.956623359 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/72e5392d-2e8f-4991-89c7-5944c96ba071-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kmthf" (UID: "72e5392d-2e8f-4991-89c7-5944c96ba071") : configmap "kube-rbac-proxy" not found Jul 21 14:33:02.465400 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:02.465365 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/34992709-e4d4-4cae-8d06-0989d2a64a0c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-qpqqq\" (UID: \"34992709-e4d4-4cae-8d06-0989d2a64a0c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qpqqq" Jul 21 14:33:02.465576 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:02.465471 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 14:33:02.465576 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:02.465525 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34992709-e4d4-4cae-8d06-0989d2a64a0c-networking-console-plugin-cert podName:34992709-e4d4-4cae-8d06-0989d2a64a0c nodeName:}" failed. No retries permitted until 2026-07-21 14:33:06.465511696 +0000 UTC m=+56.864656853 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/34992709-e4d4-4cae-8d06-0989d2a64a0c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-qpqqq" (UID: "34992709-e4d4-4cae-8d06-0989d2a64a0c") : secret "networking-console-plugin-cert" not found Jul 21 14:33:05.597161 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:05.597126 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72e5392d-2e8f-4991-89c7-5944c96ba071-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:33:05.597681 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:05.597256 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72e5392d-2e8f-4991-89c7-5944c96ba071-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:33:05.597681 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:05.597287 2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 14:33:05.597681 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:05.597376 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/72e5392d-2e8f-4991-89c7-5944c96ba071-insights-runtime-extractor-tls podName:72e5392d-2e8f-4991-89c7-5944c96ba071 nodeName:}" failed. No retries permitted until 2026-07-21 14:33:13.597357625 +0000 UTC m=+63.996502805 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/72e5392d-2e8f-4991-89c7-5944c96ba071-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kmthf" (UID: "72e5392d-2e8f-4991-89c7-5944c96ba071") : secret "insights-runtime-extractor-tls" not found Jul 21 14:33:05.597811 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:05.597745 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/72e5392d-2e8f-4991-89c7-5944c96ba071-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:33:05.717631 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:05.717580 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-spzgj" Jul 21 14:33:05.717817 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:05.717647 2559 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-spzgj" Jul 21 14:33:05.718025 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:05.718012 2559 scope.go:117] "RemoveContainer" containerID="53f01cf0298cd9c515f738a3361933de2d418bf64ce1dfef16f037b6989c7a3c" Jul 21 14:33:05.718180 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:05.718162 2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-spzgj_openshift-console-operator(7acd8006-41bc-43da-a1b0-7f03cda70beb)\"" pod="openshift-console-operator/console-operator-565b7b569d-spzgj" podUID="7acd8006-41bc-43da-a1b0-7f03cda70beb" Jul 21 14:33:06.506341 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:06.506303 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/34992709-e4d4-4cae-8d06-0989d2a64a0c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-qpqqq\" (UID: \"34992709-e4d4-4cae-8d06-0989d2a64a0c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qpqqq" Jul 21 14:33:06.506523 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:06.506457 2559 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 21 14:33:06.506563 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:33:06.506542 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34992709-e4d4-4cae-8d06-0989d2a64a0c-networking-console-plugin-cert podName:34992709-e4d4-4cae-8d06-0989d2a64a0c nodeName:}" failed. No retries permitted until 2026-07-21 14:33:14.506526013 +0000 UTC m=+64.905671170 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/34992709-e4d4-4cae-8d06-0989d2a64a0c-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-qpqqq" (UID: "34992709-e4d4-4cae-8d06-0989d2a64a0c") : secret "networking-console-plugin-cert" not found Jul 21 14:33:10.293115 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:10.293086 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vvvbp" Jul 21 14:33:13.674273 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:13.674230 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72e5392d-2e8f-4991-89c7-5944c96ba071-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:33:13.676472 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:13.676446 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/72e5392d-2e8f-4991-89c7-5944c96ba071-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kmthf\" (UID: \"72e5392d-2e8f-4991-89c7-5944c96ba071\") " pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:33:13.735325 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:13.735296 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wkr9m\"" Jul 21 14:33:13.743410 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:13.743389 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kmthf" Jul 21 14:33:13.863462 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:13.863437 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kmthf"] Jul 21 14:33:13.865760 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:33:13.865734 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72e5392d_2e8f_4991_89c7_5944c96ba071.slice/crio-01799591c00785e5afab664dc9dd11455d3691ac382f91d907dc4fe03005feac WatchSource:0}: Error finding container 01799591c00785e5afab664dc9dd11455d3691ac382f91d907dc4fe03005feac: Status 404 returned error can't find the container with id 01799591c00785e5afab664dc9dd11455d3691ac382f91d907dc4fe03005feac Jul 21 14:33:14.442935 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:14.442899 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kmthf" event={"ID":"72e5392d-2e8f-4991-89c7-5944c96ba071","Type":"ContainerStarted","Data":"01799591c00785e5afab664dc9dd11455d3691ac382f91d907dc4fe03005feac"} Jul 21 14:33:14.581892 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:14.581847 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/34992709-e4d4-4cae-8d06-0989d2a64a0c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-qpqqq\" (UID: \"34992709-e4d4-4cae-8d06-0989d2a64a0c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qpqqq" Jul 21 14:33:14.584579 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:14.584551 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/34992709-e4d4-4cae-8d06-0989d2a64a0c-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-qpqqq\" (UID: \"34992709-e4d4-4cae-8d06-0989d2a64a0c\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qpqqq" Jul 21 14:33:14.711070 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:14.711040 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-wkktv\"" Jul 21 14:33:14.718869 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:14.718840 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qpqqq" Jul 21 14:33:14.896322 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:14.896289 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-qpqqq"] Jul 21 14:33:14.899703 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:33:14.899672 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34992709_e4d4_4cae_8d06_0989d2a64a0c.slice/crio-0e7e0f4e2ceef97852aaff7de0f428b0ae73111451b57e41f6d7efa9b2ac0f83 WatchSource:0}: Error finding container 0e7e0f4e2ceef97852aaff7de0f428b0ae73111451b57e41f6d7efa9b2ac0f83: Status 404 returned error can't find the container with id 0e7e0f4e2ceef97852aaff7de0f428b0ae73111451b57e41f6d7efa9b2ac0f83 Jul 21 14:33:15.447747 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:15.447704 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qpqqq" event={"ID":"34992709-e4d4-4cae-8d06-0989d2a64a0c","Type":"ContainerStarted","Data":"0e7e0f4e2ceef97852aaff7de0f428b0ae73111451b57e41f6d7efa9b2ac0f83"} Jul 21 14:33:15.793387 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:15.793345 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs\") pod \"network-metrics-daemon-jt8tp\" (UID: \"ff2e3b8e-ffa1-4753-973f-fd67e111bf2e\") " pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:33:15.795788 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:15.795759 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 14:33:15.806526 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:15.806466 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ff2e3b8e-ffa1-4753-973f-fd67e111bf2e-metrics-certs\") pod \"network-metrics-daemon-jt8tp\" (UID: \"ff2e3b8e-ffa1-4753-973f-fd67e111bf2e\") " pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:33:15.895226 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:15.895177 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrbtz\" (UniqueName: \"kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz\") pod \"network-check-target-hfzqm\" (UID: \"68244146-2fb6-42ed-8c43-730c2f1fbc2f\") " pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:33:15.897827 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:15.895542 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret\") pod \"global-pull-secret-syncer-4zv85\" (UID: \"47d4c102-9f81-49f9-901a-99fd62fd7315\") " pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:33:15.898268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:15.898042 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 14:33:15.901399 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:15.901375 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrbtz\" (UniqueName: \"kubernetes.io/projected/68244146-2fb6-42ed-8c43-730c2f1fbc2f-kube-api-access-jrbtz\") pod \"network-check-target-hfzqm\" (UID: \"68244146-2fb6-42ed-8c43-730c2f1fbc2f\") " pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:33:15.908389 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:15.908361 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/47d4c102-9f81-49f9-901a-99fd62fd7315-original-pull-secret\") pod \"global-pull-secret-syncer-4zv85\" (UID: \"47d4c102-9f81-49f9-901a-99fd62fd7315\") " pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:33:15.938221 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:15.938193 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cprh8\"" Jul 21 14:33:15.944052 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:15.944025 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-4zv85" Jul 21 14:33:15.946173 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:15.946142 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jt8tp" Jul 21 14:33:16.105919 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:16.105741 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jt8tp"] Jul 21 14:33:16.112538 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:33:16.112490 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff2e3b8e_ffa1_4753_973f_fd67e111bf2e.slice/crio-ad1434ca39e1a9d42d0da80b8ca23d0f2ce6da7289f7dd0d1175e960c0b9f274 WatchSource:0}: Error finding container ad1434ca39e1a9d42d0da80b8ca23d0f2ce6da7289f7dd0d1175e960c0b9f274: Status 404 returned error can't find the container with id ad1434ca39e1a9d42d0da80b8ca23d0f2ce6da7289f7dd0d1175e960c0b9f274 Jul 21 14:33:16.132688 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:16.132657 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c99qd\"" Jul 21 14:33:16.139350 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:16.139279 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-4zv85"] Jul 21 14:33:16.140823 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:16.140729 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:33:16.143769 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:33:16.143746 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47d4c102_9f81_49f9_901a_99fd62fd7315.slice/crio-9673eed9b37520adf83c95109dbb50ebe3b7bd42a1523b8fa4f2d4aa5d91e6a5 WatchSource:0}: Error finding container 9673eed9b37520adf83c95109dbb50ebe3b7bd42a1523b8fa4f2d4aa5d91e6a5: Status 404 returned error can't find the container with id 9673eed9b37520adf83c95109dbb50ebe3b7bd42a1523b8fa4f2d4aa5d91e6a5 Jul 21 14:33:16.452730 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:16.452694 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4zv85" event={"ID":"47d4c102-9f81-49f9-901a-99fd62fd7315","Type":"ContainerStarted","Data":"9673eed9b37520adf83c95109dbb50ebe3b7bd42a1523b8fa4f2d4aa5d91e6a5"} Jul 21 14:33:16.454069 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:16.454045 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jt8tp" event={"ID":"ff2e3b8e-ffa1-4753-973f-fd67e111bf2e","Type":"ContainerStarted","Data":"ad1434ca39e1a9d42d0da80b8ca23d0f2ce6da7289f7dd0d1175e960c0b9f274"} Jul 21 14:33:17.410194 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.410155 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a34dc857-ae97-433e-a10e-29e3c0f87f48-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vsq44\" (UID: \"a34dc857-ae97-433e-a10e-29e3c0f87f48\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vsq44" Jul 21 14:33:17.410657 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.410214 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:33:17.410657 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.410241 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-metrics-tls\") pod \"dns-default-f7lm7\" (UID: \"a04bb16e-8ec8-442b-b0f2-1a8448f6e490\") " pod="openshift-dns/dns-default-f7lm7" Jul 21 14:33:17.410657 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.410278 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c0543a5-61bd-497a-848f-6bb12c29f60d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-ll6gz\" (UID: \"4c0543a5-61bd-497a-848f-6bb12c29f60d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz" Jul 21 14:33:17.410657 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.410307 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-service-ca-bundle\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:33:17.410657 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.410325 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-metrics-certs\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:33:17.411916 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.411888 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-service-ca-bundle\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:33:17.413688 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.413407 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ebc3dc3f-3b6d-4745-bad2-b20b2c84f417-metrics-certs\") pod \"router-default-56b4b5f45d-9tkdk\" (UID: \"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417\") " pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:33:17.413688 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.413456 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a04bb16e-8ec8-442b-b0f2-1a8448f6e490-metrics-tls\") pod \"dns-default-f7lm7\" (UID: \"a04bb16e-8ec8-442b-b0f2-1a8448f6e490\") " pod="openshift-dns/dns-default-f7lm7" Jul 21 14:33:17.413688 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.413659 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c0543a5-61bd-497a-848f-6bb12c29f60d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-ll6gz\" (UID: \"4c0543a5-61bd-497a-848f-6bb12c29f60d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz" Jul 21 14:33:17.414311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.414268 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/a34dc857-ae97-433e-a10e-29e3c0f87f48-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-vsq44\" (UID: \"a34dc857-ae97-433e-a10e-29e3c0f87f48\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vsq44" Jul 21 14:33:17.415081 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.415055 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls\") pod \"image-registry-d7bdd865-vschb\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:33:17.524835 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.524782 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gcwlj\"" Jul 21 14:33:17.532728 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.532704 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:33:17.532938 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.532917 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nrtkq\"" Jul 21 14:33:17.540839 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.540810 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz" Jul 21 14:33:17.560035 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.560013 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-t2qjq\"" Jul 21 14:33:17.568087 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.568064 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-f7lm7" Jul 21 14:33:17.570136 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.570120 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-lv5h4\"" Jul 21 14:33:17.578930 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.578908 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vsq44" Jul 21 14:33:17.598865 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.598841 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ftqxk\"" Jul 21 14:33:17.606890 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:17.606864 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:33:18.897002 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:18.896924 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hfzqm"] Jul 21 14:33:19.150646 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:33:19.150585 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68244146_2fb6_42ed_8c43_730c2f1fbc2f.slice/crio-29f5e5336d4d0291929d383d44b1f1093f96ac987e07dc9bcdfe945103e33b53 WatchSource:0}: Error finding container 29f5e5336d4d0291929d383d44b1f1093f96ac987e07dc9bcdfe945103e33b53: Status 404 returned error can't find the container with id 29f5e5336d4d0291929d383d44b1f1093f96ac987e07dc9bcdfe945103e33b53 Jul 21 14:33:19.467897 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:19.467824 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hfzqm" event={"ID":"68244146-2fb6-42ed-8c43-730c2f1fbc2f","Type":"ContainerStarted","Data":"29f5e5336d4d0291929d383d44b1f1093f96ac987e07dc9bcdfe945103e33b53"} Jul 21 14:33:20.117426 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:20.117400 2559 scope.go:117] "RemoveContainer" containerID="53f01cf0298cd9c515f738a3361933de2d418bf64ce1dfef16f037b6989c7a3c" Jul 21 14:33:21.442528 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.442422 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-d7bdd865-vschb"] Jul 21 14:33:21.448506 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.448429 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-56b4b5f45d-9tkdk"] Jul 21 14:33:21.449136 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:33:21.449101 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dfb5b2b_90f4_445d_a231_09b16bfd3358.slice/crio-d60a2f4eecd6d34bb1e4bb30c797096d2140dbdc0f0e268405cd8c47820742b4 WatchSource:0}: Error finding container d60a2f4eecd6d34bb1e4bb30c797096d2140dbdc0f0e268405cd8c47820742b4: Status 404 returned error can't find the container with id d60a2f4eecd6d34bb1e4bb30c797096d2140dbdc0f0e268405cd8c47820742b4 Jul 21 14:33:21.466279 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.465596 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vsq44"] Jul 21 14:33:21.484234 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.484204 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 14:33:21.484366 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.484306 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-spzgj" event={"ID":"7acd8006-41bc-43da-a1b0-7f03cda70beb","Type":"ContainerStarted","Data":"d59715afb94535400d0931afbae48186e8caede3d0091a4b96573f299ded73db"} Jul 21 14:33:21.484916 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.484837 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-spzgj" Jul 21 14:33:21.487256 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.487130 2559 patch_prober.go:28] interesting pod/console-operator-565b7b569d-spzgj container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.6:8443/readyz\": dial tcp 10.132.0.6:8443: connect: connection refused" start-of-body= Jul 21 14:33:21.487256 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.487185 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-565b7b569d-spzgj" podUID="7acd8006-41bc-43da-a1b0-7f03cda70beb" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.6:8443/readyz\": dial tcp 10.132.0.6:8443: connect: connection refused" Jul 21 14:33:21.502228 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.501504 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-4zv85" event={"ID":"47d4c102-9f81-49f9-901a-99fd62fd7315","Type":"ContainerStarted","Data":"e3632cbeb7da8b0b0b6dc377e0322d72a1fb275129e57c5664e51dee191faea1"} Jul 21 14:33:21.505867 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.505353 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" event={"ID":"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417","Type":"ContainerStarted","Data":"b8ab63f5e0773f4eee6ff13a22c95e867f9c11e9171d97938531cc8710792abc"} Jul 21 14:33:21.507630 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.507269 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-spzgj" podStartSLOduration=28.994530242 podStartE2EDuration="39.507251135s" totalImagesPullingTime="10.512720893s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:32:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:33:21.506767227 +0000 UTC m=+71.905912410" watchObservedRunningTime="2026-07-21 14:33:21.507251135 +0000 UTC m=+71.906396314" Jul 21 14:33:21.508776 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.508750 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qpqqq" event={"ID":"34992709-e4d4-4cae-8d06-0989d2a64a0c","Type":"ContainerStarted","Data":"3cac2e9e1727a66391844ee711dcc33e49b7203f76ca8b6d3b2d5a35c034ead1"} Jul 21 14:33:21.512291 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.512221 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jt8tp" event={"ID":"ff2e3b8e-ffa1-4753-973f-fd67e111bf2e","Type":"ContainerStarted","Data":"25fb5f46ca3282c9b08913e2ee5503c6f19d58b9178e0de004d9d6eef5eaedc9"} Jul 21 14:33:21.518705 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.516765 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz"] Jul 21 14:33:21.522399 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.522134 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-f7lm7"] Jul 21 14:33:21.529680 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.526425 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kmthf" event={"ID":"72e5392d-2e8f-4991-89c7-5944c96ba071","Type":"ContainerStarted","Data":"d18d29c147f6b6204347f5ecf19f21a81095f287031f00aae51036b7008c97e6"} Jul 21 14:33:21.529680 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:33:21.528129 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c0543a5_61bd_497a_848f_6bb12c29f60d.slice/crio-3e5965e5e726308377cf5250f1920921d71dab5b17a4558dbf1e3b61574f9301 WatchSource:0}: Error finding container 3e5965e5e726308377cf5250f1920921d71dab5b17a4558dbf1e3b61574f9301: Status 404 returned error can't find the container with id 3e5965e5e726308377cf5250f1920921d71dab5b17a4558dbf1e3b61574f9301 Jul 21 14:33:21.536815 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.536725 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hfzqm" event={"ID":"68244146-2fb6-42ed-8c43-730c2f1fbc2f","Type":"ContainerStarted","Data":"6682cf50954324f3682658f17c3495692cfdc7b0a29758ac55f9ae1554361ad0"} Jul 21 14:33:21.538581 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.538129 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:33:21.538581 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.538193 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-4zv85" podStartSLOduration=66.462981772 podStartE2EDuration="1m11.538175615s" totalImagesPullingTime="5.075193843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:32:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:33:21.536399368 +0000 UTC m=+71.935544549" watchObservedRunningTime="2026-07-21 14:33:21.538175615 +0000 UTC m=+71.937320806" Jul 21 14:33:21.539546 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.539521 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d7bdd865-vschb" event={"ID":"7dfb5b2b-90f4-445d-a231-09b16bfd3358","Type":"ContainerStarted","Data":"d60a2f4eecd6d34bb1e4bb30c797096d2140dbdc0f0e268405cd8c47820742b4"} Jul 21 14:33:21.558081 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.557657 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-qpqqq" podStartSLOduration=18.936832676 podStartE2EDuration="23.557636707s" totalImagesPullingTime="4.620804031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:33:21.556383785 +0000 UTC m=+71.955528968" watchObservedRunningTime="2026-07-21 14:33:21.557636707 +0000 UTC m=+71.956781888" Jul 21 14:33:21.949290 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.948394 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hfzqm" podStartSLOduration=71.948371975 podStartE2EDuration="1m11.948371975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:32:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:33:21.574365043 +0000 UTC m=+71.973510223" watchObservedRunningTime="2026-07-21 14:33:21.948371975 +0000 UTC m=+72.347517155" Jul 21 14:33:21.949290 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.949146 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d99bc66-dcc4j"] Jul 21 14:33:21.953115 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.953080 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d99bc66-dcc4j" Jul 21 14:33:21.955911 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.955671 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 21 14:33:21.955911 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.955775 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nglm5\"" Jul 21 14:33:21.956752 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.956665 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 21 14:33:21.956930 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.956890 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 21 14:33:21.957034 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.956932 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 21 14:33:21.970970 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:21.970948 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d99bc66-dcc4j"] Jul 21 14:33:22.048763 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.048733 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45abed06-1e92-44de-b116-aecea44be4f0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f5d99bc66-dcc4j\" (UID: \"45abed06-1e92-44de-b116-aecea44be4f0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d99bc66-dcc4j" Jul 21 14:33:22.048950 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.048781 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nvzr\" (UniqueName: \"kubernetes.io/projected/45abed06-1e92-44de-b116-aecea44be4f0-kube-api-access-8nvzr\") pod \"managed-serviceaccount-addon-agent-7f5d99bc66-dcc4j\" (UID: \"45abed06-1e92-44de-b116-aecea44be4f0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d99bc66-dcc4j" Jul 21 14:33:22.150026 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.149997 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45abed06-1e92-44de-b116-aecea44be4f0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f5d99bc66-dcc4j\" (UID: \"45abed06-1e92-44de-b116-aecea44be4f0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d99bc66-dcc4j" Jul 21 14:33:22.150182 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.150051 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nvzr\" (UniqueName: \"kubernetes.io/projected/45abed06-1e92-44de-b116-aecea44be4f0-kube-api-access-8nvzr\") pod \"managed-serviceaccount-addon-agent-7f5d99bc66-dcc4j\" (UID: \"45abed06-1e92-44de-b116-aecea44be4f0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d99bc66-dcc4j" Jul 21 14:33:22.153045 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.153024 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/45abed06-1e92-44de-b116-aecea44be4f0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f5d99bc66-dcc4j\" (UID: \"45abed06-1e92-44de-b116-aecea44be4f0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d99bc66-dcc4j" Jul 21 14:33:22.165369 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.165343 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nvzr\" (UniqueName: \"kubernetes.io/projected/45abed06-1e92-44de-b116-aecea44be4f0-kube-api-access-8nvzr\") pod \"managed-serviceaccount-addon-agent-7f5d99bc66-dcc4j\" (UID: \"45abed06-1e92-44de-b116-aecea44be4f0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d99bc66-dcc4j" Jul 21 14:33:22.249095 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.249060 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-slxw2"] Jul 21 14:33:22.253710 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.253684 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-slxw2" Jul 21 14:33:22.259862 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.259671 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 21 14:33:22.260120 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.260099 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 21 14:33:22.260216 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.260127 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-j6dvv\"" Jul 21 14:33:22.274414 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.274387 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-slxw2"] Jul 21 14:33:22.278725 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.278699 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d99bc66-dcc4j" Jul 21 14:33:22.352071 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.352041 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl7tz\" (UniqueName: \"kubernetes.io/projected/bcd8f8bf-96d7-401a-8af8-3df4a8f6a72f-kube-api-access-hl7tz\") pod \"downloads-5bc67dcd46-slxw2\" (UID: \"bcd8f8bf-96d7-401a-8af8-3df4a8f6a72f\") " pod="openshift-console/downloads-5bc67dcd46-slxw2" Jul 21 14:33:22.452636 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.452599 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d99bc66-dcc4j"] Jul 21 14:33:22.453080 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.452811 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl7tz\" (UniqueName: \"kubernetes.io/projected/bcd8f8bf-96d7-401a-8af8-3df4a8f6a72f-kube-api-access-hl7tz\") pod \"downloads-5bc67dcd46-slxw2\" (UID: \"bcd8f8bf-96d7-401a-8af8-3df4a8f6a72f\") " pod="openshift-console/downloads-5bc67dcd46-slxw2" Jul 21 14:33:22.459846 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:33:22.459807 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45abed06_1e92_44de_b116_aecea44be4f0.slice/crio-645785b832506f8e0d86b03203b947e91e2c91ea946fd7458bcea756a726ace8 WatchSource:0}: Error finding container 645785b832506f8e0d86b03203b947e91e2c91ea946fd7458bcea756a726ace8: Status 404 returned error can't find the container with id 645785b832506f8e0d86b03203b947e91e2c91ea946fd7458bcea756a726ace8 Jul 21 14:33:22.464358 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.464285 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl7tz\" (UniqueName: \"kubernetes.io/projected/bcd8f8bf-96d7-401a-8af8-3df4a8f6a72f-kube-api-access-hl7tz\") pod \"downloads-5bc67dcd46-slxw2\" (UID: \"bcd8f8bf-96d7-401a-8af8-3df4a8f6a72f\") " pod="openshift-console/downloads-5bc67dcd46-slxw2" Jul 21 14:33:22.549307 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.548666 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" event={"ID":"ebc3dc3f-3b6d-4745-bad2-b20b2c84f417","Type":"ContainerStarted","Data":"eb66dbde886c4e8cfeeaeaf53da535dfb0c8fdb40c1dad9dd77e0d119bc71f90"} Jul 21 14:33:22.550902 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.550860 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d99bc66-dcc4j" event={"ID":"45abed06-1e92-44de-b116-aecea44be4f0","Type":"ContainerStarted","Data":"645785b832506f8e0d86b03203b947e91e2c91ea946fd7458bcea756a726ace8"} Jul 21 14:33:22.552309 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.552275 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f7lm7" event={"ID":"a04bb16e-8ec8-442b-b0f2-1a8448f6e490","Type":"ContainerStarted","Data":"a37875d59997e6fd45cd121e0fcaa69ee061744f05e5f9c34b2d0f60da87affb"} Jul 21 14:33:22.556267 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.555977 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jt8tp" event={"ID":"ff2e3b8e-ffa1-4753-973f-fd67e111bf2e","Type":"ContainerStarted","Data":"26016c6de97fed5521b5981926bca62f2e0b30edb360de74f5016264e34b6cba"} Jul 21 14:33:22.564713 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.562686 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vsq44" event={"ID":"a34dc857-ae97-433e-a10e-29e3c0f87f48","Type":"ContainerStarted","Data":"896ee7cb8279e328ddec1b5ce44a0c43a712e0b96f081553cf5cebf67c3d377c"} Jul 21 14:33:22.567391 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.566472 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-slxw2" Jul 21 14:33:22.567391 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.567148 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz" event={"ID":"4c0543a5-61bd-497a-848f-6bb12c29f60d","Type":"ContainerStarted","Data":"3e5965e5e726308377cf5250f1920921d71dab5b17a4558dbf1e3b61574f9301"} Jul 21 14:33:22.570713 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.570658 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d7bdd865-vschb" event={"ID":"7dfb5b2b-90f4-445d-a231-09b16bfd3358","Type":"ContainerStarted","Data":"3c645e750df32d999fa351257a00434c376611341116f2585a82f1e99ce0f668"} Jul 21 14:33:22.575265 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.574214 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" podStartSLOduration=40.574196073 podStartE2EDuration="40.574196073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:32:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:33:22.574158164 +0000 UTC m=+72.973303344" watchObservedRunningTime="2026-07-21 14:33:22.574196073 +0000 UTC m=+72.973341253" Jul 21 14:33:22.577120 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.577097 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-spzgj" Jul 21 14:33:22.596894 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.596840 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-d7bdd865-vschb" podStartSLOduration=72.596820313 podStartE2EDuration="1m12.596820313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:32:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:33:22.595894347 +0000 UTC m=+72.995039595" watchObservedRunningTime="2026-07-21 14:33:22.596820313 +0000 UTC m=+72.995965493" Jul 21 14:33:22.607704 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.607662 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:33:22.610543 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.610522 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:33:22.613256 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.612673 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jt8tp" podStartSLOduration=67.518540215 podStartE2EDuration="1m12.612655739s" totalImagesPullingTime="5.094115524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:32:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:33:22.610886812 +0000 UTC m=+73.010031992" watchObservedRunningTime="2026-07-21 14:33:22.612655739 +0000 UTC m=+73.011800919" Jul 21 14:33:22.753230 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:22.753049 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-slxw2"] Jul 21 14:33:22.758907 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:33:22.758865 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd8f8bf_96d7_401a_8af8_3df4a8f6a72f.slice/crio-8844c0b5a696a18497e2ea3a2b96f7d2348c58088bfbc8bbabb8fc49012e49a4 WatchSource:0}: Error finding container 8844c0b5a696a18497e2ea3a2b96f7d2348c58088bfbc8bbabb8fc49012e49a4: Status 404 returned error can't find the container with id 8844c0b5a696a18497e2ea3a2b96f7d2348c58088bfbc8bbabb8fc49012e49a4 Jul 21 14:33:23.577502 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:23.577461 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-slxw2" event={"ID":"bcd8f8bf-96d7-401a-8af8-3df4a8f6a72f","Type":"ContainerStarted","Data":"8844c0b5a696a18497e2ea3a2b96f7d2348c58088bfbc8bbabb8fc49012e49a4"} Jul 21 14:33:23.577963 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:23.577824 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:33:23.577963 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:23.577874 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:33:23.579360 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:23.579317 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-56b4b5f45d-9tkdk" Jul 21 14:33:30.619034 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:30.618990 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d99bc66-dcc4j" event={"ID":"45abed06-1e92-44de-b116-aecea44be4f0","Type":"ContainerStarted","Data":"64fc9754c3b8cbd47257667b5ac01ebe050612e3ffa8d3fd795f4de473170241"} Jul 21 14:33:30.622271 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:30.622093 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f7lm7" event={"ID":"a04bb16e-8ec8-442b-b0f2-1a8448f6e490","Type":"ContainerStarted","Data":"01c32e64d160240f08d9ae6371df6a0aa53bdbf0d4499ae57cc1e7b6a80a1717"} Jul 21 14:33:30.622271 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:30.622157 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-f7lm7" event={"ID":"a04bb16e-8ec8-442b-b0f2-1a8448f6e490","Type":"ContainerStarted","Data":"e215ef69da0d3ada88b5d61d2d892d78826a192c7b87af56a2d366ae5cd1fce0"} Jul 21 14:33:30.622449 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:30.622298 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-f7lm7" Jul 21 14:33:30.629767 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:30.629734 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kmthf" event={"ID":"72e5392d-2e8f-4991-89c7-5944c96ba071","Type":"ContainerStarted","Data":"f1a5ab9b575339b4dfbf09e78ede9865a051d7e89138de1dc8f547ebdc2f5ad5"} Jul 21 14:33:30.632137 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:30.632101 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vsq44" event={"ID":"a34dc857-ae97-433e-a10e-29e3c0f87f48","Type":"ContainerStarted","Data":"95782d65fcbcc58e934bda48fe89b969aff947dd955af24d33818ff04dba7fd8"} Jul 21 14:33:30.632252 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:30.632160 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vsq44" event={"ID":"a34dc857-ae97-433e-a10e-29e3c0f87f48","Type":"ContainerStarted","Data":"03a46de4838b58800979234b176d6d4da19d8f7cc81727b4a06147105ae4a806"} Jul 21 14:33:30.634060 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:30.634033 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz" event={"ID":"4c0543a5-61bd-497a-848f-6bb12c29f60d","Type":"ContainerStarted","Data":"7e46dea293fd46e7e8c13e8b34b43eb285c5e9b4c606c2015059dc21cb11b116"} Jul 21 14:33:30.639030 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:30.638993 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f5d99bc66-dcc4j" podStartSLOduration=1.891017818 podStartE2EDuration="9.638981295s" totalImagesPullingTime="7.747963477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:33:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:33:30.637839796 +0000 UTC m=+81.036984975" watchObservedRunningTime="2026-07-21 14:33:30.638981295 +0000 UTC m=+81.038126485" Jul 21 14:33:30.659707 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:30.659648 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-f7lm7" podStartSLOduration=38.824131864 podStartE2EDuration="45.659625973s" totalImagesPullingTime="6.835494109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:33:30.658517741 +0000 UTC m=+81.057662921" watchObservedRunningTime="2026-07-21 14:33:30.659625973 +0000 UTC m=+81.058771144" Jul 21 14:33:30.683982 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:30.683917 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-ll6gz" podStartSLOduration=40.013347345 podStartE2EDuration="48.683902219s" totalImagesPullingTime="8.670554874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:32:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:33:30.683081765 +0000 UTC m=+81.082226945" watchObservedRunningTime="2026-07-21 14:33:30.683902219 +0000 UTC m=+81.083047397" Jul 21 14:33:30.703355 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:30.703308 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-vsq44" podStartSLOduration=40.047896 podStartE2EDuration="48.703290922s" totalImagesPullingTime="8.655394922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:32:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:33:30.702573275 +0000 UTC m=+81.101718455" watchObservedRunningTime="2026-07-21 14:33:30.703290922 +0000 UTC m=+81.102436113" Jul 21 14:33:34.653454 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:34.653359 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kmthf" event={"ID":"72e5392d-2e8f-4991-89c7-5944c96ba071","Type":"ContainerStarted","Data":"0093a20d60868520150d796c8f20d6c09156108e82408ca68cf291612ccef516"} Jul 21 14:33:34.686446 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:34.686342 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kmthf" podStartSLOduration=17.641587416 podStartE2EDuration="37.686322661s" totalImagesPullingTime="20.044735245s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 14:32:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:33:34.68553859 +0000 UTC m=+85.084683773" watchObservedRunningTime="2026-07-21 14:33:34.686322661 +0000 UTC m=+85.085467840" Jul 21 14:33:40.641042 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:40.641012 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-f7lm7" Jul 21 14:33:44.586865 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:44.586834 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:33:44.699683 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:44.699636 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-slxw2" event={"ID":"bcd8f8bf-96d7-401a-8af8-3df4a8f6a72f","Type":"ContainerStarted","Data":"f6feb0fbda94e1f100b92cdd6e004d23a4b32441a431786a2463b6e54b6b366d"} Jul 21 14:33:44.699901 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:44.699847 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-slxw2" Jul 21 14:33:44.720997 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:44.720941 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-slxw2" podStartSLOduration=1.4752502650000001 podStartE2EDuration="22.720919174s" totalImagesPullingTime="21.245668909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:33:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:33:44.719703672 +0000 UTC m=+95.118848852" watchObservedRunningTime="2026-07-21 14:33:44.720919174 +0000 UTC m=+95.120064355" Jul 21 14:33:44.725838 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:44.725809 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-slxw2" Jul 21 14:33:45.390270 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.390220 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v6z8j"] Jul 21 14:33:45.421164 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.421129 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.423853 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.423828 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b2phk\"" Jul 21 14:33:45.424157 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.423883 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 21 14:33:45.424157 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.424135 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 21 14:33:45.424328 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.423934 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 21 14:33:45.425912 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.425892 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 21 14:33:45.440602 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.440571 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4dec691f-72c1-4519-a016-edd8cbc0bbc4-node-exporter-textfile\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.440735 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.440618 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4dec691f-72c1-4519-a016-edd8cbc0bbc4-root\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.440735 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.440663 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4dec691f-72c1-4519-a016-edd8cbc0bbc4-node-exporter-accelerators-collector-config\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.440735 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.440702 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4dec691f-72c1-4519-a016-edd8cbc0bbc4-metrics-client-ca\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.440989 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.440763 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4dec691f-72c1-4519-a016-edd8cbc0bbc4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.440989 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.440805 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8t4h\" (UniqueName: \"kubernetes.io/projected/4dec691f-72c1-4519-a016-edd8cbc0bbc4-kube-api-access-w8t4h\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.440989 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.440831 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4dec691f-72c1-4519-a016-edd8cbc0bbc4-node-exporter-tls\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.440989 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.440916 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4dec691f-72c1-4519-a016-edd8cbc0bbc4-sys\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.440989 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.440952 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4dec691f-72c1-4519-a016-edd8cbc0bbc4-node-exporter-wtmp\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.495671 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.495633 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d7bdd865-vschb"] Jul 21 14:33:45.542082 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.542046 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4dec691f-72c1-4519-a016-edd8cbc0bbc4-node-exporter-accelerators-collector-config\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.542278 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.542095 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4dec691f-72c1-4519-a016-edd8cbc0bbc4-metrics-client-ca\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.542278 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.542142 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4dec691f-72c1-4519-a016-edd8cbc0bbc4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.542278 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.542168 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8t4h\" (UniqueName: \"kubernetes.io/projected/4dec691f-72c1-4519-a016-edd8cbc0bbc4-kube-api-access-w8t4h\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.542278 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.542191 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4dec691f-72c1-4519-a016-edd8cbc0bbc4-node-exporter-tls\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.542278 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.542231 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4dec691f-72c1-4519-a016-edd8cbc0bbc4-sys\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.542278 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.542256 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4dec691f-72c1-4519-a016-edd8cbc0bbc4-node-exporter-wtmp\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.542570 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.542297 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4dec691f-72c1-4519-a016-edd8cbc0bbc4-node-exporter-textfile\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.542570 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.542323 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4dec691f-72c1-4519-a016-edd8cbc0bbc4-root\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.542570 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.542414 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4dec691f-72c1-4519-a016-edd8cbc0bbc4-root\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.542570 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.542471 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4dec691f-72c1-4519-a016-edd8cbc0bbc4-sys\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.542767 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.542582 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4dec691f-72c1-4519-a016-edd8cbc0bbc4-node-exporter-wtmp\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.542861 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.542761 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4dec691f-72c1-4519-a016-edd8cbc0bbc4-node-exporter-accelerators-collector-config\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.543032 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.543004 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4dec691f-72c1-4519-a016-edd8cbc0bbc4-node-exporter-textfile\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.543259 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.543242 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4dec691f-72c1-4519-a016-edd8cbc0bbc4-metrics-client-ca\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.545109 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.545089 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4dec691f-72c1-4519-a016-edd8cbc0bbc4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.545585 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.545564 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4dec691f-72c1-4519-a016-edd8cbc0bbc4-node-exporter-tls\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.552073 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.552048 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8t4h\" (UniqueName: \"kubernetes.io/projected/4dec691f-72c1-4519-a016-edd8cbc0bbc4-kube-api-access-w8t4h\") pod \"node-exporter-v6z8j\" (UID: \"4dec691f-72c1-4519-a016-edd8cbc0bbc4\") " pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.732945 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:45.732910 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v6z8j" Jul 21 14:33:45.780909 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:33:45.780864 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dec691f_72c1_4519_a016_edd8cbc0bbc4.slice/crio-2a7334211557a481f0ab5ed380180c8856443e3f008c559352f440e3cdf39cde WatchSource:0}: Error finding container 2a7334211557a481f0ab5ed380180c8856443e3f008c559352f440e3cdf39cde: Status 404 returned error can't find the container with id 2a7334211557a481f0ab5ed380180c8856443e3f008c559352f440e3cdf39cde Jul 21 14:33:46.711206 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:46.711129 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v6z8j" event={"ID":"4dec691f-72c1-4519-a016-edd8cbc0bbc4","Type":"ContainerStarted","Data":"2a7334211557a481f0ab5ed380180c8856443e3f008c559352f440e3cdf39cde"} Jul 21 14:33:47.717273 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:47.717231 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v6z8j" event={"ID":"4dec691f-72c1-4519-a016-edd8cbc0bbc4","Type":"ContainerStarted","Data":"cb6843be75d498efcb2e9d79c52ee5268b5077732b545deeb7f48cd55ecd4c9e"} Jul 21 14:33:48.723133 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:48.723093 2559 generic.go:356] "Generic (PLEG): container finished" podID="4dec691f-72c1-4519-a016-edd8cbc0bbc4" containerID="cb6843be75d498efcb2e9d79c52ee5268b5077732b545deeb7f48cd55ecd4c9e" exitCode=0 Jul 21 14:33:48.723570 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:48.723164 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v6z8j" event={"ID":"4dec691f-72c1-4519-a016-edd8cbc0bbc4","Type":"ContainerDied","Data":"cb6843be75d498efcb2e9d79c52ee5268b5077732b545deeb7f48cd55ecd4c9e"} Jul 21 14:33:49.731008 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:49.730966 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v6z8j" event={"ID":"4dec691f-72c1-4519-a016-edd8cbc0bbc4","Type":"ContainerStarted","Data":"0d2ffcae1ac5edea77a9140cfbfc49557981ad34a43dd06b1b5ec098722cb05e"} Jul 21 14:33:49.731452 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:49.731068 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v6z8j" event={"ID":"4dec691f-72c1-4519-a016-edd8cbc0bbc4","Type":"ContainerStarted","Data":"fe4d966495bb204db89e1b2ebe7b6d99d39f3be186e4f36e75e5c818f5c6d54f"} Jul 21 14:33:49.755589 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:49.755529 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v6z8j" podStartSLOduration=2.891653235 podStartE2EDuration="4.75551427s" totalImagesPullingTime="1.744976365s" totalInitContainerRuntime="118.88467ms" isStatefulPod=true podCreationTimestamp="2026-07-21 14:33:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:33:49.753540766 +0000 UTC m=+100.152685945" watchObservedRunningTime="2026-07-21 14:33:49.75551427 +0000 UTC m=+100.154659448" Jul 21 14:33:53.580915 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:33:53.580882 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hfzqm" Jul 21 14:34:02.784586 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:02.784550 2559 generic.go:356] "Generic (PLEG): container finished" podID="d8634880-5487-4cab-a0e5-99c821dfa8f9" containerID="edeab628a9feec3156dad0d408705a3ad13f6d9cce0df854f70e43f69c2c3715" exitCode=0 Jul 21 14:34:02.785149 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:02.784628 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-vw9pf" event={"ID":"d8634880-5487-4cab-a0e5-99c821dfa8f9","Type":"ContainerDied","Data":"edeab628a9feec3156dad0d408705a3ad13f6d9cce0df854f70e43f69c2c3715"} Jul 21 14:34:02.785149 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:02.785100 2559 scope.go:117] "RemoveContainer" containerID="edeab628a9feec3156dad0d408705a3ad13f6d9cce0df854f70e43f69c2c3715" Jul 21 14:34:03.789900 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:03.789868 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-vw9pf" event={"ID":"d8634880-5487-4cab-a0e5-99c821dfa8f9","Type":"ContainerStarted","Data":"5567f561ac44efc7fdb9e508f0b3471a9a6c18b60d8b0d26df1ba8a23013a635"} Jul 21 14:34:10.522095 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.522035 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-d7bdd865-vschb" podUID="7dfb5b2b-90f4-445d-a231-09b16bfd3358" containerName="registry" containerID="cri-o://3c645e750df32d999fa351257a00434c376611341116f2585a82f1e99ce0f668" gracePeriod=30 Jul 21 14:34:10.808070 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.808037 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:34:10.817202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.817171 2559 generic.go:356] "Generic (PLEG): container finished" podID="7dfb5b2b-90f4-445d-a231-09b16bfd3358" containerID="3c645e750df32d999fa351257a00434c376611341116f2585a82f1e99ce0f668" exitCode=0 Jul 21 14:34:10.817360 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.817215 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-d7bdd865-vschb" Jul 21 14:34:10.817360 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.817212 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d7bdd865-vschb" event={"ID":"7dfb5b2b-90f4-445d-a231-09b16bfd3358","Type":"ContainerDied","Data":"3c645e750df32d999fa351257a00434c376611341116f2585a82f1e99ce0f668"} Jul 21 14:34:10.817438 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.817371 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-d7bdd865-vschb" event={"ID":"7dfb5b2b-90f4-445d-a231-09b16bfd3358","Type":"ContainerDied","Data":"d60a2f4eecd6d34bb1e4bb30c797096d2140dbdc0f0e268405cd8c47820742b4"} Jul 21 14:34:10.817438 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.817398 2559 scope.go:117] "RemoveContainer" containerID="3c645e750df32d999fa351257a00434c376611341116f2585a82f1e99ce0f668" Jul 21 14:34:10.825223 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.825207 2559 scope.go:117] "RemoveContainer" containerID="3c645e750df32d999fa351257a00434c376611341116f2585a82f1e99ce0f668" Jul 21 14:34:10.825500 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:34:10.825480 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3c645e750df32d999fa351257a00434c376611341116f2585a82f1e99ce0f668\": container with ID starting with 3c645e750df32d999fa351257a00434c376611341116f2585a82f1e99ce0f668 not found: ID does not exist" containerID="3c645e750df32d999fa351257a00434c376611341116f2585a82f1e99ce0f668" Jul 21 14:34:10.825583 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.825516 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3c645e750df32d999fa351257a00434c376611341116f2585a82f1e99ce0f668"} err="failed to get container status \"3c645e750df32d999fa351257a00434c376611341116f2585a82f1e99ce0f668\": rpc error: code = NotFound desc = could not find container \"3c645e750df32d999fa351257a00434c376611341116f2585a82f1e99ce0f668\": container with ID starting with 3c645e750df32d999fa351257a00434c376611341116f2585a82f1e99ce0f668 not found: ID does not exist" Jul 21 14:34:10.962582 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.962543 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7dfb5b2b-90f4-445d-a231-09b16bfd3358-trusted-ca\") pod \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " Jul 21 14:34:10.962773 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.962609 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls\") pod \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " Jul 21 14:34:10.962773 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.962630 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hx9w6\" (UniqueName: \"kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-kube-api-access-hx9w6\") pod \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " Jul 21 14:34:10.962773 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.962659 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-bound-sa-token\") pod \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " Jul 21 14:34:10.962773 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.962682 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7dfb5b2b-90f4-445d-a231-09b16bfd3358-ca-trust-extracted\") pod \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " Jul 21 14:34:10.962773 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.962698 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7dfb5b2b-90f4-445d-a231-09b16bfd3358-installation-pull-secrets\") pod \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " Jul 21 14:34:10.962773 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.962723 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-certificates\") pod \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " Jul 21 14:34:10.962773 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.962774 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7dfb5b2b-90f4-445d-a231-09b16bfd3358-image-registry-private-configuration\") pod \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\" (UID: \"7dfb5b2b-90f4-445d-a231-09b16bfd3358\") " Jul 21 14:34:10.963242 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.963172 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dfb5b2b-90f4-445d-a231-09b16bfd3358-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7dfb5b2b-90f4-445d-a231-09b16bfd3358" (UID: "7dfb5b2b-90f4-445d-a231-09b16bfd3358"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:34:10.963351 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.963320 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7dfb5b2b-90f4-445d-a231-09b16bfd3358" (UID: "7dfb5b2b-90f4-445d-a231-09b16bfd3358"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 14:34:10.965821 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.965760 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dfb5b2b-90f4-445d-a231-09b16bfd3358-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7dfb5b2b-90f4-445d-a231-09b16bfd3358" (UID: "7dfb5b2b-90f4-445d-a231-09b16bfd3358"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 14:34:10.965821 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.965769 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-kube-api-access-hx9w6" (OuterVolumeSpecName: "kube-api-access-hx9w6") pod "7dfb5b2b-90f4-445d-a231-09b16bfd3358" (UID: "7dfb5b2b-90f4-445d-a231-09b16bfd3358"). InnerVolumeSpecName "kube-api-access-hx9w6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:34:10.965981 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.965837 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7dfb5b2b-90f4-445d-a231-09b16bfd3358" (UID: "7dfb5b2b-90f4-445d-a231-09b16bfd3358"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:34:10.965981 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.965885 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dfb5b2b-90f4-445d-a231-09b16bfd3358-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7dfb5b2b-90f4-445d-a231-09b16bfd3358" (UID: "7dfb5b2b-90f4-445d-a231-09b16bfd3358"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 21 14:34:10.965981 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.965935 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7dfb5b2b-90f4-445d-a231-09b16bfd3358" (UID: "7dfb5b2b-90f4-445d-a231-09b16bfd3358"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:34:10.971415 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:10.971387 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dfb5b2b-90f4-445d-a231-09b16bfd3358-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7dfb5b2b-90f4-445d-a231-09b16bfd3358" (UID: "7dfb5b2b-90f4-445d-a231-09b16bfd3358"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:34:11.063563 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:11.063473 2559 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7dfb5b2b-90f4-445d-a231-09b16bfd3358-image-registry-private-configuration\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:34:11.063563 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:11.063514 2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7dfb5b2b-90f4-445d-a231-09b16bfd3358-trusted-ca\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:34:11.063563 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:11.063528 2559 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-tls\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:34:11.063563 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:11.063541 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hx9w6\" (UniqueName: \"kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-kube-api-access-hx9w6\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:34:11.063563 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:11.063555 2559 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7dfb5b2b-90f4-445d-a231-09b16bfd3358-bound-sa-token\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:34:11.063563 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:11.063567 2559 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7dfb5b2b-90f4-445d-a231-09b16bfd3358-ca-trust-extracted\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:34:11.063986 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:11.063579 2559 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7dfb5b2b-90f4-445d-a231-09b16bfd3358-installation-pull-secrets\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:34:11.063986 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:11.063591 2559 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7dfb5b2b-90f4-445d-a231-09b16bfd3358-registry-certificates\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:34:11.138754 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:11.138720 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-d7bdd865-vschb"] Jul 21 14:34:11.141994 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:11.141971 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-d7bdd865-vschb"] Jul 21 14:34:12.119578 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:12.119547 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dfb5b2b-90f4-445d-a231-09b16bfd3358" path="/var/lib/kubelet/pods/7dfb5b2b-90f4-445d-a231-09b16bfd3358/volumes" Jul 21 14:34:22.871031 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:22.870998 2559 generic.go:356] "Generic (PLEG): container finished" podID="fbc0f993-9ad3-4e74-9efd-f4697e056f73" containerID="5e11e85c6fb3ef3ad5185995b99044106ba3aed5dfa01423b64b0dfc05529cd7" exitCode=0 Jul 21 14:34:22.871431 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:22.871063 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7ntq" event={"ID":"fbc0f993-9ad3-4e74-9efd-f4697e056f73","Type":"ContainerDied","Data":"5e11e85c6fb3ef3ad5185995b99044106ba3aed5dfa01423b64b0dfc05529cd7"} Jul 21 14:34:22.871431 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:22.871353 2559 scope.go:117] "RemoveContainer" containerID="5e11e85c6fb3ef3ad5185995b99044106ba3aed5dfa01423b64b0dfc05529cd7" Jul 21 14:34:23.876522 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:23.876484 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-h7ntq" event={"ID":"fbc0f993-9ad3-4e74-9efd-f4697e056f73","Type":"ContainerStarted","Data":"b5d5021d938cb5d0740244d4de50833b336b874eecbd76cd92756bb33f961540"} Jul 21 14:34:27.892615 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:27.892529 2559 generic.go:356] "Generic (PLEG): container finished" podID="7993f7cc-616e-4593-a05d-896b58ccce86" containerID="9b019f5a0ebf5c676f3df787edb3876a470a7d76690f317d4b331d19fb553956" exitCode=0 Jul 21 14:34:27.892615 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:27.892574 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fphzx" event={"ID":"7993f7cc-616e-4593-a05d-896b58ccce86","Type":"ContainerDied","Data":"9b019f5a0ebf5c676f3df787edb3876a470a7d76690f317d4b331d19fb553956"} Jul 21 14:34:27.893041 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:27.892865 2559 scope.go:117] "RemoveContainer" containerID="9b019f5a0ebf5c676f3df787edb3876a470a7d76690f317d4b331d19fb553956" Jul 21 14:34:28.897663 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:34:28.897632 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-fphzx" event={"ID":"7993f7cc-616e-4593-a05d-896b58ccce86","Type":"ContainerStarted","Data":"6ba66bf85ade1c0a88f95e6399843908e22c95282cde8f851b9396ba4b8093ba"} Jul 21 14:36:24.680465 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:24.680425 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598"] Jul 21 14:36:24.680989 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:24.680736 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dfb5b2b-90f4-445d-a231-09b16bfd3358" containerName="registry" Jul 21 14:36:24.680989 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:24.680749 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dfb5b2b-90f4-445d-a231-09b16bfd3358" containerName="registry" Jul 21 14:36:24.680989 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:24.680839 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dfb5b2b-90f4-445d-a231-09b16bfd3358" containerName="registry" Jul 21 14:36:24.683992 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:24.683976 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598" Jul 21 14:36:24.686501 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:24.686480 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 21 14:36:24.686686 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:24.686672 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rltjg\"" Jul 21 14:36:24.687621 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:24.687605 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 21 14:36:24.692625 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:24.692606 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598"] Jul 21 14:36:24.800602 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:24.800556 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ede6438-e071-4ab5-8a7b-203f3a2741c3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598\" (UID: \"5ede6438-e071-4ab5-8a7b-203f3a2741c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598" Jul 21 14:36:24.800775 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:24.800626 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ede6438-e071-4ab5-8a7b-203f3a2741c3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598\" (UID: \"5ede6438-e071-4ab5-8a7b-203f3a2741c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598" Jul 21 14:36:24.800775 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:24.800669 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlc9m\" (UniqueName: \"kubernetes.io/projected/5ede6438-e071-4ab5-8a7b-203f3a2741c3-kube-api-access-zlc9m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598\" (UID: \"5ede6438-e071-4ab5-8a7b-203f3a2741c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598" Jul 21 14:36:24.901999 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:24.901962 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ede6438-e071-4ab5-8a7b-203f3a2741c3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598\" (UID: \"5ede6438-e071-4ab5-8a7b-203f3a2741c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598" Jul 21 14:36:24.902147 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:24.902023 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ede6438-e071-4ab5-8a7b-203f3a2741c3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598\" (UID: \"5ede6438-e071-4ab5-8a7b-203f3a2741c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598" Jul 21 14:36:24.902202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:24.902135 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlc9m\" (UniqueName: \"kubernetes.io/projected/5ede6438-e071-4ab5-8a7b-203f3a2741c3-kube-api-access-zlc9m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598\" (UID: \"5ede6438-e071-4ab5-8a7b-203f3a2741c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598" Jul 21 14:36:24.902338 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:24.902322 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ede6438-e071-4ab5-8a7b-203f3a2741c3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598\" (UID: \"5ede6438-e071-4ab5-8a7b-203f3a2741c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598" Jul 21 14:36:24.902405 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:24.902386 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ede6438-e071-4ab5-8a7b-203f3a2741c3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598\" (UID: \"5ede6438-e071-4ab5-8a7b-203f3a2741c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598" Jul 21 14:36:24.911317 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:24.911295 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlc9m\" (UniqueName: \"kubernetes.io/projected/5ede6438-e071-4ab5-8a7b-203f3a2741c3-kube-api-access-zlc9m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598\" (UID: \"5ede6438-e071-4ab5-8a7b-203f3a2741c3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598" Jul 21 14:36:24.992695 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:24.992664 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598" Jul 21 14:36:25.122579 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:25.122546 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598"] Jul 21 14:36:25.126009 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:36:25.125983 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ede6438_e071_4ab5_8a7b_203f3a2741c3.slice/crio-43cff65e438a700b1edce61eba97d77b0e6b5ec5f92373865084a6a4a510c056 WatchSource:0}: Error finding container 43cff65e438a700b1edce61eba97d77b0e6b5ec5f92373865084a6a4a510c056: Status 404 returned error can't find the container with id 43cff65e438a700b1edce61eba97d77b0e6b5ec5f92373865084a6a4a510c056 Jul 21 14:36:25.318138 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:25.318052 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598" event={"ID":"5ede6438-e071-4ab5-8a7b-203f3a2741c3","Type":"ContainerStarted","Data":"43cff65e438a700b1edce61eba97d77b0e6b5ec5f92373865084a6a4a510c056"} Jul 21 14:36:32.349536 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:32.349456 2559 generic.go:356] "Generic (PLEG): container finished" podID="5ede6438-e071-4ab5-8a7b-203f3a2741c3" containerID="7eed7ff33de24f418a56044cfbd6bc29f0c936805640b9d78ec158639cc10bb1" exitCode=0 Jul 21 14:36:32.349536 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:32.349532 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598" event={"ID":"5ede6438-e071-4ab5-8a7b-203f3a2741c3","Type":"ContainerDied","Data":"7eed7ff33de24f418a56044cfbd6bc29f0c936805640b9d78ec158639cc10bb1"} Jul 21 14:36:35.363402 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:35.363363 2559 generic.go:356] "Generic (PLEG): container finished" podID="5ede6438-e071-4ab5-8a7b-203f3a2741c3" containerID="b46f34b65675dc29b154194404fc2ee006b14ed84c1cec424d7728c90045697b" exitCode=0 Jul 21 14:36:35.363867 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:35.363443 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598" event={"ID":"5ede6438-e071-4ab5-8a7b-203f3a2741c3","Type":"ContainerDied","Data":"b46f34b65675dc29b154194404fc2ee006b14ed84c1cec424d7728c90045697b"} Jul 21 14:36:43.399179 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:43.399140 2559 generic.go:356] "Generic (PLEG): container finished" podID="5ede6438-e071-4ab5-8a7b-203f3a2741c3" containerID="bab0c20baf0686a58d11a79935b35e4b1dc1fb61ed6e763eda5a94439f77e355" exitCode=0 Jul 21 14:36:43.399553 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:43.399217 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598" event={"ID":"5ede6438-e071-4ab5-8a7b-203f3a2741c3","Type":"ContainerDied","Data":"bab0c20baf0686a58d11a79935b35e4b1dc1fb61ed6e763eda5a94439f77e355"} Jul 21 14:36:44.530761 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:44.530735 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598" Jul 21 14:36:44.672976 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:44.672889 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ede6438-e071-4ab5-8a7b-203f3a2741c3-util\") pod \"5ede6438-e071-4ab5-8a7b-203f3a2741c3\" (UID: \"5ede6438-e071-4ab5-8a7b-203f3a2741c3\") " Jul 21 14:36:44.672976 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:44.672940 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlc9m\" (UniqueName: \"kubernetes.io/projected/5ede6438-e071-4ab5-8a7b-203f3a2741c3-kube-api-access-zlc9m\") pod \"5ede6438-e071-4ab5-8a7b-203f3a2741c3\" (UID: \"5ede6438-e071-4ab5-8a7b-203f3a2741c3\") " Jul 21 14:36:44.673168 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:44.672978 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ede6438-e071-4ab5-8a7b-203f3a2741c3-bundle\") pod \"5ede6438-e071-4ab5-8a7b-203f3a2741c3\" (UID: \"5ede6438-e071-4ab5-8a7b-203f3a2741c3\") " Jul 21 14:36:44.673660 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:44.673628 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ede6438-e071-4ab5-8a7b-203f3a2741c3-bundle" (OuterVolumeSpecName: "bundle") pod "5ede6438-e071-4ab5-8a7b-203f3a2741c3" (UID: "5ede6438-e071-4ab5-8a7b-203f3a2741c3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:36:44.675195 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:44.675171 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ede6438-e071-4ab5-8a7b-203f3a2741c3-kube-api-access-zlc9m" (OuterVolumeSpecName: "kube-api-access-zlc9m") pod "5ede6438-e071-4ab5-8a7b-203f3a2741c3" (UID: "5ede6438-e071-4ab5-8a7b-203f3a2741c3"). InnerVolumeSpecName "kube-api-access-zlc9m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:36:44.677076 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:44.677052 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ede6438-e071-4ab5-8a7b-203f3a2741c3-util" (OuterVolumeSpecName: "util") pod "5ede6438-e071-4ab5-8a7b-203f3a2741c3" (UID: "5ede6438-e071-4ab5-8a7b-203f3a2741c3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:36:44.774009 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:44.773974 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ede6438-e071-4ab5-8a7b-203f3a2741c3-bundle\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:36:44.774009 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:44.774004 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ede6438-e071-4ab5-8a7b-203f3a2741c3-util\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:36:44.774009 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:44.774013 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlc9m\" (UniqueName: \"kubernetes.io/projected/5ede6438-e071-4ab5-8a7b-203f3a2741c3-kube-api-access-zlc9m\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:36:45.408974 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:45.408948 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598" Jul 21 14:36:45.409118 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:45.408948 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540lf598" event={"ID":"5ede6438-e071-4ab5-8a7b-203f3a2741c3","Type":"ContainerDied","Data":"43cff65e438a700b1edce61eba97d77b0e6b5ec5f92373865084a6a4a510c056"} Jul 21 14:36:45.409118 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:45.409069 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43cff65e438a700b1edce61eba97d77b0e6b5ec5f92373865084a6a4a510c056" Jul 21 14:36:57.851858 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:57.851814 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf"] Jul 21 14:36:57.852262 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:57.852172 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ede6438-e071-4ab5-8a7b-203f3a2741c3" containerName="util" Jul 21 14:36:57.852262 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:57.852184 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ede6438-e071-4ab5-8a7b-203f3a2741c3" containerName="util" Jul 21 14:36:57.852262 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:57.852194 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ede6438-e071-4ab5-8a7b-203f3a2741c3" containerName="pull" Jul 21 14:36:57.852262 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:57.852201 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ede6438-e071-4ab5-8a7b-203f3a2741c3" containerName="pull" Jul 21 14:36:57.852262 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:57.852214 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ede6438-e071-4ab5-8a7b-203f3a2741c3" containerName="extract" Jul 21 14:36:57.852262 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:57.852223 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ede6438-e071-4ab5-8a7b-203f3a2741c3" containerName="extract" Jul 21 14:36:57.852445 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:57.852280 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ede6438-e071-4ab5-8a7b-203f3a2741c3" containerName="extract" Jul 21 14:36:57.855562 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:57.855545 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf" Jul 21 14:36:57.861733 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:57.861472 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 21 14:36:57.861733 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:57.861490 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rltjg\"" Jul 21 14:36:57.867364 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:57.862454 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 21 14:36:57.877715 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:57.877690 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf"] Jul 21 14:36:57.975628 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:57.975591 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/184a0152-494a-42bb-9b56-6c4c7f38536f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf\" (UID: \"184a0152-494a-42bb-9b56-6c4c7f38536f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf" Jul 21 14:36:57.975830 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:57.975632 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmfnp\" (UniqueName: \"kubernetes.io/projected/184a0152-494a-42bb-9b56-6c4c7f38536f-kube-api-access-zmfnp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf\" (UID: \"184a0152-494a-42bb-9b56-6c4c7f38536f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf" Jul 21 14:36:57.975830 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:57.975723 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/184a0152-494a-42bb-9b56-6c4c7f38536f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf\" (UID: \"184a0152-494a-42bb-9b56-6c4c7f38536f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf" Jul 21 14:36:58.077056 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:58.077016 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/184a0152-494a-42bb-9b56-6c4c7f38536f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf\" (UID: \"184a0152-494a-42bb-9b56-6c4c7f38536f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf" Jul 21 14:36:58.077255 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:58.077085 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/184a0152-494a-42bb-9b56-6c4c7f38536f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf\" (UID: \"184a0152-494a-42bb-9b56-6c4c7f38536f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf" Jul 21 14:36:58.077255 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:58.077183 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmfnp\" (UniqueName: \"kubernetes.io/projected/184a0152-494a-42bb-9b56-6c4c7f38536f-kube-api-access-zmfnp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf\" (UID: \"184a0152-494a-42bb-9b56-6c4c7f38536f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf" Jul 21 14:36:58.077467 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:58.077448 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/184a0152-494a-42bb-9b56-6c4c7f38536f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf\" (UID: \"184a0152-494a-42bb-9b56-6c4c7f38536f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf" Jul 21 14:36:58.077548 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:58.077482 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/184a0152-494a-42bb-9b56-6c4c7f38536f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf\" (UID: \"184a0152-494a-42bb-9b56-6c4c7f38536f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf" Jul 21 14:36:58.086501 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:58.086475 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmfnp\" (UniqueName: \"kubernetes.io/projected/184a0152-494a-42bb-9b56-6c4c7f38536f-kube-api-access-zmfnp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf\" (UID: \"184a0152-494a-42bb-9b56-6c4c7f38536f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf" Jul 21 14:36:58.165486 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:58.165375 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf" Jul 21 14:36:58.299920 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:58.299893 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf"] Jul 21 14:36:58.302320 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:36:58.302290 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod184a0152_494a_42bb_9b56_6c4c7f38536f.slice/crio-68b2b397fb110b3948f0bd70d2680bb46835e4e8b55251861528adaaf5d803ab WatchSource:0}: Error finding container 68b2b397fb110b3948f0bd70d2680bb46835e4e8b55251861528adaaf5d803ab: Status 404 returned error can't find the container with id 68b2b397fb110b3948f0bd70d2680bb46835e4e8b55251861528adaaf5d803ab Jul 21 14:36:58.460190 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:58.460155 2559 generic.go:356] "Generic (PLEG): container finished" podID="184a0152-494a-42bb-9b56-6c4c7f38536f" containerID="79ecc7ca6b37ac2767753f23a43a2d7634de846fbbb0e2e7787c9e11b928e16d" exitCode=0 Jul 21 14:36:58.460348 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:58.460245 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf" event={"ID":"184a0152-494a-42bb-9b56-6c4c7f38536f","Type":"ContainerDied","Data":"79ecc7ca6b37ac2767753f23a43a2d7634de846fbbb0e2e7787c9e11b928e16d"} Jul 21 14:36:58.460348 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:36:58.460292 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf" event={"ID":"184a0152-494a-42bb-9b56-6c4c7f38536f","Type":"ContainerStarted","Data":"68b2b397fb110b3948f0bd70d2680bb46835e4e8b55251861528adaaf5d803ab"} Jul 21 14:37:01.474195 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:01.474159 2559 generic.go:356] "Generic (PLEG): container finished" podID="184a0152-494a-42bb-9b56-6c4c7f38536f" containerID="4b89ad4d18a8b3c37bcde93ccb0af40dac46f80d0cb6de9ff073ba3f751ab7bc" exitCode=0 Jul 21 14:37:01.474611 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:01.474246 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf" event={"ID":"184a0152-494a-42bb-9b56-6c4c7f38536f","Type":"ContainerDied","Data":"4b89ad4d18a8b3c37bcde93ccb0af40dac46f80d0cb6de9ff073ba3f751ab7bc"} Jul 21 14:37:02.479935 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:02.479904 2559 generic.go:356] "Generic (PLEG): container finished" podID="184a0152-494a-42bb-9b56-6c4c7f38536f" containerID="32946dca16a4f5ca31f57d8cdaa112a96de1b88395506b826910945e5c706b89" exitCode=0 Jul 21 14:37:02.480328 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:02.479956 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf" event={"ID":"184a0152-494a-42bb-9b56-6c4c7f38536f","Type":"ContainerDied","Data":"32946dca16a4f5ca31f57d8cdaa112a96de1b88395506b826910945e5c706b89"} Jul 21 14:37:03.630315 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:03.630286 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf" Jul 21 14:37:03.725182 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:03.725149 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/184a0152-494a-42bb-9b56-6c4c7f38536f-util\") pod \"184a0152-494a-42bb-9b56-6c4c7f38536f\" (UID: \"184a0152-494a-42bb-9b56-6c4c7f38536f\") " Jul 21 14:37:03.725182 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:03.725182 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmfnp\" (UniqueName: \"kubernetes.io/projected/184a0152-494a-42bb-9b56-6c4c7f38536f-kube-api-access-zmfnp\") pod \"184a0152-494a-42bb-9b56-6c4c7f38536f\" (UID: \"184a0152-494a-42bb-9b56-6c4c7f38536f\") " Jul 21 14:37:03.725386 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:03.725243 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/184a0152-494a-42bb-9b56-6c4c7f38536f-bundle\") pod \"184a0152-494a-42bb-9b56-6c4c7f38536f\" (UID: \"184a0152-494a-42bb-9b56-6c4c7f38536f\") " Jul 21 14:37:03.725695 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:03.725661 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/184a0152-494a-42bb-9b56-6c4c7f38536f-bundle" (OuterVolumeSpecName: "bundle") pod "184a0152-494a-42bb-9b56-6c4c7f38536f" (UID: "184a0152-494a-42bb-9b56-6c4c7f38536f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:37:03.727296 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:03.727273 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/184a0152-494a-42bb-9b56-6c4c7f38536f-kube-api-access-zmfnp" (OuterVolumeSpecName: "kube-api-access-zmfnp") pod "184a0152-494a-42bb-9b56-6c4c7f38536f" (UID: "184a0152-494a-42bb-9b56-6c4c7f38536f"). InnerVolumeSpecName "kube-api-access-zmfnp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:37:03.826367 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:03.826283 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/184a0152-494a-42bb-9b56-6c4c7f38536f-bundle\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:37:03.826367 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:03.826314 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmfnp\" (UniqueName: \"kubernetes.io/projected/184a0152-494a-42bb-9b56-6c4c7f38536f-kube-api-access-zmfnp\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:37:04.171517 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:04.171434 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/184a0152-494a-42bb-9b56-6c4c7f38536f-util" (OuterVolumeSpecName: "util") pod "184a0152-494a-42bb-9b56-6c4c7f38536f" (UID: "184a0152-494a-42bb-9b56-6c4c7f38536f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:37:04.229693 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:04.229652 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/184a0152-494a-42bb-9b56-6c4c7f38536f-util\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:37:04.489176 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:04.489141 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf" event={"ID":"184a0152-494a-42bb-9b56-6c4c7f38536f","Type":"ContainerDied","Data":"68b2b397fb110b3948f0bd70d2680bb46835e4e8b55251861528adaaf5d803ab"} Jul 21 14:37:04.489176 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:04.489175 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp9lnf" Jul 21 14:37:04.489176 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:04.489185 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="68b2b397fb110b3948f0bd70d2680bb46835e4e8b55251861528adaaf5d803ab" Jul 21 14:37:05.524823 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:05.524775 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4t2rw"] Jul 21 14:37:05.525201 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:05.525074 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="184a0152-494a-42bb-9b56-6c4c7f38536f" containerName="pull" Jul 21 14:37:05.525201 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:05.525084 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="184a0152-494a-42bb-9b56-6c4c7f38536f" containerName="pull" Jul 21 14:37:05.525201 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:05.525099 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="184a0152-494a-42bb-9b56-6c4c7f38536f" containerName="util" Jul 21 14:37:05.525201 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:05.525105 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="184a0152-494a-42bb-9b56-6c4c7f38536f" containerName="util" Jul 21 14:37:05.525201 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:05.525112 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="184a0152-494a-42bb-9b56-6c4c7f38536f" containerName="extract" Jul 21 14:37:05.525201 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:05.525117 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="184a0152-494a-42bb-9b56-6c4c7f38536f" containerName="extract" Jul 21 14:37:05.525201 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:05.525167 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="184a0152-494a-42bb-9b56-6c4c7f38536f" containerName="extract" Jul 21 14:37:05.529029 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:05.529011 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4t2rw" Jul 21 14:37:05.531561 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:05.531537 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 21 14:37:05.531701 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:05.531683 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 21 14:37:05.532407 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:05.532391 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-2nhzj\"" Jul 21 14:37:05.536755 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:05.536729 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4t2rw"] Jul 21 14:37:05.641164 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:05.641123 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llqt5\" (UniqueName: \"kubernetes.io/projected/ab8a9c2e-ce38-40c9-afdd-84950cf99ad6-kube-api-access-llqt5\") pod \"cert-manager-webhook-6486ffd997-4t2rw\" (UID: \"ab8a9c2e-ce38-40c9-afdd-84950cf99ad6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4t2rw" Jul 21 14:37:05.641348 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:05.641185 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab8a9c2e-ce38-40c9-afdd-84950cf99ad6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4t2rw\" (UID: \"ab8a9c2e-ce38-40c9-afdd-84950cf99ad6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4t2rw" Jul 21 14:37:05.742395 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:05.742359 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llqt5\" (UniqueName: \"kubernetes.io/projected/ab8a9c2e-ce38-40c9-afdd-84950cf99ad6-kube-api-access-llqt5\") pod \"cert-manager-webhook-6486ffd997-4t2rw\" (UID: \"ab8a9c2e-ce38-40c9-afdd-84950cf99ad6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4t2rw" Jul 21 14:37:05.742532 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:05.742413 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab8a9c2e-ce38-40c9-afdd-84950cf99ad6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4t2rw\" (UID: \"ab8a9c2e-ce38-40c9-afdd-84950cf99ad6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4t2rw" Jul 21 14:37:05.751728 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:05.751693 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab8a9c2e-ce38-40c9-afdd-84950cf99ad6-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4t2rw\" (UID: \"ab8a9c2e-ce38-40c9-afdd-84950cf99ad6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4t2rw" Jul 21 14:37:05.751908 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:05.751884 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llqt5\" (UniqueName: \"kubernetes.io/projected/ab8a9c2e-ce38-40c9-afdd-84950cf99ad6-kube-api-access-llqt5\") pod \"cert-manager-webhook-6486ffd997-4t2rw\" (UID: \"ab8a9c2e-ce38-40c9-afdd-84950cf99ad6\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4t2rw" Jul 21 14:37:05.838696 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:05.838601 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4t2rw" Jul 21 14:37:05.964221 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:05.964196 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4t2rw"] Jul 21 14:37:05.966786 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:37:05.966754 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab8a9c2e_ce38_40c9_afdd_84950cf99ad6.slice/crio-a0f2936bb9196f437ba9c4dfea8f844d3b9b614ed770ec70717e2b89b6cfa098 WatchSource:0}: Error finding container a0f2936bb9196f437ba9c4dfea8f844d3b9b614ed770ec70717e2b89b6cfa098: Status 404 returned error can't find the container with id a0f2936bb9196f437ba9c4dfea8f844d3b9b614ed770ec70717e2b89b6cfa098 Jul 21 14:37:06.497875 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:06.497841 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4t2rw" event={"ID":"ab8a9c2e-ce38-40c9-afdd-84950cf99ad6","Type":"ContainerStarted","Data":"a0f2936bb9196f437ba9c4dfea8f844d3b9b614ed770ec70717e2b89b6cfa098"} Jul 21 14:37:09.512169 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:09.512130 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4t2rw" event={"ID":"ab8a9c2e-ce38-40c9-afdd-84950cf99ad6","Type":"ContainerStarted","Data":"4ec49333250b8ae9bebd30b71dcc36a4b80771b408b766d1634b918ff08c8e25"} Jul 21 14:37:09.512558 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:09.512256 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4t2rw" Jul 21 14:37:09.528126 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:09.528057 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-4t2rw" podStartSLOduration=1.9303010280000001 podStartE2EDuration="4.528037754s" totalImagesPullingTime="2.597736726s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:37:09.527675916 +0000 UTC m=+299.926821090" watchObservedRunningTime="2026-07-21 14:37:09.528037754 +0000 UTC m=+299.927182934" Jul 21 14:37:10.021459 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:10.021422 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 14:37:10.024492 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:10.024463 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 14:37:10.031867 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:10.031843 2559 kubelet.go:1648] "Image garbage collection succeeded" Jul 21 14:37:11.560423 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:11.560384 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q7btw"] Jul 21 14:37:11.563718 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:11.563700 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q7btw" Jul 21 14:37:11.566027 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:11.566007 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-bjh4w\"" Jul 21 14:37:11.566897 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:11.566884 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 21 14:37:11.566980 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:11.566896 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 21 14:37:11.578253 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:11.578223 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q7btw"] Jul 21 14:37:11.587056 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:11.587027 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxwhk\" (UniqueName: \"kubernetes.io/projected/4b64bb3a-b75e-4ca8-a8fa-bc26e6515f68-kube-api-access-gxwhk\") pod \"openshift-lws-operator-fd8ccff4c-q7btw\" (UID: \"4b64bb3a-b75e-4ca8-a8fa-bc26e6515f68\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q7btw" Jul 21 14:37:11.587209 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:11.587092 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b64bb3a-b75e-4ca8-a8fa-bc26e6515f68-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q7btw\" (UID: \"4b64bb3a-b75e-4ca8-a8fa-bc26e6515f68\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q7btw" Jul 21 14:37:11.687577 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:11.687534 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b64bb3a-b75e-4ca8-a8fa-bc26e6515f68-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q7btw\" (UID: \"4b64bb3a-b75e-4ca8-a8fa-bc26e6515f68\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q7btw" Jul 21 14:37:11.687760 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:11.687614 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxwhk\" (UniqueName: \"kubernetes.io/projected/4b64bb3a-b75e-4ca8-a8fa-bc26e6515f68-kube-api-access-gxwhk\") pod \"openshift-lws-operator-fd8ccff4c-q7btw\" (UID: \"4b64bb3a-b75e-4ca8-a8fa-bc26e6515f68\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q7btw" Jul 21 14:37:11.687964 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:11.687945 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b64bb3a-b75e-4ca8-a8fa-bc26e6515f68-tmp\") pod \"openshift-lws-operator-fd8ccff4c-q7btw\" (UID: \"4b64bb3a-b75e-4ca8-a8fa-bc26e6515f68\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q7btw" Jul 21 14:37:11.695571 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:11.695552 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxwhk\" (UniqueName: \"kubernetes.io/projected/4b64bb3a-b75e-4ca8-a8fa-bc26e6515f68-kube-api-access-gxwhk\") pod \"openshift-lws-operator-fd8ccff4c-q7btw\" (UID: \"4b64bb3a-b75e-4ca8-a8fa-bc26e6515f68\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q7btw" Jul 21 14:37:11.872782 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:11.872688 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q7btw" Jul 21 14:37:12.000269 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:12.000246 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q7btw"] Jul 21 14:37:12.002755 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:37:12.002725 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b64bb3a_b75e_4ca8_a8fa_bc26e6515f68.slice/crio-2cbe7926e65ce0b4cb48402f78c7dd3c1d60b632a27c7d5326750b5693c6a681 WatchSource:0}: Error finding container 2cbe7926e65ce0b4cb48402f78c7dd3c1d60b632a27c7d5326750b5693c6a681: Status 404 returned error can't find the container with id 2cbe7926e65ce0b4cb48402f78c7dd3c1d60b632a27c7d5326750b5693c6a681 Jul 21 14:37:12.004536 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:12.004514 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 14:37:12.525119 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:12.525087 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q7btw" event={"ID":"4b64bb3a-b75e-4ca8-a8fa-bc26e6515f68","Type":"ContainerStarted","Data":"2cbe7926e65ce0b4cb48402f78c7dd3c1d60b632a27c7d5326750b5693c6a681"} Jul 21 14:37:14.535964 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:14.535932 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q7btw" event={"ID":"4b64bb3a-b75e-4ca8-a8fa-bc26e6515f68","Type":"ContainerStarted","Data":"f7017c627a4c40a4b3ca9c9e77dacfe9f74fa0b461d582346a29053b30dee9c2"} Jul 21 14:37:14.551816 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:14.551745 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-q7btw" podStartSLOduration=1.492758341 podStartE2EDuration="3.551726848s" totalImagesPullingTime="2.058968507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:37:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:37:14.550631612 +0000 UTC m=+304.949776792" watchObservedRunningTime="2026-07-21 14:37:14.551726848 +0000 UTC m=+304.950872028" Jul 21 14:37:15.519473 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:15.519435 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4t2rw" Jul 21 14:37:17.045230 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:17.045193 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh"] Jul 21 14:37:17.067597 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:17.067552 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh"] Jul 21 14:37:17.067773 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:17.067652 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh" Jul 21 14:37:17.070664 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:17.070643 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 21 14:37:17.071820 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:17.071786 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 21 14:37:17.071820 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:17.071813 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rltjg\"" Jul 21 14:37:17.125196 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:17.125158 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a131c00c-a745-41fc-9831-ebabc3833961-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh\" (UID: \"a131c00c-a745-41fc-9831-ebabc3833961\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh" Jul 21 14:37:17.125400 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:17.125214 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwkll\" (UniqueName: \"kubernetes.io/projected/a131c00c-a745-41fc-9831-ebabc3833961-kube-api-access-nwkll\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh\" (UID: \"a131c00c-a745-41fc-9831-ebabc3833961\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh" Jul 21 14:37:17.125400 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:17.125324 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a131c00c-a745-41fc-9831-ebabc3833961-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh\" (UID: \"a131c00c-a745-41fc-9831-ebabc3833961\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh" Jul 21 14:37:17.225765 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:17.225722 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a131c00c-a745-41fc-9831-ebabc3833961-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh\" (UID: \"a131c00c-a745-41fc-9831-ebabc3833961\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh" Jul 21 14:37:17.225980 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:17.225777 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwkll\" (UniqueName: \"kubernetes.io/projected/a131c00c-a745-41fc-9831-ebabc3833961-kube-api-access-nwkll\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh\" (UID: \"a131c00c-a745-41fc-9831-ebabc3833961\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh" Jul 21 14:37:17.225980 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:17.225830 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a131c00c-a745-41fc-9831-ebabc3833961-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh\" (UID: \"a131c00c-a745-41fc-9831-ebabc3833961\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh" Jul 21 14:37:17.226152 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:17.226129 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a131c00c-a745-41fc-9831-ebabc3833961-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh\" (UID: \"a131c00c-a745-41fc-9831-ebabc3833961\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh" Jul 21 14:37:17.226222 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:17.226198 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a131c00c-a745-41fc-9831-ebabc3833961-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh\" (UID: \"a131c00c-a745-41fc-9831-ebabc3833961\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh" Jul 21 14:37:17.234675 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:17.234653 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwkll\" (UniqueName: \"kubernetes.io/projected/a131c00c-a745-41fc-9831-ebabc3833961-kube-api-access-nwkll\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh\" (UID: \"a131c00c-a745-41fc-9831-ebabc3833961\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh" Jul 21 14:37:17.377048 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:17.376958 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh" Jul 21 14:37:17.525049 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:17.524925 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh"] Jul 21 14:37:17.527308 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:37:17.527285 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda131c00c_a745_41fc_9831_ebabc3833961.slice/crio-8eee82c1002d0c697b975b2e4979cde2616390c577650d4e33f5fc01be5518e2 WatchSource:0}: Error finding container 8eee82c1002d0c697b975b2e4979cde2616390c577650d4e33f5fc01be5518e2: Status 404 returned error can't find the container with id 8eee82c1002d0c697b975b2e4979cde2616390c577650d4e33f5fc01be5518e2 Jul 21 14:37:17.550278 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:17.550244 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh" event={"ID":"a131c00c-a745-41fc-9831-ebabc3833961","Type":"ContainerStarted","Data":"8eee82c1002d0c697b975b2e4979cde2616390c577650d4e33f5fc01be5518e2"} Jul 21 14:37:18.556660 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:18.556569 2559 generic.go:356] "Generic (PLEG): container finished" podID="a131c00c-a745-41fc-9831-ebabc3833961" containerID="e4428ea4e7e00d5470787fc8bdc1f7468e8f7bd2f3163627e569cd66d69851dd" exitCode=0 Jul 21 14:37:18.557076 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:18.556659 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh" event={"ID":"a131c00c-a745-41fc-9831-ebabc3833961","Type":"ContainerDied","Data":"e4428ea4e7e00d5470787fc8bdc1f7468e8f7bd2f3163627e569cd66d69851dd"} Jul 21 14:37:21.571704 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:21.571672 2559 generic.go:356] "Generic (PLEG): container finished" podID="a131c00c-a745-41fc-9831-ebabc3833961" containerID="c8d2cb032941fbf59561b160829f59d33ac8c4f8ac2d6cc44ffabb141a8cbd05" exitCode=0 Jul 21 14:37:21.572132 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:21.571722 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh" event={"ID":"a131c00c-a745-41fc-9831-ebabc3833961","Type":"ContainerDied","Data":"c8d2cb032941fbf59561b160829f59d33ac8c4f8ac2d6cc44ffabb141a8cbd05"} Jul 21 14:37:22.577910 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:22.577876 2559 generic.go:356] "Generic (PLEG): container finished" podID="a131c00c-a745-41fc-9831-ebabc3833961" containerID="2239b654aaf9241910e72f01455567153e8ec6eb2d16907ae26ee9989d058730" exitCode=0 Jul 21 14:37:22.577910 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:22.577915 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh" event={"ID":"a131c00c-a745-41fc-9831-ebabc3833961","Type":"ContainerDied","Data":"2239b654aaf9241910e72f01455567153e8ec6eb2d16907ae26ee9989d058730"} Jul 21 14:37:23.712186 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:23.712157 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh" Jul 21 14:37:23.774013 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:23.773984 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a131c00c-a745-41fc-9831-ebabc3833961-bundle\") pod \"a131c00c-a745-41fc-9831-ebabc3833961\" (UID: \"a131c00c-a745-41fc-9831-ebabc3833961\") " Jul 21 14:37:23.774200 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:23.774060 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwkll\" (UniqueName: \"kubernetes.io/projected/a131c00c-a745-41fc-9831-ebabc3833961-kube-api-access-nwkll\") pod \"a131c00c-a745-41fc-9831-ebabc3833961\" (UID: \"a131c00c-a745-41fc-9831-ebabc3833961\") " Jul 21 14:37:23.774200 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:23.774115 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a131c00c-a745-41fc-9831-ebabc3833961-util\") pod \"a131c00c-a745-41fc-9831-ebabc3833961\" (UID: \"a131c00c-a745-41fc-9831-ebabc3833961\") " Jul 21 14:37:23.774684 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:23.774653 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a131c00c-a745-41fc-9831-ebabc3833961-bundle" (OuterVolumeSpecName: "bundle") pod "a131c00c-a745-41fc-9831-ebabc3833961" (UID: "a131c00c-a745-41fc-9831-ebabc3833961"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:37:23.776120 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:23.776086 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a131c00c-a745-41fc-9831-ebabc3833961-kube-api-access-nwkll" (OuterVolumeSpecName: "kube-api-access-nwkll") pod "a131c00c-a745-41fc-9831-ebabc3833961" (UID: "a131c00c-a745-41fc-9831-ebabc3833961"). InnerVolumeSpecName "kube-api-access-nwkll". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:37:23.778754 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:23.778728 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a131c00c-a745-41fc-9831-ebabc3833961-util" (OuterVolumeSpecName: "util") pod "a131c00c-a745-41fc-9831-ebabc3833961" (UID: "a131c00c-a745-41fc-9831-ebabc3833961"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:37:23.875075 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:23.874987 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwkll\" (UniqueName: \"kubernetes.io/projected/a131c00c-a745-41fc-9831-ebabc3833961-kube-api-access-nwkll\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:37:23.875075 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:23.875020 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a131c00c-a745-41fc-9831-ebabc3833961-util\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:37:23.875075 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:23.875036 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a131c00c-a745-41fc-9831-ebabc3833961-bundle\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:37:24.590057 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:24.590019 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh" event={"ID":"a131c00c-a745-41fc-9831-ebabc3833961","Type":"ContainerDied","Data":"8eee82c1002d0c697b975b2e4979cde2616390c577650d4e33f5fc01be5518e2"} Jul 21 14:37:24.590231 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:24.590075 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8eee82c1002d0c697b975b2e4979cde2616390c577650d4e33f5fc01be5518e2" Jul 21 14:37:24.590231 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:24.590079 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afblgmh" Jul 21 14:37:36.256610 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.256577 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t"] Jul 21 14:37:36.257128 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.256904 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a131c00c-a745-41fc-9831-ebabc3833961" containerName="pull" Jul 21 14:37:36.257128 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.256916 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a131c00c-a745-41fc-9831-ebabc3833961" containerName="pull" Jul 21 14:37:36.257128 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.256930 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a131c00c-a745-41fc-9831-ebabc3833961" containerName="util" Jul 21 14:37:36.257128 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.256935 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a131c00c-a745-41fc-9831-ebabc3833961" containerName="util" Jul 21 14:37:36.257128 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.256945 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a131c00c-a745-41fc-9831-ebabc3833961" containerName="extract" Jul 21 14:37:36.257128 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.256950 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a131c00c-a745-41fc-9831-ebabc3833961" containerName="extract" Jul 21 14:37:36.257128 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.257015 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a131c00c-a745-41fc-9831-ebabc3833961" containerName="extract" Jul 21 14:37:36.264562 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.264532 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" Jul 21 14:37:36.268657 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.268632 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2tzgd\"" Jul 21 14:37:36.268830 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.268727 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 21 14:37:36.268830 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.268749 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 21 14:37:36.268830 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.268772 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 21 14:37:36.269055 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.269027 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 21 14:37:36.285524 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.285497 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t"] Jul 21 14:37:36.369312 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.369269 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2f2dd5e8-d872-4c26-bdb2-6d879f1da786-manifests\") pod \"opendatahub-operator-controller-manager-b978d8c-vds4t\" (UID: \"2f2dd5e8-d872-4c26-bdb2-6d879f1da786\") " pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" Jul 21 14:37:36.369312 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.369316 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2f2dd5e8-d872-4c26-bdb2-6d879f1da786-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b978d8c-vds4t\" (UID: \"2f2dd5e8-d872-4c26-bdb2-6d879f1da786\") " pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" Jul 21 14:37:36.369582 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.369352 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k7tz\" (UniqueName: \"kubernetes.io/projected/2f2dd5e8-d872-4c26-bdb2-6d879f1da786-kube-api-access-5k7tz\") pod \"opendatahub-operator-controller-manager-b978d8c-vds4t\" (UID: \"2f2dd5e8-d872-4c26-bdb2-6d879f1da786\") " pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" Jul 21 14:37:36.369582 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.369383 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f2dd5e8-d872-4c26-bdb2-6d879f1da786-webhook-cert\") pod \"opendatahub-operator-controller-manager-b978d8c-vds4t\" (UID: \"2f2dd5e8-d872-4c26-bdb2-6d879f1da786\") " pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" Jul 21 14:37:36.369582 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.369444 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f2dd5e8-d872-4c26-bdb2-6d879f1da786-tmp\") pod \"opendatahub-operator-controller-manager-b978d8c-vds4t\" (UID: \"2f2dd5e8-d872-4c26-bdb2-6d879f1da786\") " pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" Jul 21 14:37:36.470710 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.470667 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2f2dd5e8-d872-4c26-bdb2-6d879f1da786-manifests\") pod \"opendatahub-operator-controller-manager-b978d8c-vds4t\" (UID: \"2f2dd5e8-d872-4c26-bdb2-6d879f1da786\") " pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" Jul 21 14:37:36.470710 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.470714 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2f2dd5e8-d872-4c26-bdb2-6d879f1da786-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b978d8c-vds4t\" (UID: \"2f2dd5e8-d872-4c26-bdb2-6d879f1da786\") " pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" Jul 21 14:37:36.470985 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.470742 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k7tz\" (UniqueName: \"kubernetes.io/projected/2f2dd5e8-d872-4c26-bdb2-6d879f1da786-kube-api-access-5k7tz\") pod \"opendatahub-operator-controller-manager-b978d8c-vds4t\" (UID: \"2f2dd5e8-d872-4c26-bdb2-6d879f1da786\") " pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" Jul 21 14:37:36.470985 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.470778 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f2dd5e8-d872-4c26-bdb2-6d879f1da786-webhook-cert\") pod \"opendatahub-operator-controller-manager-b978d8c-vds4t\" (UID: \"2f2dd5e8-d872-4c26-bdb2-6d879f1da786\") " pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" Jul 21 14:37:36.470985 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.470818 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f2dd5e8-d872-4c26-bdb2-6d879f1da786-tmp\") pod \"opendatahub-operator-controller-manager-b978d8c-vds4t\" (UID: \"2f2dd5e8-d872-4c26-bdb2-6d879f1da786\") " pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" Jul 21 14:37:36.471177 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.471151 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2f2dd5e8-d872-4c26-bdb2-6d879f1da786-manifests\") pod \"opendatahub-operator-controller-manager-b978d8c-vds4t\" (UID: \"2f2dd5e8-d872-4c26-bdb2-6d879f1da786\") " pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" Jul 21 14:37:36.473107 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.473085 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2f2dd5e8-d872-4c26-bdb2-6d879f1da786-tmp\") pod \"opendatahub-operator-controller-manager-b978d8c-vds4t\" (UID: \"2f2dd5e8-d872-4c26-bdb2-6d879f1da786\") " pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" Jul 21 14:37:36.473349 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.473327 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2f2dd5e8-d872-4c26-bdb2-6d879f1da786-apiservice-cert\") pod \"opendatahub-operator-controller-manager-b978d8c-vds4t\" (UID: \"2f2dd5e8-d872-4c26-bdb2-6d879f1da786\") " pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" Jul 21 14:37:36.473395 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.473327 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2f2dd5e8-d872-4c26-bdb2-6d879f1da786-webhook-cert\") pod \"opendatahub-operator-controller-manager-b978d8c-vds4t\" (UID: \"2f2dd5e8-d872-4c26-bdb2-6d879f1da786\") " pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" Jul 21 14:37:36.482884 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.482858 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k7tz\" (UniqueName: \"kubernetes.io/projected/2f2dd5e8-d872-4c26-bdb2-6d879f1da786-kube-api-access-5k7tz\") pod \"opendatahub-operator-controller-manager-b978d8c-vds4t\" (UID: \"2f2dd5e8-d872-4c26-bdb2-6d879f1da786\") " pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" Jul 21 14:37:36.574303 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.574211 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" Jul 21 14:37:36.722128 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:36.722101 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t"] Jul 21 14:37:36.723463 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:37:36.723440 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f2dd5e8_d872_4c26_bdb2_6d879f1da786.slice/crio-ba22d2caf3bd321a76527f34a0e52061dc52640f0ed1f0ba343b05a453fc9c8f WatchSource:0}: Error finding container ba22d2caf3bd321a76527f34a0e52061dc52640f0ed1f0ba343b05a453fc9c8f: Status 404 returned error can't find the container with id ba22d2caf3bd321a76527f34a0e52061dc52640f0ed1f0ba343b05a453fc9c8f Jul 21 14:37:37.651780 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:37.651738 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" event={"ID":"2f2dd5e8-d872-4c26-bdb2-6d879f1da786","Type":"ContainerStarted","Data":"ba22d2caf3bd321a76527f34a0e52061dc52640f0ed1f0ba343b05a453fc9c8f"} Jul 21 14:37:40.667751 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:40.667710 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" event={"ID":"2f2dd5e8-d872-4c26-bdb2-6d879f1da786","Type":"ContainerStarted","Data":"34e2a81028d79a40c845add043b4e99017434a4e75530d6e904dd7bdca8dade4"} Jul 21 14:37:40.877107 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:37:40.877069 2559 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f2dd5e8_d872_4c26_bdb2_6d879f1da786.slice/crio-conmon-34e2a81028d79a40c845add043b4e99017434a4e75530d6e904dd7bdca8dade4.scope\": RecentStats: unable to find data in memory cache]" Jul 21 14:37:41.673911 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:41.673871 2559 generic.go:356] "Generic (PLEG): container finished" podID="2f2dd5e8-d872-4c26-bdb2-6d879f1da786" containerID="34e2a81028d79a40c845add043b4e99017434a4e75530d6e904dd7bdca8dade4" exitCode=0 Jul 21 14:37:41.674297 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:41.673921 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" event={"ID":"2f2dd5e8-d872-4c26-bdb2-6d879f1da786","Type":"ContainerDied","Data":"34e2a81028d79a40c845add043b4e99017434a4e75530d6e904dd7bdca8dade4"} Jul 21 14:37:42.681079 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:42.681047 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" event={"ID":"2f2dd5e8-d872-4c26-bdb2-6d879f1da786","Type":"ContainerStarted","Data":"bad2e526e1839c3f6728c9bacd39720f4886af29f8404684ffe956cbbdd21cb1"} Jul 21 14:37:42.681506 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:42.681188 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" Jul 21 14:37:42.703942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:42.703893 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" podStartSLOduration=2.265139726 podStartE2EDuration="6.703877091s" totalImagesPullingTime="3.398561628s" totalInitContainerRuntime="1.040175737s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:37:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:37:42.70214254 +0000 UTC m=+333.101287719" watchObservedRunningTime="2026-07-21 14:37:42.703877091 +0000 UTC m=+333.103022556" Jul 21 14:37:53.689228 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:53.689198 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-b978d8c-vds4t" Jul 21 14:37:56.910177 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:56.910144 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7vvkl"] Jul 21 14:37:56.918368 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:56.918347 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7vvkl" Jul 21 14:37:56.920471 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:56.920450 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 21 14:37:56.929063 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:56.929039 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7vvkl"] Jul 21 14:37:57.050611 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:57.050573 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5jdg\" (UniqueName: \"kubernetes.io/projected/a77170e4-3129-44d3-8f60-a594b3e89a6f-kube-api-access-h5jdg\") pod \"model-serving-api-54d89bd5fc-7vvkl\" (UID: \"a77170e4-3129-44d3-8f60-a594b3e89a6f\") " pod="opendatahub/model-serving-api-54d89bd5fc-7vvkl" Jul 21 14:37:57.050789 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:57.050630 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a77170e4-3129-44d3-8f60-a594b3e89a6f-tls-certs\") pod \"model-serving-api-54d89bd5fc-7vvkl\" (UID: \"a77170e4-3129-44d3-8f60-a594b3e89a6f\") " pod="opendatahub/model-serving-api-54d89bd5fc-7vvkl" Jul 21 14:37:57.151126 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:57.151074 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5jdg\" (UniqueName: \"kubernetes.io/projected/a77170e4-3129-44d3-8f60-a594b3e89a6f-kube-api-access-h5jdg\") pod \"model-serving-api-54d89bd5fc-7vvkl\" (UID: \"a77170e4-3129-44d3-8f60-a594b3e89a6f\") " pod="opendatahub/model-serving-api-54d89bd5fc-7vvkl" Jul 21 14:37:57.151307 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:57.151144 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a77170e4-3129-44d3-8f60-a594b3e89a6f-tls-certs\") pod \"model-serving-api-54d89bd5fc-7vvkl\" (UID: \"a77170e4-3129-44d3-8f60-a594b3e89a6f\") " pod="opendatahub/model-serving-api-54d89bd5fc-7vvkl" Jul 21 14:37:57.151307 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:37:57.151289 2559 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 21 14:37:57.151393 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:37:57.151379 2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a77170e4-3129-44d3-8f60-a594b3e89a6f-tls-certs podName:a77170e4-3129-44d3-8f60-a594b3e89a6f nodeName:}" failed. No retries permitted until 2026-07-21 14:37:57.651359184 +0000 UTC m=+348.050504355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a77170e4-3129-44d3-8f60-a594b3e89a6f-tls-certs") pod "model-serving-api-54d89bd5fc-7vvkl" (UID: "a77170e4-3129-44d3-8f60-a594b3e89a6f") : secret "model-serving-api-tls" not found Jul 21 14:37:57.159924 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:57.159891 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5jdg\" (UniqueName: \"kubernetes.io/projected/a77170e4-3129-44d3-8f60-a594b3e89a6f-kube-api-access-h5jdg\") pod \"model-serving-api-54d89bd5fc-7vvkl\" (UID: \"a77170e4-3129-44d3-8f60-a594b3e89a6f\") " pod="opendatahub/model-serving-api-54d89bd5fc-7vvkl" Jul 21 14:37:57.656314 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:57.656272 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a77170e4-3129-44d3-8f60-a594b3e89a6f-tls-certs\") pod \"model-serving-api-54d89bd5fc-7vvkl\" (UID: \"a77170e4-3129-44d3-8f60-a594b3e89a6f\") " pod="opendatahub/model-serving-api-54d89bd5fc-7vvkl" Jul 21 14:37:57.658740 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:57.658720 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a77170e4-3129-44d3-8f60-a594b3e89a6f-tls-certs\") pod \"model-serving-api-54d89bd5fc-7vvkl\" (UID: \"a77170e4-3129-44d3-8f60-a594b3e89a6f\") " pod="opendatahub/model-serving-api-54d89bd5fc-7vvkl" Jul 21 14:37:57.828715 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:57.828677 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-7vvkl" Jul 21 14:37:57.954166 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:57.954142 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-7vvkl"] Jul 21 14:37:57.956770 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:37:57.956740 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77170e4_3129_44d3_8f60_a594b3e89a6f.slice/crio-4a0de2914dd6c0cb8039b78babe51526cd8978df39d5037da9cb88f3700fb33e WatchSource:0}: Error finding container 4a0de2914dd6c0cb8039b78babe51526cd8978df39d5037da9cb88f3700fb33e: Status 404 returned error can't find the container with id 4a0de2914dd6c0cb8039b78babe51526cd8978df39d5037da9cb88f3700fb33e Jul 21 14:37:58.751111 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:37:58.751072 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7vvkl" event={"ID":"a77170e4-3129-44d3-8f60-a594b3e89a6f","Type":"ContainerStarted","Data":"4a0de2914dd6c0cb8039b78babe51526cd8978df39d5037da9cb88f3700fb33e"} Jul 21 14:38:01.765594 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:01.765564 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-7vvkl" event={"ID":"a77170e4-3129-44d3-8f60-a594b3e89a6f","Type":"ContainerStarted","Data":"f0cbcf0c54ece0c9f20a5a039d30259c7ad114468ebdf17f998cdae3b370bf64"} Jul 21 14:38:01.766028 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:01.765668 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-7vvkl" Jul 21 14:38:01.787202 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:01.787154 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-7vvkl" podStartSLOduration=2.7367907689999997 podStartE2EDuration="5.78713951s" totalImagesPullingTime="3.050348741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:38:01.785449704 +0000 UTC m=+352.184594883" watchObservedRunningTime="2026-07-21 14:38:01.78713951 +0000 UTC m=+352.186284700" Jul 21 14:38:03.910378 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:03.910299 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24"] Jul 21 14:38:03.913596 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:03.913580 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24" Jul 21 14:38:03.916277 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:03.916255 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 21 14:38:03.916277 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:03.916264 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 21 14:38:03.917456 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:03.917424 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-c85s5\"" Jul 21 14:38:03.917541 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:03.917486 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 21 14:38:03.924056 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:03.924034 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24"] Jul 21 14:38:04.009420 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:04.009378 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/166f1d6a-23f2-4f94-9a7a-1cb3d931ddae-metrics-cert\") pod \"lws-controller-manager-77cc7cb7fc-f4s24\" (UID: \"166f1d6a-23f2-4f94-9a7a-1cb3d931ddae\") " pod="openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24" Jul 21 14:38:04.009593 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:04.009441 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/166f1d6a-23f2-4f94-9a7a-1cb3d931ddae-cert\") pod \"lws-controller-manager-77cc7cb7fc-f4s24\" (UID: \"166f1d6a-23f2-4f94-9a7a-1cb3d931ddae\") " pod="openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24" Jul 21 14:38:04.009593 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:04.009471 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/166f1d6a-23f2-4f94-9a7a-1cb3d931ddae-manager-config\") pod \"lws-controller-manager-77cc7cb7fc-f4s24\" (UID: \"166f1d6a-23f2-4f94-9a7a-1cb3d931ddae\") " pod="openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24" Jul 21 14:38:04.009593 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:04.009506 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfvtg\" (UniqueName: \"kubernetes.io/projected/166f1d6a-23f2-4f94-9a7a-1cb3d931ddae-kube-api-access-rfvtg\") pod \"lws-controller-manager-77cc7cb7fc-f4s24\" (UID: \"166f1d6a-23f2-4f94-9a7a-1cb3d931ddae\") " pod="openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24" Jul 21 14:38:04.110343 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:04.110296 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/166f1d6a-23f2-4f94-9a7a-1cb3d931ddae-cert\") pod \"lws-controller-manager-77cc7cb7fc-f4s24\" (UID: \"166f1d6a-23f2-4f94-9a7a-1cb3d931ddae\") " pod="openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24" Jul 21 14:38:04.110343 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:04.110342 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/166f1d6a-23f2-4f94-9a7a-1cb3d931ddae-manager-config\") pod \"lws-controller-manager-77cc7cb7fc-f4s24\" (UID: \"166f1d6a-23f2-4f94-9a7a-1cb3d931ddae\") " pod="openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24" Jul 21 14:38:04.110555 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:04.110373 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfvtg\" (UniqueName: \"kubernetes.io/projected/166f1d6a-23f2-4f94-9a7a-1cb3d931ddae-kube-api-access-rfvtg\") pod \"lws-controller-manager-77cc7cb7fc-f4s24\" (UID: \"166f1d6a-23f2-4f94-9a7a-1cb3d931ddae\") " pod="openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24" Jul 21 14:38:04.110555 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:04.110402 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/166f1d6a-23f2-4f94-9a7a-1cb3d931ddae-metrics-cert\") pod \"lws-controller-manager-77cc7cb7fc-f4s24\" (UID: \"166f1d6a-23f2-4f94-9a7a-1cb3d931ddae\") " pod="openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24" Jul 21 14:38:04.111158 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:04.111126 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/166f1d6a-23f2-4f94-9a7a-1cb3d931ddae-manager-config\") pod \"lws-controller-manager-77cc7cb7fc-f4s24\" (UID: \"166f1d6a-23f2-4f94-9a7a-1cb3d931ddae\") " pod="openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24" Jul 21 14:38:04.112925 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:04.112900 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/166f1d6a-23f2-4f94-9a7a-1cb3d931ddae-metrics-cert\") pod \"lws-controller-manager-77cc7cb7fc-f4s24\" (UID: \"166f1d6a-23f2-4f94-9a7a-1cb3d931ddae\") " pod="openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24" Jul 21 14:38:04.112925 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:04.112915 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/166f1d6a-23f2-4f94-9a7a-1cb3d931ddae-cert\") pod \"lws-controller-manager-77cc7cb7fc-f4s24\" (UID: \"166f1d6a-23f2-4f94-9a7a-1cb3d931ddae\") " pod="openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24" Jul 21 14:38:04.118762 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:04.118742 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfvtg\" (UniqueName: \"kubernetes.io/projected/166f1d6a-23f2-4f94-9a7a-1cb3d931ddae-kube-api-access-rfvtg\") pod \"lws-controller-manager-77cc7cb7fc-f4s24\" (UID: \"166f1d6a-23f2-4f94-9a7a-1cb3d931ddae\") " pod="openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24" Jul 21 14:38:04.223168 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:04.223140 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24" Jul 21 14:38:04.355245 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:04.355211 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24"] Jul 21 14:38:04.357107 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:38:04.357080 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod166f1d6a_23f2_4f94_9a7a_1cb3d931ddae.slice/crio-65517c60cdd988692ef25b494138ca68a24eeac040816ee6c3f813ec1a82682e WatchSource:0}: Error finding container 65517c60cdd988692ef25b494138ca68a24eeac040816ee6c3f813ec1a82682e: Status 404 returned error can't find the container with id 65517c60cdd988692ef25b494138ca68a24eeac040816ee6c3f813ec1a82682e Jul 21 14:38:04.779868 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:04.779832 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24" event={"ID":"166f1d6a-23f2-4f94-9a7a-1cb3d931ddae","Type":"ContainerStarted","Data":"65517c60cdd988692ef25b494138ca68a24eeac040816ee6c3f813ec1a82682e"} Jul 21 14:38:06.790978 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:06.790937 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24" event={"ID":"166f1d6a-23f2-4f94-9a7a-1cb3d931ddae","Type":"ContainerStarted","Data":"1202879519c2d0a95d159e8f2f42c275d9a8dc39afa951d4fa467fef8a8f06ad"} Jul 21 14:38:06.791366 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:06.791068 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24" Jul 21 14:38:06.826659 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:06.826605 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24" podStartSLOduration=2.17869971 podStartE2EDuration="3.826587779s" totalImagesPullingTime="1.647888069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:38:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:38:06.825469258 +0000 UTC m=+357.224614436" watchObservedRunningTime="2026-07-21 14:38:06.826587779 +0000 UTC m=+357.225732955" Jul 21 14:38:12.774703 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:12.774670 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-7vvkl" Jul 21 14:38:14.700619 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.700581 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd"] Jul 21 14:38:14.710276 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.710245 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.715886 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.715859 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-lnp55\"" Jul 21 14:38:14.716058 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.716039 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 21 14:38:14.722257 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.722227 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd"] Jul 21 14:38:14.809406 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.809368 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2b5d575-a413-41af-8d3b-a81b778b6048-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.809588 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.809412 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2b5d575-a413-41af-8d3b-a81b778b6048-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.809588 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.809434 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b5d575-a413-41af-8d3b-a81b778b6048-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.809588 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.809465 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2b5d575-a413-41af-8d3b-a81b778b6048-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.809588 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.809551 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmzsv\" (UniqueName: \"kubernetes.io/projected/d2b5d575-a413-41af-8d3b-a81b778b6048-kube-api-access-tmzsv\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.809588 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.809586 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2b5d575-a413-41af-8d3b-a81b778b6048-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.809749 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.809621 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b5d575-a413-41af-8d3b-a81b778b6048-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.809749 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.809638 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2b5d575-a413-41af-8d3b-a81b778b6048-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.809749 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.809661 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2b5d575-a413-41af-8d3b-a81b778b6048-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.910412 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.910376 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2b5d575-a413-41af-8d3b-a81b778b6048-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.910412 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.910413 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2b5d575-a413-41af-8d3b-a81b778b6048-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.910700 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.910430 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b5d575-a413-41af-8d3b-a81b778b6048-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.910700 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.910470 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2b5d575-a413-41af-8d3b-a81b778b6048-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.910700 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.910655 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmzsv\" (UniqueName: \"kubernetes.io/projected/d2b5d575-a413-41af-8d3b-a81b778b6048-kube-api-access-tmzsv\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.910890 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.910721 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2b5d575-a413-41af-8d3b-a81b778b6048-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.910890 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.910763 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b5d575-a413-41af-8d3b-a81b778b6048-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.910890 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.910817 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2b5d575-a413-41af-8d3b-a81b778b6048-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.910890 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.910853 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2b5d575-a413-41af-8d3b-a81b778b6048-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.911078 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.910887 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2b5d575-a413-41af-8d3b-a81b778b6048-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.911078 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.910921 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b5d575-a413-41af-8d3b-a81b778b6048-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.911078 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.910956 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2b5d575-a413-41af-8d3b-a81b778b6048-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.911234 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.911155 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2b5d575-a413-41af-8d3b-a81b778b6048-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.911566 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.911546 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2b5d575-a413-41af-8d3b-a81b778b6048-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.912938 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.912917 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2b5d575-a413-41af-8d3b-a81b778b6048-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.913032 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.912978 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2b5d575-a413-41af-8d3b-a81b778b6048-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.918628 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.918605 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2b5d575-a413-41af-8d3b-a81b778b6048-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:14.919325 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:14.919294 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmzsv\" (UniqueName: \"kubernetes.io/projected/d2b5d575-a413-41af-8d3b-a81b778b6048-kube-api-access-tmzsv\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4gglhd\" (UID: \"d2b5d575-a413-41af-8d3b-a81b778b6048\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:15.020888 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:15.020838 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:15.153345 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:15.153310 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd"] Jul 21 14:38:15.156458 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:38:15.156433 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b5d575_a413_41af_8d3b_a81b778b6048.slice/crio-5f5580c227ac5aa46966c6347e9ef5f1e4af5b02e92019570e53da372d86f1f6 WatchSource:0}: Error finding container 5f5580c227ac5aa46966c6347e9ef5f1e4af5b02e92019570e53da372d86f1f6: Status 404 returned error can't find the container with id 5f5580c227ac5aa46966c6347e9ef5f1e4af5b02e92019570e53da372d86f1f6 Jul 21 14:38:15.833349 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:15.833315 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" event={"ID":"d2b5d575-a413-41af-8d3b-a81b778b6048","Type":"ContainerStarted","Data":"5f5580c227ac5aa46966c6347e9ef5f1e4af5b02e92019570e53da372d86f1f6"} Jul 21 14:38:17.798694 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:17.798664 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-77cc7cb7fc-f4s24" Jul 21 14:38:17.888857 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:17.888817 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 14:38:17.888971 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:17.888894 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 14:38:17.888971 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:17.888925 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 14:38:18.852917 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:18.852877 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" event={"ID":"d2b5d575-a413-41af-8d3b-a81b778b6048","Type":"ContainerStarted","Data":"d69ee1c51c615e314f97950b23327a0abbad95017078e7920b2626572729cd1b"} Jul 21 14:38:18.871837 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:18.871757 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" podStartSLOduration=2.141697562 podStartE2EDuration="4.871739528s" totalImagesPullingTime="2.730041966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:38:18.871281697 +0000 UTC m=+369.270426878" watchObservedRunningTime="2026-07-21 14:38:18.871739528 +0000 UTC m=+369.270884707" Jul 21 14:38:19.021280 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:19.021244 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:19.025856 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:19.025832 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:19.858037 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:19.858006 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:38:19.858976 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:38:19.858956 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4gglhd" Jul 21 14:39:12.667436 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:12.667394 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6"] Jul 21 14:39:12.671206 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:12.671175 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6" Jul 21 14:39:12.673625 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:12.673597 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 21 14:39:12.673785 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:12.673687 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 21 14:39:12.674414 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:12.674399 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sftv9\"" Jul 21 14:39:12.679825 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:12.679769 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6"] Jul 21 14:39:12.703544 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:12.703507 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5923e0a3-8d11-4cc6-99de-d72974f07495-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6\" (UID: \"5923e0a3-8d11-4cc6-99de-d72974f07495\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6" Jul 21 14:39:12.703544 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:12.703546 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5923e0a3-8d11-4cc6-99de-d72974f07495-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6\" (UID: \"5923e0a3-8d11-4cc6-99de-d72974f07495\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6" Jul 21 14:39:12.703770 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:12.703627 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dj4z\" (UniqueName: \"kubernetes.io/projected/5923e0a3-8d11-4cc6-99de-d72974f07495-kube-api-access-7dj4z\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6\" (UID: \"5923e0a3-8d11-4cc6-99de-d72974f07495\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6" Jul 21 14:39:12.804053 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:12.804010 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dj4z\" (UniqueName: \"kubernetes.io/projected/5923e0a3-8d11-4cc6-99de-d72974f07495-kube-api-access-7dj4z\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6\" (UID: \"5923e0a3-8d11-4cc6-99de-d72974f07495\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6" Jul 21 14:39:12.804234 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:12.804072 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5923e0a3-8d11-4cc6-99de-d72974f07495-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6\" (UID: \"5923e0a3-8d11-4cc6-99de-d72974f07495\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6" Jul 21 14:39:12.804234 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:12.804103 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5923e0a3-8d11-4cc6-99de-d72974f07495-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6\" (UID: \"5923e0a3-8d11-4cc6-99de-d72974f07495\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6" Jul 21 14:39:12.804534 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:12.804514 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5923e0a3-8d11-4cc6-99de-d72974f07495-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6\" (UID: \"5923e0a3-8d11-4cc6-99de-d72974f07495\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6" Jul 21 14:39:12.804585 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:12.804538 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5923e0a3-8d11-4cc6-99de-d72974f07495-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6\" (UID: \"5923e0a3-8d11-4cc6-99de-d72974f07495\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6" Jul 21 14:39:12.813722 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:12.813688 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dj4z\" (UniqueName: \"kubernetes.io/projected/5923e0a3-8d11-4cc6-99de-d72974f07495-kube-api-access-7dj4z\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6\" (UID: \"5923e0a3-8d11-4cc6-99de-d72974f07495\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6" Jul 21 14:39:12.982657 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:12.982620 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6" Jul 21 14:39:13.130299 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.130268 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6"] Jul 21 14:39:13.132598 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:39:13.132565 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5923e0a3_8d11_4cc6_99de_d72974f07495.slice/crio-b6645117a7bf9e7647ffdf182d630e464b410ea51e1bb0dc05729ece3cd9caa2 WatchSource:0}: Error finding container b6645117a7bf9e7647ffdf182d630e464b410ea51e1bb0dc05729ece3cd9caa2: Status 404 returned error can't find the container with id b6645117a7bf9e7647ffdf182d630e464b410ea51e1bb0dc05729ece3cd9caa2 Jul 21 14:39:13.267116 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.267079 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95"] Jul 21 14:39:13.270869 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.270842 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95" Jul 21 14:39:13.283505 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.283466 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95"] Jul 21 14:39:13.308995 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.308955 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfq7g\" (UniqueName: \"kubernetes.io/projected/f8490783-5a85-402f-811e-113358f568b7-kube-api-access-vfq7g\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95\" (UID: \"f8490783-5a85-402f-811e-113358f568b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95" Jul 21 14:39:13.309171 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.309066 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8490783-5a85-402f-811e-113358f568b7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95\" (UID: \"f8490783-5a85-402f-811e-113358f568b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95" Jul 21 14:39:13.309171 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.309110 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8490783-5a85-402f-811e-113358f568b7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95\" (UID: \"f8490783-5a85-402f-811e-113358f568b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95" Jul 21 14:39:13.410253 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.410214 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8490783-5a85-402f-811e-113358f568b7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95\" (UID: \"f8490783-5a85-402f-811e-113358f568b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95" Jul 21 14:39:13.410253 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.410263 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8490783-5a85-402f-811e-113358f568b7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95\" (UID: \"f8490783-5a85-402f-811e-113358f568b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95" Jul 21 14:39:13.410538 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.410301 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfq7g\" (UniqueName: \"kubernetes.io/projected/f8490783-5a85-402f-811e-113358f568b7-kube-api-access-vfq7g\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95\" (UID: \"f8490783-5a85-402f-811e-113358f568b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95" Jul 21 14:39:13.410677 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.410653 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8490783-5a85-402f-811e-113358f568b7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95\" (UID: \"f8490783-5a85-402f-811e-113358f568b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95" Jul 21 14:39:13.410741 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.410715 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8490783-5a85-402f-811e-113358f568b7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95\" (UID: \"f8490783-5a85-402f-811e-113358f568b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95" Jul 21 14:39:13.419074 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.419037 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfq7g\" (UniqueName: \"kubernetes.io/projected/f8490783-5a85-402f-811e-113358f568b7-kube-api-access-vfq7g\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95\" (UID: \"f8490783-5a85-402f-811e-113358f568b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95" Jul 21 14:39:13.631041 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.630917 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95" Jul 21 14:39:13.666225 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.666186 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq"] Jul 21 14:39:13.670037 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.670016 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq" Jul 21 14:39:13.679547 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.679516 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq"] Jul 21 14:39:13.712673 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.712637 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddnpx\" (UniqueName: \"kubernetes.io/projected/4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93-kube-api-access-ddnpx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq\" (UID: \"4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq" Jul 21 14:39:13.712920 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.712691 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq\" (UID: \"4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq" Jul 21 14:39:13.712920 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.712782 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq\" (UID: \"4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq" Jul 21 14:39:13.791382 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.791348 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95"] Jul 21 14:39:13.794363 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:39:13.794331 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8490783_5a85_402f_811e_113358f568b7.slice/crio-d34ba15869746a97603584696c47f2dd3a5cebf344aec35b836073389467c840 WatchSource:0}: Error finding container d34ba15869746a97603584696c47f2dd3a5cebf344aec35b836073389467c840: Status 404 returned error can't find the container with id d34ba15869746a97603584696c47f2dd3a5cebf344aec35b836073389467c840 Jul 21 14:39:13.813938 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.813902 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq\" (UID: \"4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq" Jul 21 14:39:13.814114 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.814007 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddnpx\" (UniqueName: \"kubernetes.io/projected/4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93-kube-api-access-ddnpx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq\" (UID: \"4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq" Jul 21 14:39:13.814114 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.814040 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq\" (UID: \"4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq" Jul 21 14:39:13.814381 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.814349 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq\" (UID: \"4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq" Jul 21 14:39:13.814456 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.814410 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq\" (UID: \"4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq" Jul 21 14:39:13.822834 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.822808 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddnpx\" (UniqueName: \"kubernetes.io/projected/4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93-kube-api-access-ddnpx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq\" (UID: \"4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq" Jul 21 14:39:13.983005 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:13.982958 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq" Jul 21 14:39:14.070720 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:14.070655 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw"] Jul 21 14:39:14.076912 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:14.076852 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw" Jul 21 14:39:14.084998 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:14.084959 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw"] Jul 21 14:39:14.116651 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:14.116617 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw\" (UID: \"cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw" Jul 21 14:39:14.116651 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:14.116649 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw\" (UID: \"cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw" Jul 21 14:39:14.116954 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:14.116753 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txz2k\" (UniqueName: \"kubernetes.io/projected/cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7-kube-api-access-txz2k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw\" (UID: \"cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw" Jul 21 14:39:14.117334 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:14.117285 2559 generic.go:356] "Generic (PLEG): container finished" podID="5923e0a3-8d11-4cc6-99de-d72974f07495" containerID="54915573184ecc98cdde0c07c556466f620d9ed244bbee75bdb6766b2c28a1de" exitCode=0 Jul 21 14:39:14.119625 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:14.119592 2559 generic.go:356] "Generic (PLEG): container finished" podID="f8490783-5a85-402f-811e-113358f568b7" containerID="72b69e513bc4c6000e4b6816b4fc7aba57245ced09d3b98c823d1b92c4cb9dba" exitCode=0 Jul 21 14:39:14.122151 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:14.122062 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6" event={"ID":"5923e0a3-8d11-4cc6-99de-d72974f07495","Type":"ContainerDied","Data":"54915573184ecc98cdde0c07c556466f620d9ed244bbee75bdb6766b2c28a1de"} Jul 21 14:39:14.122151 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:14.122117 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6" event={"ID":"5923e0a3-8d11-4cc6-99de-d72974f07495","Type":"ContainerStarted","Data":"b6645117a7bf9e7647ffdf182d630e464b410ea51e1bb0dc05729ece3cd9caa2"} Jul 21 14:39:14.122151 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:14.122140 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95" event={"ID":"f8490783-5a85-402f-811e-113358f568b7","Type":"ContainerDied","Data":"72b69e513bc4c6000e4b6816b4fc7aba57245ced09d3b98c823d1b92c4cb9dba"} Jul 21 14:39:14.122361 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:14.122165 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95" event={"ID":"f8490783-5a85-402f-811e-113358f568b7","Type":"ContainerStarted","Data":"d34ba15869746a97603584696c47f2dd3a5cebf344aec35b836073389467c840"} Jul 21 14:39:14.148457 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:14.148418 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq"] Jul 21 14:39:14.152402 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:39:14.151820 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc1f6c1_dae5_45e6_afeb_69dc7ccddd93.slice/crio-165ccf82b5e1a7fdaa021cb280ba51d392e46c82df6c010eb1cc42690e7f8b43 WatchSource:0}: Error finding container 165ccf82b5e1a7fdaa021cb280ba51d392e46c82df6c010eb1cc42690e7f8b43: Status 404 returned error can't find the container with id 165ccf82b5e1a7fdaa021cb280ba51d392e46c82df6c010eb1cc42690e7f8b43 Jul 21 14:39:14.217841 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:14.217779 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txz2k\" (UniqueName: \"kubernetes.io/projected/cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7-kube-api-access-txz2k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw\" (UID: \"cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw" Jul 21 14:39:14.218038 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:14.217990 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw\" (UID: \"cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw" Jul 21 14:39:14.218038 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:14.218019 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw\" (UID: \"cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw" Jul 21 14:39:14.218444 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:14.218420 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw\" (UID: \"cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw" Jul 21 14:39:14.218539 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:14.218450 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw\" (UID: \"cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw" Jul 21 14:39:14.226965 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:14.226929 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txz2k\" (UniqueName: \"kubernetes.io/projected/cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7-kube-api-access-txz2k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw\" (UID: \"cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw" Jul 21 14:39:14.393812 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:14.393759 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw" Jul 21 14:39:14.545052 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:14.545025 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw"] Jul 21 14:39:14.547682 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:39:14.547653 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc1055ea_fbdd_46e2_95de_c5bbb78c7ac7.slice/crio-8a8e75bb140afa145217cff596581da24167fa70b49d20df44e3b2f5aa3286fe WatchSource:0}: Error finding container 8a8e75bb140afa145217cff596581da24167fa70b49d20df44e3b2f5aa3286fe: Status 404 returned error can't find the container with id 8a8e75bb140afa145217cff596581da24167fa70b49d20df44e3b2f5aa3286fe Jul 21 14:39:15.128149 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:15.128050 2559 generic.go:356] "Generic (PLEG): container finished" podID="f8490783-5a85-402f-811e-113358f568b7" containerID="235b819ac4c479352532b7a22a76b05382cf10c4720b6a5474e8d6e20c05f4e9" exitCode=0 Jul 21 14:39:15.128587 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:15.128140 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95" event={"ID":"f8490783-5a85-402f-811e-113358f568b7","Type":"ContainerDied","Data":"235b819ac4c479352532b7a22a76b05382cf10c4720b6a5474e8d6e20c05f4e9"} Jul 21 14:39:15.130123 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:15.130093 2559 generic.go:356] "Generic (PLEG): container finished" podID="cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7" containerID="5d9dd13daa98da3e3a16d0ea8e985ceb982fb869b9f8d8dba40035e623573861" exitCode=0 Jul 21 14:39:15.130254 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:15.130225 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw" event={"ID":"cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7","Type":"ContainerDied","Data":"5d9dd13daa98da3e3a16d0ea8e985ceb982fb869b9f8d8dba40035e623573861"} Jul 21 14:39:15.130379 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:15.130286 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw" event={"ID":"cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7","Type":"ContainerStarted","Data":"8a8e75bb140afa145217cff596581da24167fa70b49d20df44e3b2f5aa3286fe"} Jul 21 14:39:15.131942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:15.131916 2559 generic.go:356] "Generic (PLEG): container finished" podID="4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93" containerID="91edc705d47569c4efb0664926cd7ce43c2d58507e064878f3f423a06015e03e" exitCode=0 Jul 21 14:39:15.132053 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:15.131959 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq" event={"ID":"4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93","Type":"ContainerDied","Data":"91edc705d47569c4efb0664926cd7ce43c2d58507e064878f3f423a06015e03e"} Jul 21 14:39:15.132053 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:15.131999 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq" event={"ID":"4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93","Type":"ContainerStarted","Data":"165ccf82b5e1a7fdaa021cb280ba51d392e46c82df6c010eb1cc42690e7f8b43"} Jul 21 14:39:16.139929 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:16.139894 2559 generic.go:356] "Generic (PLEG): container finished" podID="f8490783-5a85-402f-811e-113358f568b7" containerID="07415fa3ce8bcb7b7472cf713d495f70879008f359d6aefd10e287fa9c7e401f" exitCode=0 Jul 21 14:39:16.140364 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:16.139932 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95" event={"ID":"f8490783-5a85-402f-811e-113358f568b7","Type":"ContainerDied","Data":"07415fa3ce8bcb7b7472cf713d495f70879008f359d6aefd10e287fa9c7e401f"} Jul 21 14:39:16.142095 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:16.142069 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw" event={"ID":"cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7","Type":"ContainerStarted","Data":"d15784d15660a8bcad8d5cfbc3c14c3a52bd8f95af1cf55493e6164b42d8b7a8"} Jul 21 14:39:17.149136 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:17.149097 2559 generic.go:356] "Generic (PLEG): container finished" podID="cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7" containerID="d15784d15660a8bcad8d5cfbc3c14c3a52bd8f95af1cf55493e6164b42d8b7a8" exitCode=0 Jul 21 14:39:17.149654 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:17.149182 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw" event={"ID":"cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7","Type":"ContainerDied","Data":"d15784d15660a8bcad8d5cfbc3c14c3a52bd8f95af1cf55493e6164b42d8b7a8"} Jul 21 14:39:17.362545 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:17.362509 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95" Jul 21 14:39:17.447925 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:17.447827 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vfq7g\" (UniqueName: \"kubernetes.io/projected/f8490783-5a85-402f-811e-113358f568b7-kube-api-access-vfq7g\") pod \"f8490783-5a85-402f-811e-113358f568b7\" (UID: \"f8490783-5a85-402f-811e-113358f568b7\") " Jul 21 14:39:17.447925 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:17.447872 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8490783-5a85-402f-811e-113358f568b7-bundle\") pod \"f8490783-5a85-402f-811e-113358f568b7\" (UID: \"f8490783-5a85-402f-811e-113358f568b7\") " Jul 21 14:39:17.447925 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:17.447897 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8490783-5a85-402f-811e-113358f568b7-util\") pod \"f8490783-5a85-402f-811e-113358f568b7\" (UID: \"f8490783-5a85-402f-811e-113358f568b7\") " Jul 21 14:39:17.448464 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:17.448419 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8490783-5a85-402f-811e-113358f568b7-bundle" (OuterVolumeSpecName: "bundle") pod "f8490783-5a85-402f-811e-113358f568b7" (UID: "f8490783-5a85-402f-811e-113358f568b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:39:17.450272 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:17.450240 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8490783-5a85-402f-811e-113358f568b7-kube-api-access-vfq7g" (OuterVolumeSpecName: "kube-api-access-vfq7g") pod "f8490783-5a85-402f-811e-113358f568b7" (UID: "f8490783-5a85-402f-811e-113358f568b7"). InnerVolumeSpecName "kube-api-access-vfq7g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:39:17.453553 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:17.453521 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8490783-5a85-402f-811e-113358f568b7-util" (OuterVolumeSpecName: "util") pod "f8490783-5a85-402f-811e-113358f568b7" (UID: "f8490783-5a85-402f-811e-113358f568b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:39:17.549191 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:17.549147 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vfq7g\" (UniqueName: \"kubernetes.io/projected/f8490783-5a85-402f-811e-113358f568b7-kube-api-access-vfq7g\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:39:17.549191 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:17.549181 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f8490783-5a85-402f-811e-113358f568b7-bundle\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:39:17.549191 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:17.549190 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f8490783-5a85-402f-811e-113358f568b7-util\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:39:18.156786 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:18.156748 2559 generic.go:356] "Generic (PLEG): container finished" podID="cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7" containerID="5e62a37918f0a3da5ec4f4974b827eb6388d7f5ca7b707ae2421669a8507485f" exitCode=0 Jul 21 14:39:18.157250 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:18.156832 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw" event={"ID":"cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7","Type":"ContainerDied","Data":"5e62a37918f0a3da5ec4f4974b827eb6388d7f5ca7b707ae2421669a8507485f"} Jul 21 14:39:18.158711 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:18.158681 2559 generic.go:356] "Generic (PLEG): container finished" podID="5923e0a3-8d11-4cc6-99de-d72974f07495" containerID="a877cfc53bc5fbf9cdb01524aa3bb11ff8d0fd0b0f3eb90a2c47af03704e4689" exitCode=0 Jul 21 14:39:18.158851 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:18.158762 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6" event={"ID":"5923e0a3-8d11-4cc6-99de-d72974f07495","Type":"ContainerDied","Data":"a877cfc53bc5fbf9cdb01524aa3bb11ff8d0fd0b0f3eb90a2c47af03704e4689"} Jul 21 14:39:18.161007 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:18.160984 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95" event={"ID":"f8490783-5a85-402f-811e-113358f568b7","Type":"ContainerDied","Data":"d34ba15869746a97603584696c47f2dd3a5cebf344aec35b836073389467c840"} Jul 21 14:39:18.161007 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:18.160999 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95" Jul 21 14:39:18.161143 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:18.161027 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d34ba15869746a97603584696c47f2dd3a5cebf344aec35b836073389467c840" Jul 21 14:39:19.169531 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:19.169497 2559 generic.go:356] "Generic (PLEG): container finished" podID="5923e0a3-8d11-4cc6-99de-d72974f07495" containerID="19f344d71c07cdd83dba853ac4003f569b3f7cd277bb91d0ed2802db4fa24f13" exitCode=0 Jul 21 14:39:19.170004 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:19.169577 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6" event={"ID":"5923e0a3-8d11-4cc6-99de-d72974f07495","Type":"ContainerDied","Data":"19f344d71c07cdd83dba853ac4003f569b3f7cd277bb91d0ed2802db4fa24f13"} Jul 21 14:39:19.319413 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:19.319375 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw" Jul 21 14:39:19.365248 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:19.365207 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7-util\") pod \"cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7\" (UID: \"cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7\") " Jul 21 14:39:19.365453 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:19.365264 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txz2k\" (UniqueName: \"kubernetes.io/projected/cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7-kube-api-access-txz2k\") pod \"cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7\" (UID: \"cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7\") " Jul 21 14:39:19.365453 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:19.365306 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7-bundle\") pod \"cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7\" (UID: \"cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7\") " Jul 21 14:39:19.366018 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:19.365989 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7-bundle" (OuterVolumeSpecName: "bundle") pod "cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7" (UID: "cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:39:19.367593 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:19.367559 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7-kube-api-access-txz2k" (OuterVolumeSpecName: "kube-api-access-txz2k") pod "cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7" (UID: "cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7"). InnerVolumeSpecName "kube-api-access-txz2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:39:19.370414 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:19.370379 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7-util" (OuterVolumeSpecName: "util") pod "cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7" (UID: "cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:39:19.466002 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:19.465970 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7-util\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:39:19.466002 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:19.466002 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txz2k\" (UniqueName: \"kubernetes.io/projected/cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7-kube-api-access-txz2k\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:39:19.466246 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:19.466014 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7-bundle\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:39:20.179112 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:20.179082 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw" Jul 21 14:39:20.179563 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:20.179081 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw" event={"ID":"cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7","Type":"ContainerDied","Data":"8a8e75bb140afa145217cff596581da24167fa70b49d20df44e3b2f5aa3286fe"} Jul 21 14:39:20.179563 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:20.179235 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8a8e75bb140afa145217cff596581da24167fa70b49d20df44e3b2f5aa3286fe" Jul 21 14:39:20.337895 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:20.337859 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6" Jul 21 14:39:20.375953 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:20.375921 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5923e0a3-8d11-4cc6-99de-d72974f07495-bundle\") pod \"5923e0a3-8d11-4cc6-99de-d72974f07495\" (UID: \"5923e0a3-8d11-4cc6-99de-d72974f07495\") " Jul 21 14:39:20.376094 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:20.375981 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5923e0a3-8d11-4cc6-99de-d72974f07495-util\") pod \"5923e0a3-8d11-4cc6-99de-d72974f07495\" (UID: \"5923e0a3-8d11-4cc6-99de-d72974f07495\") " Jul 21 14:39:20.376172 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:20.376099 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dj4z\" (UniqueName: \"kubernetes.io/projected/5923e0a3-8d11-4cc6-99de-d72974f07495-kube-api-access-7dj4z\") pod \"5923e0a3-8d11-4cc6-99de-d72974f07495\" (UID: \"5923e0a3-8d11-4cc6-99de-d72974f07495\") " Jul 21 14:39:20.376523 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:20.376482 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5923e0a3-8d11-4cc6-99de-d72974f07495-bundle" (OuterVolumeSpecName: "bundle") pod "5923e0a3-8d11-4cc6-99de-d72974f07495" (UID: "5923e0a3-8d11-4cc6-99de-d72974f07495"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:39:20.378608 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:20.378540 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5923e0a3-8d11-4cc6-99de-d72974f07495-kube-api-access-7dj4z" (OuterVolumeSpecName: "kube-api-access-7dj4z") pod "5923e0a3-8d11-4cc6-99de-d72974f07495" (UID: "5923e0a3-8d11-4cc6-99de-d72974f07495"). InnerVolumeSpecName "kube-api-access-7dj4z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:39:20.383233 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:20.383192 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5923e0a3-8d11-4cc6-99de-d72974f07495-util" (OuterVolumeSpecName: "util") pod "5923e0a3-8d11-4cc6-99de-d72974f07495" (UID: "5923e0a3-8d11-4cc6-99de-d72974f07495"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:39:20.476982 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:20.476940 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dj4z\" (UniqueName: \"kubernetes.io/projected/5923e0a3-8d11-4cc6-99de-d72974f07495-kube-api-access-7dj4z\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:39:20.476982 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:20.476977 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5923e0a3-8d11-4cc6-99de-d72974f07495-bundle\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:39:20.476982 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:20.476993 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5923e0a3-8d11-4cc6-99de-d72974f07495-util\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:39:21.187929 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:21.187893 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6" Jul 21 14:39:21.188772 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:21.187892 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6" event={"ID":"5923e0a3-8d11-4cc6-99de-d72974f07495","Type":"ContainerDied","Data":"b6645117a7bf9e7647ffdf182d630e464b410ea51e1bb0dc05729ece3cd9caa2"} Jul 21 14:39:21.188772 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:21.188035 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6645117a7bf9e7647ffdf182d630e464b410ea51e1bb0dc05729ece3cd9caa2" Jul 21 14:39:21.190461 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:21.190423 2559 generic.go:356] "Generic (PLEG): container finished" podID="4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93" containerID="572376d55bdbecd94e3c29b0260cdac0156b607e5fba82d2a11cc36e07f4a41f" exitCode=0 Jul 21 14:39:21.190599 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:21.190489 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq" event={"ID":"4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93","Type":"ContainerDied","Data":"572376d55bdbecd94e3c29b0260cdac0156b607e5fba82d2a11cc36e07f4a41f"} Jul 21 14:39:22.199309 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:22.199271 2559 generic.go:356] "Generic (PLEG): container finished" podID="4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93" containerID="8f1b0806302b9e3b88c35cb28a15fe901d4c106206de14f4cc034b569e74ae32" exitCode=0 Jul 21 14:39:22.199309 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:22.199313 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq" event={"ID":"4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93","Type":"ContainerDied","Data":"8f1b0806302b9e3b88c35cb28a15fe901d4c106206de14f4cc034b569e74ae32"} Jul 21 14:39:23.346268 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:23.346232 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq" Jul 21 14:39:23.401967 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:23.401923 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93-bundle\") pod \"4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93\" (UID: \"4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93\") " Jul 21 14:39:23.402163 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:23.402001 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddnpx\" (UniqueName: \"kubernetes.io/projected/4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93-kube-api-access-ddnpx\") pod \"4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93\" (UID: \"4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93\") " Jul 21 14:39:23.402163 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:23.402026 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93-util\") pod \"4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93\" (UID: \"4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93\") " Jul 21 14:39:23.402667 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:23.402625 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93-bundle" (OuterVolumeSpecName: "bundle") pod "4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93" (UID: "4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:39:23.404394 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:23.404346 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93-kube-api-access-ddnpx" (OuterVolumeSpecName: "kube-api-access-ddnpx") pod "4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93" (UID: "4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93"). InnerVolumeSpecName "kube-api-access-ddnpx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:39:23.406780 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:23.406735 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93-util" (OuterVolumeSpecName: "util") pod "4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93" (UID: "4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:39:23.502931 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:23.502828 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddnpx\" (UniqueName: \"kubernetes.io/projected/4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93-kube-api-access-ddnpx\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:39:23.502931 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:23.502864 2559 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93-util\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:39:23.502931 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:23.502875 2559 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93-bundle\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:39:24.212369 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:24.212320 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq" event={"ID":"4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93","Type":"ContainerDied","Data":"165ccf82b5e1a7fdaa021cb280ba51d392e46c82df6c010eb1cc42690e7f8b43"} Jul 21 14:39:24.212369 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:24.212374 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="165ccf82b5e1a7fdaa021cb280ba51d392e46c82df6c010eb1cc42690e7f8b43" Jul 21 14:39:24.212647 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:24.212399 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq" Jul 21 14:39:39.475900 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.475783 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv"] Jul 21 14:39:39.476376 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476291 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7" containerName="extract" Jul 21 14:39:39.476376 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476311 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7" containerName="extract" Jul 21 14:39:39.476376 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476325 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5923e0a3-8d11-4cc6-99de-d72974f07495" containerName="pull" Jul 21 14:39:39.476376 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476333 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5923e0a3-8d11-4cc6-99de-d72974f07495" containerName="pull" Jul 21 14:39:39.476376 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476342 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93" containerName="extract" Jul 21 14:39:39.476376 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476349 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93" containerName="extract" Jul 21 14:39:39.476376 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476362 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93" containerName="pull" Jul 21 14:39:39.476376 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476370 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93" containerName="pull" Jul 21 14:39:39.476762 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476392 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93" containerName="util" Jul 21 14:39:39.476762 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476400 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93" containerName="util" Jul 21 14:39:39.476762 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476410 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8490783-5a85-402f-811e-113358f568b7" containerName="extract" Jul 21 14:39:39.476762 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476418 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8490783-5a85-402f-811e-113358f568b7" containerName="extract" Jul 21 14:39:39.476762 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476439 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5923e0a3-8d11-4cc6-99de-d72974f07495" containerName="util" Jul 21 14:39:39.476762 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476447 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5923e0a3-8d11-4cc6-99de-d72974f07495" containerName="util" Jul 21 14:39:39.476762 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476457 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8490783-5a85-402f-811e-113358f568b7" containerName="pull" Jul 21 14:39:39.476762 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476464 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8490783-5a85-402f-811e-113358f568b7" containerName="pull" Jul 21 14:39:39.476762 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476475 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8490783-5a85-402f-811e-113358f568b7" containerName="util" Jul 21 14:39:39.476762 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476485 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8490783-5a85-402f-811e-113358f568b7" containerName="util" Jul 21 14:39:39.476762 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476493 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7" containerName="pull" Jul 21 14:39:39.476762 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476501 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7" containerName="pull" Jul 21 14:39:39.476762 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476513 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7" containerName="util" Jul 21 14:39:39.476762 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476522 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7" containerName="util" Jul 21 14:39:39.476762 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476530 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5923e0a3-8d11-4cc6-99de-d72974f07495" containerName="extract" Jul 21 14:39:39.476762 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476539 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5923e0a3-8d11-4cc6-99de-d72974f07495" containerName="extract" Jul 21 14:39:39.476762 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476624 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93" containerName="extract" Jul 21 14:39:39.476762 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476638 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7" containerName="extract" Jul 21 14:39:39.476762 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476649 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8490783-5a85-402f-811e-113358f568b7" containerName="extract" Jul 21 14:39:39.476762 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.476657 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5923e0a3-8d11-4cc6-99de-d72974f07495" containerName="extract" Jul 21 14:39:39.481924 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.481892 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv" Jul 21 14:39:39.484779 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.484752 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lwd2v\"" Jul 21 14:39:39.484953 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.484911 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 21 14:39:39.485013 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.484990 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 21 14:39:39.494604 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.494572 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv"] Jul 21 14:39:39.543556 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.543498 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3beffcb8-ca66-4873-b506-6445595f12ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hg7tv\" (UID: \"3beffcb8-ca66-4873-b506-6445595f12ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv" Jul 21 14:39:39.543556 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.543565 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctzx2\" (UniqueName: \"kubernetes.io/projected/3beffcb8-ca66-4873-b506-6445595f12ea-kube-api-access-ctzx2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hg7tv\" (UID: \"3beffcb8-ca66-4873-b506-6445595f12ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv" Jul 21 14:39:39.644397 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.644353 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3beffcb8-ca66-4873-b506-6445595f12ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hg7tv\" (UID: \"3beffcb8-ca66-4873-b506-6445595f12ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv" Jul 21 14:39:39.644585 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.644409 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctzx2\" (UniqueName: \"kubernetes.io/projected/3beffcb8-ca66-4873-b506-6445595f12ea-kube-api-access-ctzx2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hg7tv\" (UID: \"3beffcb8-ca66-4873-b506-6445595f12ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv" Jul 21 14:39:39.644758 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.644737 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3beffcb8-ca66-4873-b506-6445595f12ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hg7tv\" (UID: \"3beffcb8-ca66-4873-b506-6445595f12ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv" Jul 21 14:39:39.653361 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.653315 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctzx2\" (UniqueName: \"kubernetes.io/projected/3beffcb8-ca66-4873-b506-6445595f12ea-kube-api-access-ctzx2\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hg7tv\" (UID: \"3beffcb8-ca66-4873-b506-6445595f12ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv" Jul 21 14:39:39.794931 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.794827 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv" Jul 21 14:39:39.955450 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:39.955416 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv"] Jul 21 14:39:39.958862 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:39:39.958661 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3beffcb8_ca66_4873_b506_6445595f12ea.slice/crio-36e38d5c5fe27a70bd055cd3249a2df9e98d4bf7ef039b9dddc0fed5a1d275cd WatchSource:0}: Error finding container 36e38d5c5fe27a70bd055cd3249a2df9e98d4bf7ef039b9dddc0fed5a1d275cd: Status 404 returned error can't find the container with id 36e38d5c5fe27a70bd055cd3249a2df9e98d4bf7ef039b9dddc0fed5a1d275cd Jul 21 14:39:40.312957 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:40.312922 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv" event={"ID":"3beffcb8-ca66-4873-b506-6445595f12ea","Type":"ContainerStarted","Data":"36e38d5c5fe27a70bd055cd3249a2df9e98d4bf7ef039b9dddc0fed5a1d275cd"} Jul 21 14:39:46.348463 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:46.348421 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv" event={"ID":"3beffcb8-ca66-4873-b506-6445595f12ea","Type":"ContainerStarted","Data":"d97b898cc41b5b668e0f45c4324f8f8230cad99cac1ec8a8845f6a4c3fe4d5b9"} Jul 21 14:39:46.348860 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:46.348535 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv" Jul 21 14:39:46.367885 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:46.367834 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv" podStartSLOduration=1.874596937 podStartE2EDuration="7.367819383s" totalImagesPullingTime="5.493222446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:39:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:39:46.366090063 +0000 UTC m=+456.765235243" watchObservedRunningTime="2026-07-21 14:39:46.367819383 +0000 UTC m=+456.766964562" Jul 21 14:39:48.382844 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:48.382810 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-shzzq"] Jul 21 14:39:48.386195 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:48.386176 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-shzzq" Jul 21 14:39:48.388588 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:48.388566 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sftv9\"" Jul 21 14:39:48.388689 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:48.388595 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 21 14:39:48.388689 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:48.388605 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 21 14:39:48.403730 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:48.403706 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-shzzq"] Jul 21 14:39:48.524686 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:48.524653 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/38c8b955-07c1-4aff-8a83-5a502e59110e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-shzzq\" (UID: \"38c8b955-07c1-4aff-8a83-5a502e59110e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-shzzq" Jul 21 14:39:48.524878 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:48.524703 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nb5n7\" (UniqueName: \"kubernetes.io/projected/38c8b955-07c1-4aff-8a83-5a502e59110e-kube-api-access-nb5n7\") pod \"kuadrant-console-plugin-66b5774985-shzzq\" (UID: \"38c8b955-07c1-4aff-8a83-5a502e59110e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-shzzq" Jul 21 14:39:48.524878 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:48.524787 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/38c8b955-07c1-4aff-8a83-5a502e59110e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-shzzq\" (UID: \"38c8b955-07c1-4aff-8a83-5a502e59110e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-shzzq" Jul 21 14:39:48.626170 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:48.626131 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/38c8b955-07c1-4aff-8a83-5a502e59110e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-shzzq\" (UID: \"38c8b955-07c1-4aff-8a83-5a502e59110e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-shzzq" Jul 21 14:39:48.626352 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:48.626190 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/38c8b955-07c1-4aff-8a83-5a502e59110e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-shzzq\" (UID: \"38c8b955-07c1-4aff-8a83-5a502e59110e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-shzzq" Jul 21 14:39:48.626352 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:48.626223 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nb5n7\" (UniqueName: \"kubernetes.io/projected/38c8b955-07c1-4aff-8a83-5a502e59110e-kube-api-access-nb5n7\") pod \"kuadrant-console-plugin-66b5774985-shzzq\" (UID: \"38c8b955-07c1-4aff-8a83-5a502e59110e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-shzzq" Jul 21 14:39:48.626949 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:48.626921 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/38c8b955-07c1-4aff-8a83-5a502e59110e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-shzzq\" (UID: \"38c8b955-07c1-4aff-8a83-5a502e59110e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-shzzq" Jul 21 14:39:48.628628 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:48.628604 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/38c8b955-07c1-4aff-8a83-5a502e59110e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-shzzq\" (UID: \"38c8b955-07c1-4aff-8a83-5a502e59110e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-shzzq" Jul 21 14:39:48.634655 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:48.634583 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nb5n7\" (UniqueName: \"kubernetes.io/projected/38c8b955-07c1-4aff-8a83-5a502e59110e-kube-api-access-nb5n7\") pod \"kuadrant-console-plugin-66b5774985-shzzq\" (UID: \"38c8b955-07c1-4aff-8a83-5a502e59110e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-shzzq" Jul 21 14:39:48.695539 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:48.695489 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-shzzq" Jul 21 14:39:48.830535 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:48.830512 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-shzzq"] Jul 21 14:39:48.832430 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:39:48.832403 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38c8b955_07c1_4aff_8a83_5a502e59110e.slice/crio-facb8e4596e580f8b494e080e433381814d38672d80a7e5e5f4bdd5ed39dbc28 WatchSource:0}: Error finding container facb8e4596e580f8b494e080e433381814d38672d80a7e5e5f4bdd5ed39dbc28: Status 404 returned error can't find the container with id facb8e4596e580f8b494e080e433381814d38672d80a7e5e5f4bdd5ed39dbc28 Jul 21 14:39:49.364094 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:49.364060 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-shzzq" event={"ID":"38c8b955-07c1-4aff-8a83-5a502e59110e","Type":"ContainerStarted","Data":"facb8e4596e580f8b494e080e433381814d38672d80a7e5e5f4bdd5ed39dbc28"} Jul 21 14:39:57.356750 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:57.356718 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv" Jul 21 14:39:59.078426 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:59.078387 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv"] Jul 21 14:39:59.079076 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:59.078623 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv" podUID="3beffcb8-ca66-4873-b506-6445595f12ea" containerName="manager" containerID="cri-o://d97b898cc41b5b668e0f45c4324f8f8230cad99cac1ec8a8845f6a4c3fe4d5b9" gracePeriod=2 Jul 21 14:39:59.090281 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:59.090064 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv"] Jul 21 14:39:59.095747 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:39:59.095705 2559 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3beffcb8-ca66-4873-b506-6445595f12ea\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-hg7tv\": pods \"kuadrant-operator-controller-manager-8684c9ff49-hg7tv\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv" Jul 21 14:39:59.107420 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:59.107389 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx"] Jul 21 14:39:59.107960 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:59.107880 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3beffcb8-ca66-4873-b506-6445595f12ea" containerName="manager" Jul 21 14:39:59.107960 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:59.107902 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="3beffcb8-ca66-4873-b506-6445595f12ea" containerName="manager" Jul 21 14:39:59.108219 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:59.107993 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="3beffcb8-ca66-4873-b506-6445595f12ea" containerName="manager" Jul 21 14:39:59.135380 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:59.134959 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx"] Jul 21 14:39:59.135380 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:59.135131 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx" Jul 21 14:39:59.167601 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:39:59.167556 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hg7tv\" is forbidden: User \"system:node:ip-10-0-131-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-241.ec2.internal' and this object" podUID="3beffcb8-ca66-4873-b506-6445595f12ea" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv" Jul 21 14:39:59.221776 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:59.221743 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e36c629b-5dac-4126-829a-3a9ed2f516b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nhscx\" (UID: \"e36c629b-5dac-4126-829a-3a9ed2f516b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx" Jul 21 14:39:59.221960 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:59.221886 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmxfv\" (UniqueName: \"kubernetes.io/projected/e36c629b-5dac-4126-829a-3a9ed2f516b1-kube-api-access-mmxfv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nhscx\" (UID: \"e36c629b-5dac-4126-829a-3a9ed2f516b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx" Jul 21 14:39:59.322782 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:59.322745 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e36c629b-5dac-4126-829a-3a9ed2f516b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nhscx\" (UID: \"e36c629b-5dac-4126-829a-3a9ed2f516b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx" Jul 21 14:39:59.322985 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:59.322850 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmxfv\" (UniqueName: \"kubernetes.io/projected/e36c629b-5dac-4126-829a-3a9ed2f516b1-kube-api-access-mmxfv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nhscx\" (UID: \"e36c629b-5dac-4126-829a-3a9ed2f516b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx" Jul 21 14:39:59.323182 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:59.323159 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e36c629b-5dac-4126-829a-3a9ed2f516b1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nhscx\" (UID: \"e36c629b-5dac-4126-829a-3a9ed2f516b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx" Jul 21 14:39:59.332164 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:59.332101 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmxfv\" (UniqueName: \"kubernetes.io/projected/e36c629b-5dac-4126-829a-3a9ed2f516b1-kube-api-access-mmxfv\") pod \"kuadrant-operator-controller-manager-8684c9ff49-nhscx\" (UID: \"e36c629b-5dac-4126-829a-3a9ed2f516b1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx" Jul 21 14:39:59.495731 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:39:59.495689 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx" Jul 21 14:40:00.120048 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:40:00.120016 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hg7tv\" is forbidden: User \"system:node:ip-10-0-131-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-241.ec2.internal' and this object" podUID="3beffcb8-ca66-4873-b506-6445595f12ea" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv" Jul 21 14:40:10.119131 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:10.119014 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv" Jul 21 14:40:10.121310 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:40:10.121272 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hg7tv\" is forbidden: User \"system:node:ip-10-0-131-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-241.ec2.internal' and this object" podUID="3beffcb8-ca66-4873-b506-6445595f12ea" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv" Jul 21 14:40:10.121851 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:40:10.121815 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode36c629b_5dac_4126_829a_3a9ed2f516b1.slice/crio-239df569cf5cba3226a9e0e145e9e2b35c1cea0f698f58126bc369b9cf8a23b6 WatchSource:0}: Error finding container 239df569cf5cba3226a9e0e145e9e2b35c1cea0f698f58126bc369b9cf8a23b6: Status 404 returned error can't find the container with id 239df569cf5cba3226a9e0e145e9e2b35c1cea0f698f58126bc369b9cf8a23b6 Jul 21 14:40:10.122638 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:10.122617 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx"] Jul 21 14:40:10.320466 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:10.320390 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctzx2\" (UniqueName: \"kubernetes.io/projected/3beffcb8-ca66-4873-b506-6445595f12ea-kube-api-access-ctzx2\") pod \"3beffcb8-ca66-4873-b506-6445595f12ea\" (UID: \"3beffcb8-ca66-4873-b506-6445595f12ea\") " Jul 21 14:40:10.320600 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:10.320476 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3beffcb8-ca66-4873-b506-6445595f12ea-extensions-socket-volume\") pod \"3beffcb8-ca66-4873-b506-6445595f12ea\" (UID: \"3beffcb8-ca66-4873-b506-6445595f12ea\") " Jul 21 14:40:10.320974 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:10.320946 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3beffcb8-ca66-4873-b506-6445595f12ea-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3beffcb8-ca66-4873-b506-6445595f12ea" (UID: "3beffcb8-ca66-4873-b506-6445595f12ea"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:40:10.322264 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:10.322241 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3beffcb8-ca66-4873-b506-6445595f12ea-kube-api-access-ctzx2" (OuterVolumeSpecName: "kube-api-access-ctzx2") pod "3beffcb8-ca66-4873-b506-6445595f12ea" (UID: "3beffcb8-ca66-4873-b506-6445595f12ea"). InnerVolumeSpecName "kube-api-access-ctzx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:40:10.421004 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:10.420966 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctzx2\" (UniqueName: \"kubernetes.io/projected/3beffcb8-ca66-4873-b506-6445595f12ea-kube-api-access-ctzx2\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:40:10.421004 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:10.420998 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3beffcb8-ca66-4873-b506-6445595f12ea-extensions-socket-volume\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:40:10.490618 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:10.490582 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx" event={"ID":"e36c629b-5dac-4126-829a-3a9ed2f516b1","Type":"ContainerStarted","Data":"a060d1a351900dbcc6b53541832aa1ceb89b0f46b0dcf4b1242cb12a31b59329"} Jul 21 14:40:10.490781 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:10.490634 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx" event={"ID":"e36c629b-5dac-4126-829a-3a9ed2f516b1","Type":"ContainerStarted","Data":"239df569cf5cba3226a9e0e145e9e2b35c1cea0f698f58126bc369b9cf8a23b6"} Jul 21 14:40:10.490781 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:10.490683 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx" Jul 21 14:40:10.492200 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:10.492171 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-shzzq" event={"ID":"38c8b955-07c1-4aff-8a83-5a502e59110e","Type":"ContainerStarted","Data":"8634f61c5a95c2ed70ce5d710f05138f0fe3b878aeb88cd2ec0996e04af72dc8"} Jul 21 14:40:10.493407 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:10.493387 2559 generic.go:356] "Generic (PLEG): container finished" podID="3beffcb8-ca66-4873-b506-6445595f12ea" containerID="d97b898cc41b5b668e0f45c4324f8f8230cad99cac1ec8a8845f6a4c3fe4d5b9" exitCode=0 Jul 21 14:40:10.493531 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:10.493424 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv" Jul 21 14:40:10.493531 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:10.493464 2559 scope.go:117] "RemoveContainer" containerID="d97b898cc41b5b668e0f45c4324f8f8230cad99cac1ec8a8845f6a4c3fe4d5b9" Jul 21 14:40:10.502214 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:10.502195 2559 scope.go:117] "RemoveContainer" containerID="d97b898cc41b5b668e0f45c4324f8f8230cad99cac1ec8a8845f6a4c3fe4d5b9" Jul 21 14:40:10.502493 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:40:10.502474 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d97b898cc41b5b668e0f45c4324f8f8230cad99cac1ec8a8845f6a4c3fe4d5b9\": container with ID starting with d97b898cc41b5b668e0f45c4324f8f8230cad99cac1ec8a8845f6a4c3fe4d5b9 not found: ID does not exist" containerID="d97b898cc41b5b668e0f45c4324f8f8230cad99cac1ec8a8845f6a4c3fe4d5b9" Jul 21 14:40:10.502554 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:10.502500 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d97b898cc41b5b668e0f45c4324f8f8230cad99cac1ec8a8845f6a4c3fe4d5b9"} err="failed to get container status \"d97b898cc41b5b668e0f45c4324f8f8230cad99cac1ec8a8845f6a4c3fe4d5b9\": rpc error: code = NotFound desc = could not find container \"d97b898cc41b5b668e0f45c4324f8f8230cad99cac1ec8a8845f6a4c3fe4d5b9\": container with ID starting with d97b898cc41b5b668e0f45c4324f8f8230cad99cac1ec8a8845f6a4c3fe4d5b9 not found: ID does not exist" Jul 21 14:40:10.511496 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:10.511454 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx" podStartSLOduration=11.511441082 podStartE2EDuration="11.511441082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:39:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:40:10.510190199 +0000 UTC m=+480.909335391" watchObservedRunningTime="2026-07-21 14:40:10.511441082 +0000 UTC m=+480.910586274" Jul 21 14:40:10.512226 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:40:10.512203 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hg7tv\" is forbidden: User \"system:node:ip-10-0-131-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-131-241.ec2.internal' and this object" podUID="3beffcb8-ca66-4873-b506-6445595f12ea" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hg7tv" Jul 21 14:40:10.528155 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:10.528114 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-shzzq" podStartSLOduration=1.2928371109999999 podStartE2EDuration="22.528101756s" totalImagesPullingTime="21.235264645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:39:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:40:10.527285224 +0000 UTC m=+480.926430404" watchObservedRunningTime="2026-07-21 14:40:10.528101756 +0000 UTC m=+480.927246978" Jul 21 14:40:12.120621 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:12.120589 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3beffcb8-ca66-4873-b506-6445595f12ea" path="/var/lib/kubelet/pods/3beffcb8-ca66-4873-b506-6445595f12ea/volumes" Jul 21 14:40:14.998355 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:14.998320 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx"] Jul 21 14:40:14.998748 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:14.998527 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx" podUID="e36c629b-5dac-4126-829a-3a9ed2f516b1" containerName="manager" containerID="cri-o://a060d1a351900dbcc6b53541832aa1ceb89b0f46b0dcf4b1242cb12a31b59329" gracePeriod=10 Jul 21 14:40:15.241232 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.241200 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr"] Jul 21 14:40:15.244968 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.244944 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr" Jul 21 14:40:15.252010 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.251925 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa67f472-29c6-4f08-adb9-d61513abbf4d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2qclr\" (UID: \"fa67f472-29c6-4f08-adb9-d61513abbf4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr" Jul 21 14:40:15.252010 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.252001 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nq58b\" (UniqueName: \"kubernetes.io/projected/fa67f472-29c6-4f08-adb9-d61513abbf4d-kube-api-access-nq58b\") pod \"kuadrant-operator-controller-manager-86878c769f-2qclr\" (UID: \"fa67f472-29c6-4f08-adb9-d61513abbf4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr" Jul 21 14:40:15.256575 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.256551 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx" Jul 21 14:40:15.263495 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.263464 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr"] Jul 21 14:40:15.353060 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.353009 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa67f472-29c6-4f08-adb9-d61513abbf4d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2qclr\" (UID: \"fa67f472-29c6-4f08-adb9-d61513abbf4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr" Jul 21 14:40:15.353225 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.353071 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nq58b\" (UniqueName: \"kubernetes.io/projected/fa67f472-29c6-4f08-adb9-d61513abbf4d-kube-api-access-nq58b\") pod \"kuadrant-operator-controller-manager-86878c769f-2qclr\" (UID: \"fa67f472-29c6-4f08-adb9-d61513abbf4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr" Jul 21 14:40:15.353414 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.353393 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa67f472-29c6-4f08-adb9-d61513abbf4d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2qclr\" (UID: \"fa67f472-29c6-4f08-adb9-d61513abbf4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr" Jul 21 14:40:15.362318 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.362292 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nq58b\" (UniqueName: \"kubernetes.io/projected/fa67f472-29c6-4f08-adb9-d61513abbf4d-kube-api-access-nq58b\") pod \"kuadrant-operator-controller-manager-86878c769f-2qclr\" (UID: \"fa67f472-29c6-4f08-adb9-d61513abbf4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr" Jul 21 14:40:15.453627 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.453589 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e36c629b-5dac-4126-829a-3a9ed2f516b1-extensions-socket-volume\") pod \"e36c629b-5dac-4126-829a-3a9ed2f516b1\" (UID: \"e36c629b-5dac-4126-829a-3a9ed2f516b1\") " Jul 21 14:40:15.453776 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.453639 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmxfv\" (UniqueName: \"kubernetes.io/projected/e36c629b-5dac-4126-829a-3a9ed2f516b1-kube-api-access-mmxfv\") pod \"e36c629b-5dac-4126-829a-3a9ed2f516b1\" (UID: \"e36c629b-5dac-4126-829a-3a9ed2f516b1\") " Jul 21 14:40:15.454018 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.453994 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e36c629b-5dac-4126-829a-3a9ed2f516b1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e36c629b-5dac-4126-829a-3a9ed2f516b1" (UID: "e36c629b-5dac-4126-829a-3a9ed2f516b1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:40:15.455694 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.455673 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e36c629b-5dac-4126-829a-3a9ed2f516b1-kube-api-access-mmxfv" (OuterVolumeSpecName: "kube-api-access-mmxfv") pod "e36c629b-5dac-4126-829a-3a9ed2f516b1" (UID: "e36c629b-5dac-4126-829a-3a9ed2f516b1"). InnerVolumeSpecName "kube-api-access-mmxfv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:40:15.520822 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.520716 2559 generic.go:356] "Generic (PLEG): container finished" podID="e36c629b-5dac-4126-829a-3a9ed2f516b1" containerID="a060d1a351900dbcc6b53541832aa1ceb89b0f46b0dcf4b1242cb12a31b59329" exitCode=0 Jul 21 14:40:15.520822 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.520762 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx" Jul 21 14:40:15.521001 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.520814 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx" event={"ID":"e36c629b-5dac-4126-829a-3a9ed2f516b1","Type":"ContainerDied","Data":"a060d1a351900dbcc6b53541832aa1ceb89b0f46b0dcf4b1242cb12a31b59329"} Jul 21 14:40:15.521001 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.520874 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx" event={"ID":"e36c629b-5dac-4126-829a-3a9ed2f516b1","Type":"ContainerDied","Data":"239df569cf5cba3226a9e0e145e9e2b35c1cea0f698f58126bc369b9cf8a23b6"} Jul 21 14:40:15.521001 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.520899 2559 scope.go:117] "RemoveContainer" containerID="a060d1a351900dbcc6b53541832aa1ceb89b0f46b0dcf4b1242cb12a31b59329" Jul 21 14:40:15.529853 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.529833 2559 scope.go:117] "RemoveContainer" containerID="a060d1a351900dbcc6b53541832aa1ceb89b0f46b0dcf4b1242cb12a31b59329" Jul 21 14:40:15.530086 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:40:15.530070 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a060d1a351900dbcc6b53541832aa1ceb89b0f46b0dcf4b1242cb12a31b59329\": container with ID starting with a060d1a351900dbcc6b53541832aa1ceb89b0f46b0dcf4b1242cb12a31b59329 not found: ID does not exist" containerID="a060d1a351900dbcc6b53541832aa1ceb89b0f46b0dcf4b1242cb12a31b59329" Jul 21 14:40:15.530129 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.530095 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a060d1a351900dbcc6b53541832aa1ceb89b0f46b0dcf4b1242cb12a31b59329"} err="failed to get container status \"a060d1a351900dbcc6b53541832aa1ceb89b0f46b0dcf4b1242cb12a31b59329\": rpc error: code = NotFound desc = could not find container \"a060d1a351900dbcc6b53541832aa1ceb89b0f46b0dcf4b1242cb12a31b59329\": container with ID starting with a060d1a351900dbcc6b53541832aa1ceb89b0f46b0dcf4b1242cb12a31b59329 not found: ID does not exist" Jul 21 14:40:15.547697 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.547673 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx"] Jul 21 14:40:15.554485 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.554458 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e36c629b-5dac-4126-829a-3a9ed2f516b1-extensions-socket-volume\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:40:15.554610 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.554544 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmxfv\" (UniqueName: \"kubernetes.io/projected/e36c629b-5dac-4126-829a-3a9ed2f516b1-kube-api-access-mmxfv\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:40:15.556482 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.556462 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-nhscx"] Jul 21 14:40:15.562184 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.562163 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr" Jul 21 14:40:15.699084 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:15.699059 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr"] Jul 21 14:40:15.700970 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:40:15.700944 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa67f472_29c6_4f08_adb9_d61513abbf4d.slice/crio-f028c93db11dd5ee0c7a424d6195fa88b093ff703afa15e85dd55b946be8f488 WatchSource:0}: Error finding container f028c93db11dd5ee0c7a424d6195fa88b093ff703afa15e85dd55b946be8f488: Status 404 returned error can't find the container with id f028c93db11dd5ee0c7a424d6195fa88b093ff703afa15e85dd55b946be8f488 Jul 21 14:40:16.121089 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:16.121048 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e36c629b-5dac-4126-829a-3a9ed2f516b1" path="/var/lib/kubelet/pods/e36c629b-5dac-4126-829a-3a9ed2f516b1/volumes" Jul 21 14:40:16.528457 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:16.528421 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr" event={"ID":"fa67f472-29c6-4f08-adb9-d61513abbf4d","Type":"ContainerStarted","Data":"8f84fc1688a8739c46e75f502b5845558a1d175dfe16916d191a81c894a51422"} Jul 21 14:40:16.528635 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:16.528471 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr" event={"ID":"fa67f472-29c6-4f08-adb9-d61513abbf4d","Type":"ContainerStarted","Data":"f028c93db11dd5ee0c7a424d6195fa88b093ff703afa15e85dd55b946be8f488"} Jul 21 14:40:16.528635 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:16.528548 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr" Jul 21 14:40:16.550873 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:16.550825 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr" podStartSLOduration=1.550810057 podStartE2EDuration="1.550810057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:40:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:40:16.549360575 +0000 UTC m=+486.948505764" watchObservedRunningTime="2026-07-21 14:40:16.550810057 +0000 UTC m=+486.949955233" Jul 21 14:40:27.535703 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:27.535673 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr" Jul 21 14:40:31.382621 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.382590 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn"] Jul 21 14:40:31.383074 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.382945 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e36c629b-5dac-4126-829a-3a9ed2f516b1" containerName="manager" Jul 21 14:40:31.383074 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.382957 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e36c629b-5dac-4126-829a-3a9ed2f516b1" containerName="manager" Jul 21 14:40:31.383074 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.383022 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e36c629b-5dac-4126-829a-3a9ed2f516b1" containerName="manager" Jul 21 14:40:31.573001 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.572903 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn"] Jul 21 14:40:31.573001 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.572985 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.575942 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.575917 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-x6mq4\"" Jul 21 14:40:31.691645 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.691549 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f113d286-fe9b-4fd2-80e2-1184eea72d4e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.691645 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.691600 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f113d286-fe9b-4fd2-80e2-1184eea72d4e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.691645 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.691625 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wc9x\" (UniqueName: \"kubernetes.io/projected/f113d286-fe9b-4fd2-80e2-1184eea72d4e-kube-api-access-7wc9x\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.691920 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.691708 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f113d286-fe9b-4fd2-80e2-1184eea72d4e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.691920 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.691748 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f113d286-fe9b-4fd2-80e2-1184eea72d4e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.691920 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.691768 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f113d286-fe9b-4fd2-80e2-1184eea72d4e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.691920 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.691827 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f113d286-fe9b-4fd2-80e2-1184eea72d4e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.691920 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.691849 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f113d286-fe9b-4fd2-80e2-1184eea72d4e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.691920 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.691864 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f113d286-fe9b-4fd2-80e2-1184eea72d4e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.792549 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.792510 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f113d286-fe9b-4fd2-80e2-1184eea72d4e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.792549 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.792554 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f113d286-fe9b-4fd2-80e2-1184eea72d4e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.792783 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.792577 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f113d286-fe9b-4fd2-80e2-1184eea72d4e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.792783 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.792616 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f113d286-fe9b-4fd2-80e2-1184eea72d4e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.792783 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.792645 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f113d286-fe9b-4fd2-80e2-1184eea72d4e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.792783 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.792669 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f113d286-fe9b-4fd2-80e2-1184eea72d4e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.792783 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.792712 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f113d286-fe9b-4fd2-80e2-1184eea72d4e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.792783 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.792762 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f113d286-fe9b-4fd2-80e2-1184eea72d4e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.793134 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.792825 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wc9x\" (UniqueName: \"kubernetes.io/projected/f113d286-fe9b-4fd2-80e2-1184eea72d4e-kube-api-access-7wc9x\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.793134 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.792954 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f113d286-fe9b-4fd2-80e2-1184eea72d4e-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.793134 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.792991 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f113d286-fe9b-4fd2-80e2-1184eea72d4e-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.793134 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.793068 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f113d286-fe9b-4fd2-80e2-1184eea72d4e-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.793262 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.793217 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f113d286-fe9b-4fd2-80e2-1184eea72d4e-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.793660 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.793638 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f113d286-fe9b-4fd2-80e2-1184eea72d4e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.794969 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.794952 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f113d286-fe9b-4fd2-80e2-1184eea72d4e-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.795249 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.795234 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f113d286-fe9b-4fd2-80e2-1184eea72d4e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.800726 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.800703 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f113d286-fe9b-4fd2-80e2-1184eea72d4e-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.800999 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.800979 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wc9x\" (UniqueName: \"kubernetes.io/projected/f113d286-fe9b-4fd2-80e2-1184eea72d4e-kube-api-access-7wc9x\") pod \"maas-default-gateway-openshift-default-56654dcf7-4l6jn\" (UID: \"f113d286-fe9b-4fd2-80e2-1184eea72d4e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:31.884056 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:31.884013 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:32.041914 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:32.041887 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn"] Jul 21 14:40:32.043582 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:40:32.043556 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf113d286_fe9b_4fd2_80e2_1184eea72d4e.slice/crio-1179ab1ec75f705a6196f3a80430f0f763326cbdfc76e32522a786f948b767fe WatchSource:0}: Error finding container 1179ab1ec75f705a6196f3a80430f0f763326cbdfc76e32522a786f948b767fe: Status 404 returned error can't find the container with id 1179ab1ec75f705a6196f3a80430f0f763326cbdfc76e32522a786f948b767fe Jul 21 14:40:32.045627 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:32.045587 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 14:40:32.045711 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:32.045667 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 14:40:32.045711 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:32.045698 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 14:40:32.610729 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:32.610696 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" event={"ID":"f113d286-fe9b-4fd2-80e2-1184eea72d4e","Type":"ContainerStarted","Data":"7fb12d9d70f4701fb2d73d3586833a507b5869b3d4e9a5d1e33ce96905d83718"} Jul 21 14:40:32.611146 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:32.610747 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" event={"ID":"f113d286-fe9b-4fd2-80e2-1184eea72d4e","Type":"ContainerStarted","Data":"1179ab1ec75f705a6196f3a80430f0f763326cbdfc76e32522a786f948b767fe"} Jul 21 14:40:32.629570 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:32.629521 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" podStartSLOduration=1.6295048680000002 podStartE2EDuration="1.629504868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:40:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:40:32.628130941 +0000 UTC m=+503.027276120" watchObservedRunningTime="2026-07-21 14:40:32.629504868 +0000 UTC m=+503.028650047" Jul 21 14:40:32.885181 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:32.885078 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:33.889530 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:33.889501 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:34.623286 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:34.623259 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:34.624208 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:34.624187 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:40:46.184005 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:46.183966 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:40:46.219953 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:46.219920 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:40:46.220108 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:46.219965 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:40:46.220108 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:46.220034 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-8h5zq" Jul 21 14:40:46.222832 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:46.222811 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 21 14:40:46.324218 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:46.324166 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d5f187bb-a49d-4ca6-8e1e-c8534f841eaf-config-file\") pod \"limitador-limitador-54d6d988d5-8h5zq\" (UID: \"d5f187bb-a49d-4ca6-8e1e-c8534f841eaf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8h5zq" Jul 21 14:40:46.324218 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:46.324223 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7sq7\" (UniqueName: \"kubernetes.io/projected/d5f187bb-a49d-4ca6-8e1e-c8534f841eaf-kube-api-access-t7sq7\") pod \"limitador-limitador-54d6d988d5-8h5zq\" (UID: \"d5f187bb-a49d-4ca6-8e1e-c8534f841eaf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8h5zq" Jul 21 14:40:46.424854 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:46.424815 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d5f187bb-a49d-4ca6-8e1e-c8534f841eaf-config-file\") pod \"limitador-limitador-54d6d988d5-8h5zq\" (UID: \"d5f187bb-a49d-4ca6-8e1e-c8534f841eaf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8h5zq" Jul 21 14:40:46.425030 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:46.424887 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7sq7\" (UniqueName: \"kubernetes.io/projected/d5f187bb-a49d-4ca6-8e1e-c8534f841eaf-kube-api-access-t7sq7\") pod \"limitador-limitador-54d6d988d5-8h5zq\" (UID: \"d5f187bb-a49d-4ca6-8e1e-c8534f841eaf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8h5zq" Jul 21 14:40:46.425473 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:46.425453 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d5f187bb-a49d-4ca6-8e1e-c8534f841eaf-config-file\") pod \"limitador-limitador-54d6d988d5-8h5zq\" (UID: \"d5f187bb-a49d-4ca6-8e1e-c8534f841eaf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8h5zq" Jul 21 14:40:46.433424 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:46.433393 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7sq7\" (UniqueName: \"kubernetes.io/projected/d5f187bb-a49d-4ca6-8e1e-c8534f841eaf-kube-api-access-t7sq7\") pod \"limitador-limitador-54d6d988d5-8h5zq\" (UID: \"d5f187bb-a49d-4ca6-8e1e-c8534f841eaf\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8h5zq" Jul 21 14:40:46.530915 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:46.530871 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-8h5zq" Jul 21 14:40:46.663024 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:46.662995 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:40:46.664527 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:40:46.664503 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5f187bb_a49d_4ca6_8e1e_c8534f841eaf.slice/crio-2577185fc342007e61352ddb334c5e2817f32bf8c82fa9c4fa80567042184268 WatchSource:0}: Error finding container 2577185fc342007e61352ddb334c5e2817f32bf8c82fa9c4fa80567042184268: Status 404 returned error can't find the container with id 2577185fc342007e61352ddb334c5e2817f32bf8c82fa9c4fa80567042184268 Jul 21 14:40:46.686623 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:46.686595 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-8h5zq" event={"ID":"d5f187bb-a49d-4ca6-8e1e-c8534f841eaf","Type":"ContainerStarted","Data":"2577185fc342007e61352ddb334c5e2817f32bf8c82fa9c4fa80567042184268"} Jul 21 14:40:46.715354 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:46.715323 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-56sn5"] Jul 21 14:40:46.720008 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:46.719991 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-56sn5" Jul 21 14:40:46.722512 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:46.722492 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mg9d8\"" Jul 21 14:40:46.724120 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:46.724096 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-56sn5"] Jul 21 14:40:46.828147 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:46.828060 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2t9p\" (UniqueName: \"kubernetes.io/projected/5f2dd07c-647f-420d-8177-065c479732a4-kube-api-access-l2t9p\") pod \"authorino-75d556bd77-56sn5\" (UID: \"5f2dd07c-647f-420d-8177-065c479732a4\") " pod="kuadrant-system/authorino-75d556bd77-56sn5" Jul 21 14:40:46.929496 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:46.929457 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2t9p\" (UniqueName: \"kubernetes.io/projected/5f2dd07c-647f-420d-8177-065c479732a4-kube-api-access-l2t9p\") pod \"authorino-75d556bd77-56sn5\" (UID: \"5f2dd07c-647f-420d-8177-065c479732a4\") " pod="kuadrant-system/authorino-75d556bd77-56sn5" Jul 21 14:40:46.938482 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:46.938451 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2t9p\" (UniqueName: \"kubernetes.io/projected/5f2dd07c-647f-420d-8177-065c479732a4-kube-api-access-l2t9p\") pod \"authorino-75d556bd77-56sn5\" (UID: \"5f2dd07c-647f-420d-8177-065c479732a4\") " pod="kuadrant-system/authorino-75d556bd77-56sn5" Jul 21 14:40:47.029888 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:47.029849 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-56sn5" Jul 21 14:40:47.216770 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:47.216706 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-56sn5"] Jul 21 14:40:47.218961 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:40:47.218927 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f2dd07c_647f_420d_8177_065c479732a4.slice/crio-8a8309f3c9704754c5337a3c38c87023d63995c5be1323881a063d1a7bc0346d WatchSource:0}: Error finding container 8a8309f3c9704754c5337a3c38c87023d63995c5be1323881a063d1a7bc0346d: Status 404 returned error can't find the container with id 8a8309f3c9704754c5337a3c38c87023d63995c5be1323881a063d1a7bc0346d Jul 21 14:40:47.694895 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:47.694853 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-56sn5" event={"ID":"5f2dd07c-647f-420d-8177-065c479732a4","Type":"ContainerStarted","Data":"8a8309f3c9704754c5337a3c38c87023d63995c5be1323881a063d1a7bc0346d"} Jul 21 14:40:51.718736 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:51.718696 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-56sn5" event={"ID":"5f2dd07c-647f-420d-8177-065c479732a4","Type":"ContainerStarted","Data":"48e3bad73ccbedee62aefd740c04237565b6542080d924e3bcb8ae8f1f426fa0"} Jul 21 14:40:51.720225 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:51.720197 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-8h5zq" event={"ID":"d5f187bb-a49d-4ca6-8e1e-c8534f841eaf","Type":"ContainerStarted","Data":"831548d15c97cc617021d650525cf43a98c1a1a0c2acd3136ac1ffb95253aa4d"} Jul 21 14:40:51.720339 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:51.720281 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-8h5zq" Jul 21 14:40:51.732830 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:51.732769 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-56sn5" podStartSLOduration=1.8640086340000002 podStartE2EDuration="5.732756383s" totalImagesPullingTime="3.868747749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:40:51.731760721 +0000 UTC m=+522.130905911" watchObservedRunningTime="2026-07-21 14:40:51.732756383 +0000 UTC m=+522.131901593" Jul 21 14:40:51.749504 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:40:51.749453 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-8h5zq" podStartSLOduration=1.334413021 podStartE2EDuration="5.749436211s" totalImagesPullingTime="4.41502319s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:40:51.748069016 +0000 UTC m=+522.147214195" watchObservedRunningTime="2026-07-21 14:40:51.749436211 +0000 UTC m=+522.148581405" Jul 21 14:41:02.727301 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:41:02.727222 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-8h5zq" Jul 21 14:41:21.440563 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:41:21.440524 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-56sn5"] Jul 21 14:41:21.441091 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:41:21.440704 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-56sn5" podUID="5f2dd07c-647f-420d-8177-065c479732a4" containerName="authorino" containerID="cri-o://48e3bad73ccbedee62aefd740c04237565b6542080d924e3bcb8ae8f1f426fa0" gracePeriod=30 Jul 21 14:41:21.707338 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:41:21.707312 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-56sn5" Jul 21 14:41:21.831496 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:41:21.831451 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2t9p\" (UniqueName: \"kubernetes.io/projected/5f2dd07c-647f-420d-8177-065c479732a4-kube-api-access-l2t9p\") pod \"5f2dd07c-647f-420d-8177-065c479732a4\" (UID: \"5f2dd07c-647f-420d-8177-065c479732a4\") " Jul 21 14:41:21.833892 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:41:21.833813 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f2dd07c-647f-420d-8177-065c479732a4-kube-api-access-l2t9p" (OuterVolumeSpecName: "kube-api-access-l2t9p") pod "5f2dd07c-647f-420d-8177-065c479732a4" (UID: "5f2dd07c-647f-420d-8177-065c479732a4"). InnerVolumeSpecName "kube-api-access-l2t9p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:41:21.873862 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:41:21.873817 2559 generic.go:356] "Generic (PLEG): container finished" podID="5f2dd07c-647f-420d-8177-065c479732a4" containerID="48e3bad73ccbedee62aefd740c04237565b6542080d924e3bcb8ae8f1f426fa0" exitCode=0 Jul 21 14:41:21.874057 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:41:21.873885 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-56sn5" Jul 21 14:41:21.874057 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:41:21.873890 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-56sn5" event={"ID":"5f2dd07c-647f-420d-8177-065c479732a4","Type":"ContainerDied","Data":"48e3bad73ccbedee62aefd740c04237565b6542080d924e3bcb8ae8f1f426fa0"} Jul 21 14:41:21.874057 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:41:21.873943 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-56sn5" event={"ID":"5f2dd07c-647f-420d-8177-065c479732a4","Type":"ContainerDied","Data":"8a8309f3c9704754c5337a3c38c87023d63995c5be1323881a063d1a7bc0346d"} Jul 21 14:41:21.874057 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:41:21.873967 2559 scope.go:117] "RemoveContainer" containerID="48e3bad73ccbedee62aefd740c04237565b6542080d924e3bcb8ae8f1f426fa0" Jul 21 14:41:21.883317 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:41:21.883299 2559 scope.go:117] "RemoveContainer" containerID="48e3bad73ccbedee62aefd740c04237565b6542080d924e3bcb8ae8f1f426fa0" Jul 21 14:41:21.883647 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:41:21.883628 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48e3bad73ccbedee62aefd740c04237565b6542080d924e3bcb8ae8f1f426fa0\": container with ID starting with 48e3bad73ccbedee62aefd740c04237565b6542080d924e3bcb8ae8f1f426fa0 not found: ID does not exist" containerID="48e3bad73ccbedee62aefd740c04237565b6542080d924e3bcb8ae8f1f426fa0" Jul 21 14:41:21.883696 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:41:21.883657 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48e3bad73ccbedee62aefd740c04237565b6542080d924e3bcb8ae8f1f426fa0"} err="failed to get container status \"48e3bad73ccbedee62aefd740c04237565b6542080d924e3bcb8ae8f1f426fa0\": rpc error: code = NotFound desc = could not find container \"48e3bad73ccbedee62aefd740c04237565b6542080d924e3bcb8ae8f1f426fa0\": container with ID starting with 48e3bad73ccbedee62aefd740c04237565b6542080d924e3bcb8ae8f1f426fa0 not found: ID does not exist" Jul 21 14:41:21.895076 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:41:21.895043 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-56sn5"] Jul 21 14:41:21.897222 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:41:21.897192 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-56sn5"] Jul 21 14:41:21.932658 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:41:21.932617 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2t9p\" (UniqueName: \"kubernetes.io/projected/5f2dd07c-647f-420d-8177-065c479732a4-kube-api-access-l2t9p\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:41:22.120591 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:41:22.120496 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f2dd07c-647f-420d-8177-065c479732a4" path="/var/lib/kubelet/pods/5f2dd07c-647f-420d-8177-065c479732a4/volumes" Jul 21 14:42:01.733096 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:01.733061 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:42:10.059596 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:10.059565 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 14:42:10.060106 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:10.059974 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 14:42:10.124066 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:10.124032 2559 generic.go:356] "Generic (PLEG): container finished" podID="f113d286-fe9b-4fd2-80e2-1184eea72d4e" containerID="7fb12d9d70f4701fb2d73d3586833a507b5869b3d4e9a5d1e33ce96905d83718" exitCode=0 Jul 21 14:42:10.124210 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:10.124099 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" event={"ID":"f113d286-fe9b-4fd2-80e2-1184eea72d4e","Type":"ContainerDied","Data":"7fb12d9d70f4701fb2d73d3586833a507b5869b3d4e9a5d1e33ce96905d83718"} Jul 21 14:42:10.124452 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:10.124437 2559 scope.go:117] "RemoveContainer" containerID="7fb12d9d70f4701fb2d73d3586833a507b5869b3d4e9a5d1e33ce96905d83718" Jul 21 14:42:10.125356 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:10.125327 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 14:42:10.125401 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:10.125391 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 14:42:10.125434 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:10.125423 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 14:42:11.130982 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:11.130947 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" event={"ID":"f113d286-fe9b-4fd2-80e2-1184eea72d4e","Type":"ContainerStarted","Data":"ab93a6919b9d4b5d4e84884e13c38eee8dc3baaf71a30b979bdca6117c402ecb"} Jul 21 14:42:11.884272 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:11.884229 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:42:11.884470 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:11.884445 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-4l6jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 21 14:42:11.884525 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:11.884503 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" podUID="f113d286-fe9b-4fd2-80e2-1184eea72d4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 21 14:42:12.885402 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:12.885364 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-4l6jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 21 14:42:12.885838 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:12.885422 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" podUID="f113d286-fe9b-4fd2-80e2-1184eea72d4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 21 14:42:13.884608 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:13.884567 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-4l6jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 21 14:42:13.884818 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:13.884628 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" podUID="f113d286-fe9b-4fd2-80e2-1184eea72d4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 21 14:42:14.885039 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:14.885001 2559 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-4l6jn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" start-of-body= Jul 21 14:42:14.885451 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:14.885066 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" podUID="f113d286-fe9b-4fd2-80e2-1184eea72d4e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.40:15021/healthz/ready\": dial tcp 10.132.0.40:15021: connect: connection refused" Jul 21 14:42:15.888381 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:15.888347 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:42:15.888767 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:15.888602 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:42:15.889384 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:15.889369 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-4l6jn" Jul 21 14:42:18.404812 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:18.404765 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:42:29.298032 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:29.297995 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:42:36.392551 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:36.392465 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:42:48.193146 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:42:48.193106 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:43:04.290668 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:43:04.290627 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:43:13.294709 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:43:13.294670 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:44:58.485995 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:44:58.485951 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5486f9cb8-g8q9n"] Jul 21 14:44:58.486434 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:44:58.486322 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f2dd07c-647f-420d-8177-065c479732a4" containerName="authorino" Jul 21 14:44:58.486434 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:44:58.486334 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f2dd07c-647f-420d-8177-065c479732a4" containerName="authorino" Jul 21 14:44:58.486434 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:44:58.486403 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f2dd07c-647f-420d-8177-065c479732a4" containerName="authorino" Jul 21 14:44:58.489447 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:44:58.489424 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5486f9cb8-g8q9n" Jul 21 14:44:58.494082 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:44:58.494052 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 21 14:44:58.494260 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:44:58.494052 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mg9d8\"" Jul 21 14:44:58.505371 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:44:58.505334 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5486f9cb8-g8q9n"] Jul 21 14:44:58.603592 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:44:58.603534 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc8dw\" (UniqueName: \"kubernetes.io/projected/1b407ae5-83a1-4c91-a9aa-e03cb3aa0bdd-kube-api-access-dc8dw\") pod \"authorino-5486f9cb8-g8q9n\" (UID: \"1b407ae5-83a1-4c91-a9aa-e03cb3aa0bdd\") " pod="kuadrant-system/authorino-5486f9cb8-g8q9n" Jul 21 14:44:58.603820 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:44:58.603687 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1b407ae5-83a1-4c91-a9aa-e03cb3aa0bdd-tls-cert\") pod \"authorino-5486f9cb8-g8q9n\" (UID: \"1b407ae5-83a1-4c91-a9aa-e03cb3aa0bdd\") " pod="kuadrant-system/authorino-5486f9cb8-g8q9n" Jul 21 14:44:58.704510 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:44:58.704464 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1b407ae5-83a1-4c91-a9aa-e03cb3aa0bdd-tls-cert\") pod \"authorino-5486f9cb8-g8q9n\" (UID: \"1b407ae5-83a1-4c91-a9aa-e03cb3aa0bdd\") " pod="kuadrant-system/authorino-5486f9cb8-g8q9n" Jul 21 14:44:58.704510 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:44:58.704516 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc8dw\" (UniqueName: \"kubernetes.io/projected/1b407ae5-83a1-4c91-a9aa-e03cb3aa0bdd-kube-api-access-dc8dw\") pod \"authorino-5486f9cb8-g8q9n\" (UID: \"1b407ae5-83a1-4c91-a9aa-e03cb3aa0bdd\") " pod="kuadrant-system/authorino-5486f9cb8-g8q9n" Jul 21 14:44:58.707269 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:44:58.707242 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1b407ae5-83a1-4c91-a9aa-e03cb3aa0bdd-tls-cert\") pod \"authorino-5486f9cb8-g8q9n\" (UID: \"1b407ae5-83a1-4c91-a9aa-e03cb3aa0bdd\") " pod="kuadrant-system/authorino-5486f9cb8-g8q9n" Jul 21 14:44:58.712643 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:44:58.712614 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc8dw\" (UniqueName: \"kubernetes.io/projected/1b407ae5-83a1-4c91-a9aa-e03cb3aa0bdd-kube-api-access-dc8dw\") pod \"authorino-5486f9cb8-g8q9n\" (UID: \"1b407ae5-83a1-4c91-a9aa-e03cb3aa0bdd\") " pod="kuadrant-system/authorino-5486f9cb8-g8q9n" Jul 21 14:44:58.800693 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:44:58.800614 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5486f9cb8-g8q9n" Jul 21 14:44:58.951474 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:44:58.951444 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5486f9cb8-g8q9n"] Jul 21 14:44:58.953685 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:44:58.953654 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b407ae5_83a1_4c91_a9aa_e03cb3aa0bdd.slice/crio-4983cdb4c68bb83fa829afddf7e2fa33b6f75833dffea012c6b88a2b8b649acc WatchSource:0}: Error finding container 4983cdb4c68bb83fa829afddf7e2fa33b6f75833dffea012c6b88a2b8b649acc: Status 404 returned error can't find the container with id 4983cdb4c68bb83fa829afddf7e2fa33b6f75833dffea012c6b88a2b8b649acc Jul 21 14:44:58.955180 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:44:58.955155 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 14:44:58.994992 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:44:58.994957 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5486f9cb8-g8q9n" event={"ID":"1b407ae5-83a1-4c91-a9aa-e03cb3aa0bdd","Type":"ContainerStarted","Data":"4983cdb4c68bb83fa829afddf7e2fa33b6f75833dffea012c6b88a2b8b649acc"} Jul 21 14:45:00.002768 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:45:00.002730 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5486f9cb8-g8q9n" event={"ID":"1b407ae5-83a1-4c91-a9aa-e03cb3aa0bdd","Type":"ContainerStarted","Data":"b03b4f28d7d315bb6697e8198a38a032e0180a019193e604abdb537e99d5e77a"} Jul 21 14:45:00.038161 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:45:00.038088 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5486f9cb8-g8q9n" podStartSLOduration=1.602464435 podStartE2EDuration="2.038062967s" totalImagesPullingTime="435.598532ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:44:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:45:00.034935942 +0000 UTC m=+770.434081119" watchObservedRunningTime="2026-07-21 14:45:00.038062967 +0000 UTC m=+770.437208147" Jul 21 14:45:40.001321 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:45:40.001240 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:45:50.696057 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:45:50.696013 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:45:59.907961 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:45:59.907927 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:47:10.091980 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:47:10.091953 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 14:47:10.094447 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:47:10.094086 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 14:47:40.301884 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:47:40.301763 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:47:52.195023 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:47:52.194986 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:48:25.196649 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:48:25.196616 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:48:32.905021 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:48:32.904936 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:48:43.602697 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:48:43.602661 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:48:49.513720 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:48:49.513679 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:48:58.803548 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:48:58.803507 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:49:08.105446 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:49:08.105391 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:49:18.889383 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:49:18.889348 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:49:28.500644 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:49:28.500610 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:49:54.101319 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:49:54.101265 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:50:04.199540 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:50:04.199436 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:50:25.999101 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:50:25.999066 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:50:35.799466 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:50:35.799427 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:50:52.215008 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:50:52.214977 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:51:02.302123 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:51:02.302089 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:51:11.904394 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:51:11.904356 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:51:21.896320 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:51:21.896284 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:51:30.706880 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:51:30.706846 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:51:57.762677 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:51:57.762641 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr"] Jul 21 14:51:57.763179 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:51:57.762865 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr" podUID="fa67f472-29c6-4f08-adb9-d61513abbf4d" containerName="manager" containerID="cri-o://8f84fc1688a8739c46e75f502b5845558a1d175dfe16916d191a81c894a51422" gracePeriod=10 Jul 21 14:51:59.824490 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:51:59.824467 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr" Jul 21 14:51:59.976072 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:51:59.976035 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nq58b\" (UniqueName: \"kubernetes.io/projected/fa67f472-29c6-4f08-adb9-d61513abbf4d-kube-api-access-nq58b\") pod \"fa67f472-29c6-4f08-adb9-d61513abbf4d\" (UID: \"fa67f472-29c6-4f08-adb9-d61513abbf4d\") " Jul 21 14:51:59.976246 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:51:59.976116 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa67f472-29c6-4f08-adb9-d61513abbf4d-extensions-socket-volume\") pod \"fa67f472-29c6-4f08-adb9-d61513abbf4d\" (UID: \"fa67f472-29c6-4f08-adb9-d61513abbf4d\") " Jul 21 14:51:59.976548 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:51:59.976517 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa67f472-29c6-4f08-adb9-d61513abbf4d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fa67f472-29c6-4f08-adb9-d61513abbf4d" (UID: "fa67f472-29c6-4f08-adb9-d61513abbf4d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 14:51:59.978271 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:51:59.978243 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa67f472-29c6-4f08-adb9-d61513abbf4d-kube-api-access-nq58b" (OuterVolumeSpecName: "kube-api-access-nq58b") pod "fa67f472-29c6-4f08-adb9-d61513abbf4d" (UID: "fa67f472-29c6-4f08-adb9-d61513abbf4d"). InnerVolumeSpecName "kube-api-access-nq58b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 14:52:00.077421 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:00.077377 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nq58b\" (UniqueName: \"kubernetes.io/projected/fa67f472-29c6-4f08-adb9-d61513abbf4d-kube-api-access-nq58b\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:52:00.077421 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:00.077414 2559 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa67f472-29c6-4f08-adb9-d61513abbf4d-extensions-socket-volume\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 14:52:00.258656 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:00.258568 2559 generic.go:356] "Generic (PLEG): container finished" podID="fa67f472-29c6-4f08-adb9-d61513abbf4d" containerID="8f84fc1688a8739c46e75f502b5845558a1d175dfe16916d191a81c894a51422" exitCode=0 Jul 21 14:52:00.258656 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:00.258612 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr" Jul 21 14:52:00.258656 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:00.258618 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr" event={"ID":"fa67f472-29c6-4f08-adb9-d61513abbf4d","Type":"ContainerDied","Data":"8f84fc1688a8739c46e75f502b5845558a1d175dfe16916d191a81c894a51422"} Jul 21 14:52:00.258919 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:00.258660 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr" event={"ID":"fa67f472-29c6-4f08-adb9-d61513abbf4d","Type":"ContainerDied","Data":"f028c93db11dd5ee0c7a424d6195fa88b093ff703afa15e85dd55b946be8f488"} Jul 21 14:52:00.258919 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:00.258682 2559 scope.go:117] "RemoveContainer" containerID="8f84fc1688a8739c46e75f502b5845558a1d175dfe16916d191a81c894a51422" Jul 21 14:52:00.268430 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:00.268414 2559 scope.go:117] "RemoveContainer" containerID="8f84fc1688a8739c46e75f502b5845558a1d175dfe16916d191a81c894a51422" Jul 21 14:52:00.268699 ip-10-0-131-241 kubenswrapper[2559]: E0721 14:52:00.268681 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f84fc1688a8739c46e75f502b5845558a1d175dfe16916d191a81c894a51422\": container with ID starting with 8f84fc1688a8739c46e75f502b5845558a1d175dfe16916d191a81c894a51422 not found: ID does not exist" containerID="8f84fc1688a8739c46e75f502b5845558a1d175dfe16916d191a81c894a51422" Jul 21 14:52:00.268747 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:00.268709 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f84fc1688a8739c46e75f502b5845558a1d175dfe16916d191a81c894a51422"} err="failed to get container status \"8f84fc1688a8739c46e75f502b5845558a1d175dfe16916d191a81c894a51422\": rpc error: code = NotFound desc = could not find container \"8f84fc1688a8739c46e75f502b5845558a1d175dfe16916d191a81c894a51422\": container with ID starting with 8f84fc1688a8739c46e75f502b5845558a1d175dfe16916d191a81c894a51422 not found: ID does not exist" Jul 21 14:52:00.277288 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:00.277267 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr"] Jul 21 14:52:00.281517 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:00.281498 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2qclr"] Jul 21 14:52:02.120513 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:02.120477 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa67f472-29c6-4f08-adb9-d61513abbf4d" path="/var/lib/kubelet/pods/fa67f472-29c6-4f08-adb9-d61513abbf4d/volumes" Jul 21 14:52:10.128380 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:10.128271 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 14:52:10.140644 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:10.132014 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 14:52:59.005887 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:59.005856 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhd7m"] Jul 21 14:52:59.006367 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:59.006184 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa67f472-29c6-4f08-adb9-d61513abbf4d" containerName="manager" Jul 21 14:52:59.006367 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:59.006195 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa67f472-29c6-4f08-adb9-d61513abbf4d" containerName="manager" Jul 21 14:52:59.006367 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:59.006247 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa67f472-29c6-4f08-adb9-d61513abbf4d" containerName="manager" Jul 21 14:52:59.009249 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:59.009233 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhd7m" Jul 21 14:52:59.012684 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:59.012664 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lwd2v\"" Jul 21 14:52:59.024472 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:59.024447 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhd7m"] Jul 21 14:52:59.078151 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:59.078118 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32861055-e4d6-4dac-9d9d-2c1b9fd2711d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fhd7m\" (UID: \"32861055-e4d6-4dac-9d9d-2c1b9fd2711d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhd7m" Jul 21 14:52:59.078151 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:59.078162 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7q72\" (UniqueName: \"kubernetes.io/projected/32861055-e4d6-4dac-9d9d-2c1b9fd2711d-kube-api-access-z7q72\") pod \"kuadrant-operator-controller-manager-86878c769f-fhd7m\" (UID: \"32861055-e4d6-4dac-9d9d-2c1b9fd2711d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhd7m" Jul 21 14:52:59.179407 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:59.179366 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32861055-e4d6-4dac-9d9d-2c1b9fd2711d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fhd7m\" (UID: \"32861055-e4d6-4dac-9d9d-2c1b9fd2711d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhd7m" Jul 21 14:52:59.179557 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:59.179416 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7q72\" (UniqueName: \"kubernetes.io/projected/32861055-e4d6-4dac-9d9d-2c1b9fd2711d-kube-api-access-z7q72\") pod \"kuadrant-operator-controller-manager-86878c769f-fhd7m\" (UID: \"32861055-e4d6-4dac-9d9d-2c1b9fd2711d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhd7m" Jul 21 14:52:59.179815 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:59.179773 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/32861055-e4d6-4dac-9d9d-2c1b9fd2711d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fhd7m\" (UID: \"32861055-e4d6-4dac-9d9d-2c1b9fd2711d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhd7m" Jul 21 14:52:59.187862 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:59.187839 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7q72\" (UniqueName: \"kubernetes.io/projected/32861055-e4d6-4dac-9d9d-2c1b9fd2711d-kube-api-access-z7q72\") pod \"kuadrant-operator-controller-manager-86878c769f-fhd7m\" (UID: \"32861055-e4d6-4dac-9d9d-2c1b9fd2711d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhd7m" Jul 21 14:52:59.319126 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:59.319022 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhd7m" Jul 21 14:52:59.459561 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:59.459530 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhd7m"] Jul 21 14:52:59.461494 ip-10-0-131-241 kubenswrapper[2559]: W0721 14:52:59.461473 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32861055_e4d6_4dac_9d9d_2c1b9fd2711d.slice/crio-827031b6f15d05a00a8bddbc59d5dba4a48f7fcc7123bd70ee175b467cb0df08 WatchSource:0}: Error finding container 827031b6f15d05a00a8bddbc59d5dba4a48f7fcc7123bd70ee175b467cb0df08: Status 404 returned error can't find the container with id 827031b6f15d05a00a8bddbc59d5dba4a48f7fcc7123bd70ee175b467cb0df08 Jul 21 14:52:59.559713 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:59.559681 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhd7m" event={"ID":"32861055-e4d6-4dac-9d9d-2c1b9fd2711d","Type":"ContainerStarted","Data":"930a0c46565ef5dac83a263f06bca911216b8950d51166eeadf0eca0205d081d"} Jul 21 14:52:59.559857 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:59.559735 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhd7m" event={"ID":"32861055-e4d6-4dac-9d9d-2c1b9fd2711d","Type":"ContainerStarted","Data":"827031b6f15d05a00a8bddbc59d5dba4a48f7fcc7123bd70ee175b467cb0df08"} Jul 21 14:52:59.559857 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:59.559804 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhd7m" Jul 21 14:52:59.583847 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:52:59.583745 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhd7m" podStartSLOduration=1.5837311889999999 podStartE2EDuration="1.583731189s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 14:52:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 14:52:59.581388366 +0000 UTC m=+1249.980533544" watchObservedRunningTime="2026-07-21 14:52:59.583731189 +0000 UTC m=+1249.982876380" Jul 21 14:53:10.567553 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:53:10.567469 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fhd7m" Jul 21 14:53:19.897613 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:53:19.897567 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:53:31.711900 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:53:31.711863 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:53:41.611454 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:53:41.611417 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:53:53.402565 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:53:53.402528 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:54:05.004111 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:54:05.004071 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:54:16.698840 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:54:16.698803 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:54:24.600358 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:54:24.600322 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:54:35.708753 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:54:35.708716 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:54:46.405015 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:54:46.404979 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:54:55.507595 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:54:55.507557 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:55:06.394755 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:55:06.394717 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:55:30.493095 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:55:30.493062 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:55:38.004162 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:55:38.004125 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:55:47.595131 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:55:47.595085 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:55:59.695192 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:55:59.695147 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:56:44.202274 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:56:44.202236 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:56:58.502357 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:56:58.502315 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:57:05.297776 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:57:05.297720 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:57:10.167311 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:57:10.167190 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 14:57:10.173124 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:57:10.173091 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 14:57:21.302986 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:57:21.302952 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:57:31.803415 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:57:31.803374 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:57:41.698538 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:57:41.698490 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:57:49.899575 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:57:49.899514 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:58:00.710548 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:58:00.710499 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:58:12.199863 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:58:12.199808 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:58:32.099509 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:58:32.099460 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:58:50.597148 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:58:50.597097 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:58:59.501272 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:58:59.501217 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:59:10.296031 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:59:10.295946 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:59:27.506815 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:59:27.506750 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:59:40.801068 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:59:40.801016 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 14:59:51.091447 ip-10-0-131-241 kubenswrapper[2559]: I0721 14:59:51.091391 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:00:00.404083 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:00.404035 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:00:14.398475 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:14.398421 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:00:35.406103 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:35.405787 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:00:42.404840 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.404779 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g"] Jul 21 15:00:42.408522 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.408499 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.411117 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.411090 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c42bc55b-openshift-default-dockercfg-z97ph\"" Jul 21 15:00:42.420270 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.420226 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g"] Jul 21 15:00:42.508118 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.508061 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-workload-socket\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.508118 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.508113 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-workload-certs\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.508423 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.508172 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-credential-socket\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.508423 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.508191 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-istio-envoy\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.508423 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.508210 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zj2rf\" (UniqueName: \"kubernetes.io/projected/2d019175-2efe-412c-833f-6a769948bfb2-kube-api-access-zj2rf\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.508423 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.508231 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-istio-data\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.508423 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.508291 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d019175-2efe-412c-833f-6a769948bfb2-istiod-ca-cert\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.508423 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.508337 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d019175-2efe-412c-833f-6a769948bfb2-istio-token\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.508423 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.508391 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d019175-2efe-412c-833f-6a769948bfb2-istio-podinfo\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.608986 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.608937 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-workload-socket\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.608986 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.608990 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-workload-certs\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.609295 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.609036 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-credential-socket\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.609295 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.609058 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-istio-envoy\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.609295 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.609077 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zj2rf\" (UniqueName: \"kubernetes.io/projected/2d019175-2efe-412c-833f-6a769948bfb2-kube-api-access-zj2rf\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.609295 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.609102 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-istio-data\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.609520 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.609226 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d019175-2efe-412c-833f-6a769948bfb2-istiod-ca-cert\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.609520 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.609402 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d019175-2efe-412c-833f-6a769948bfb2-istio-token\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.609520 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.609448 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-workload-socket\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.609520 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.609452 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d019175-2efe-412c-833f-6a769948bfb2-istio-podinfo\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.609837 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.609809 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-istio-data\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.609837 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.609819 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-workload-certs\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.609996 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.609910 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-credential-socket\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.610232 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.610205 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d019175-2efe-412c-833f-6a769948bfb2-istiod-ca-cert\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.611677 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.611655 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-istio-envoy\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.612189 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.612170 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d019175-2efe-412c-833f-6a769948bfb2-istio-podinfo\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.618144 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.618109 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d019175-2efe-412c-833f-6a769948bfb2-istio-token\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.618354 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.618264 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zj2rf\" (UniqueName: \"kubernetes.io/projected/2d019175-2efe-412c-833f-6a769948bfb2-kube-api-access-zj2rf\") pod \"e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.722059 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.722025 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:42.910742 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.910689 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g"] Jul 21 15:00:42.913299 ip-10-0-131-241 kubenswrapper[2559]: W0721 15:00:42.913255 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d019175_2efe_412c_833f_6a769948bfb2.slice/crio-2bd5ed9f40be7fbb81050ae7d664b54afc3caa5f88d7b51ebaaa89bd685b484d WatchSource:0}: Error finding container 2bd5ed9f40be7fbb81050ae7d664b54afc3caa5f88d7b51ebaaa89bd685b484d: Status 404 returned error can't find the container with id 2bd5ed9f40be7fbb81050ae7d664b54afc3caa5f88d7b51ebaaa89bd685b484d Jul 21 15:00:42.915683 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.915648 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:00:42.915755 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.915725 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:00:42.915822 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:42.915755 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:00:43.138229 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:43.138184 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" event={"ID":"2d019175-2efe-412c-833f-6a769948bfb2","Type":"ContainerStarted","Data":"605d405c486f7fa96ac95f2104f0c0b6ad82845d647029684af00f5d24edb97a"} Jul 21 15:00:43.138448 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:43.138267 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" event={"ID":"2d019175-2efe-412c-833f-6a769948bfb2","Type":"ContainerStarted","Data":"2bd5ed9f40be7fbb81050ae7d664b54afc3caa5f88d7b51ebaaa89bd685b484d"} Jul 21 15:00:43.159982 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:43.159915 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" podStartSLOduration=1.159893634 podStartE2EDuration="1.159893634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:00:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:00:43.157824887 +0000 UTC m=+1713.556970060" watchObservedRunningTime="2026-07-21 15:00:43.159893634 +0000 UTC m=+1713.559038813" Jul 21 15:00:43.722822 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:43.722740 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:43.728390 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:43.728358 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:44.145434 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:44.145339 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:44.146652 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:44.146628 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:00:52.099274 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:00:52.099227 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:01:00.187082 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:00.187020 2559 patch_prober.go:28] interesting pod/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 21 15:01:00.189956 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:00.187126 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" podUID="2d019175-2efe-412c-833f-6a769948bfb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 21 15:01:00.233924 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:00.233889 2559 generic.go:356] "Generic (PLEG): container finished" podID="2d019175-2efe-412c-833f-6a769948bfb2" containerID="605d405c486f7fa96ac95f2104f0c0b6ad82845d647029684af00f5d24edb97a" exitCode=0 Jul 21 15:01:00.234113 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:00.233944 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" event={"ID":"2d019175-2efe-412c-833f-6a769948bfb2","Type":"ContainerDied","Data":"605d405c486f7fa96ac95f2104f0c0b6ad82845d647029684af00f5d24edb97a"} Jul 21 15:01:00.234389 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:00.234372 2559 scope.go:117] "RemoveContainer" containerID="605d405c486f7fa96ac95f2104f0c0b6ad82845d647029684af00f5d24edb97a" Jul 21 15:01:00.235447 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:00.235417 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:01:00.235519 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:00.235491 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:01:00.235556 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:00.235534 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:01:01.246316 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:01.246243 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" event={"ID":"2d019175-2efe-412c-833f-6a769948bfb2","Type":"ContainerStarted","Data":"b10936ab63f61af53927534be95432280d7fcb60b965eb42a5f916dcfb2ee5dd"} Jul 21 15:01:01.722280 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:01.722241 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:01:01.722516 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:01.722489 2559 patch_prober.go:28] interesting pod/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 21 15:01:01.722579 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:01.722545 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" podUID="2d019175-2efe-412c-833f-6a769948bfb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 21 15:01:02.723217 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:02.723176 2559 patch_prober.go:28] interesting pod/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 21 15:01:02.723657 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:02.723239 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" podUID="2d019175-2efe-412c-833f-6a769948bfb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 21 15:01:03.723161 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:03.723118 2559 patch_prober.go:28] interesting pod/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 21 15:01:03.723371 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:03.723179 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" podUID="2d019175-2efe-412c-833f-6a769948bfb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 21 15:01:04.722525 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:04.722486 2559 patch_prober.go:28] interesting pod/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 21 15:01:04.722718 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:04.722581 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" podUID="2d019175-2efe-412c-833f-6a769948bfb2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 21 15:01:05.726900 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:05.726860 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:01:05.727442 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:05.727158 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:01:05.727992 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:05.727975 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:01:23.798674 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:23.798621 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:01:25.299217 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:25.299176 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g"] Jul 21 15:01:25.299648 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:25.299484 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" podUID="2d019175-2efe-412c-833f-6a769948bfb2" containerName="istio-proxy" containerID="cri-o://b10936ab63f61af53927534be95432280d7fcb60b965eb42a5f916dcfb2ee5dd" gracePeriod=30 Jul 21 15:01:26.294143 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.294103 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v"] Jul 21 15:01:26.297984 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.297961 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.300657 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.300626 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-7fd9f867-gw-openshift-default-dockercfg-zxb4g\"" Jul 21 15:01:26.315653 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.315620 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v"] Jul 21 15:01:26.429620 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.429571 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-envoy\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.429620 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.429623 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-credential-socket\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.429912 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.429640 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-token\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.429912 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.429669 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snlv4\" (UniqueName: \"kubernetes.io/projected/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-kube-api-access-snlv4\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.429912 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.429716 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-data\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.429912 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.429731 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-podinfo\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.429912 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.429748 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istiod-ca-cert\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.429912 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.429764 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-workload-socket\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.429912 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.429779 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-workload-certs\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.531290 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.531238 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snlv4\" (UniqueName: \"kubernetes.io/projected/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-kube-api-access-snlv4\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.531539 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.531321 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-data\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.531539 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.531339 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-podinfo\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.531539 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.531356 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istiod-ca-cert\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.531539 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.531379 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-workload-socket\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.531539 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.531398 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-workload-certs\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.531539 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.531443 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-envoy\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.531539 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.531484 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-credential-socket\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.531539 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.531508 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-token\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.532389 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.531999 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-workload-certs\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.532389 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.532032 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-data\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.532389 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.532047 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-workload-socket\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.532389 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.532133 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-credential-socket\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.532617 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.532598 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istiod-ca-cert\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.534711 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.534679 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-envoy\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.534942 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.534925 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-podinfo\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.540755 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.540715 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-token\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.541100 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.541081 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snlv4\" (UniqueName: \"kubernetes.io/projected/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-kube-api-access-snlv4\") pod \"e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.617355 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.617219 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:26.790658 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.790615 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v"] Jul 21 15:01:26.792215 ip-10-0-131-241 kubenswrapper[2559]: W0721 15:01:26.792176 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d9fbfe_db5e_4126_a04e_e6899f3de2c6.slice/crio-c7f272014942ed3d8a3c5477be7cccd4aaa2f95a6bfccdb3c0668042c6943f12 WatchSource:0}: Error finding container c7f272014942ed3d8a3c5477be7cccd4aaa2f95a6bfccdb3c0668042c6943f12: Status 404 returned error can't find the container with id c7f272014942ed3d8a3c5477be7cccd4aaa2f95a6bfccdb3c0668042c6943f12 Jul 21 15:01:26.795092 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.795048 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:01:26.795184 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.795139 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:01:26.795184 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:26.795172 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:01:27.413539 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:27.413499 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" event={"ID":"10d9fbfe-db5e-4126-a04e-e6899f3de2c6","Type":"ContainerStarted","Data":"1f1657a4caf456a4d476854c0afa82ac0e416197f0ac143ae9819cc8daa09f67"} Jul 21 15:01:27.414024 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:27.413568 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" event={"ID":"10d9fbfe-db5e-4126-a04e-e6899f3de2c6","Type":"ContainerStarted","Data":"c7f272014942ed3d8a3c5477be7cccd4aaa2f95a6bfccdb3c0668042c6943f12"} Jul 21 15:01:27.438588 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:27.438524 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" podStartSLOduration=1.4385059 podStartE2EDuration="1.4385059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:01:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:01:27.435005027 +0000 UTC m=+1757.834150207" watchObservedRunningTime="2026-07-21 15:01:27.4385059 +0000 UTC m=+1757.837651078" Jul 21 15:01:27.618230 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:27.618192 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:27.623975 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:27.623939 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:28.419648 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:28.419611 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:28.420609 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:28.420588 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:30.433504 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.433472 2559 generic.go:356] "Generic (PLEG): container finished" podID="2d019175-2efe-412c-833f-6a769948bfb2" containerID="b10936ab63f61af53927534be95432280d7fcb60b965eb42a5f916dcfb2ee5dd" exitCode=0 Jul 21 15:01:30.434076 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.433550 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" event={"ID":"2d019175-2efe-412c-833f-6a769948bfb2","Type":"ContainerDied","Data":"b10936ab63f61af53927534be95432280d7fcb60b965eb42a5f916dcfb2ee5dd"} Jul 21 15:01:30.434076 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.433617 2559 scope.go:117] "RemoveContainer" containerID="605d405c486f7fa96ac95f2104f0c0b6ad82845d647029684af00f5d24edb97a" Jul 21 15:01:30.575997 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.575908 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:01:30.676520 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.676477 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-istio-data\") pod \"2d019175-2efe-412c-833f-6a769948bfb2\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " Jul 21 15:01:30.676520 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.676521 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d019175-2efe-412c-833f-6a769948bfb2-istio-token\") pod \"2d019175-2efe-412c-833f-6a769948bfb2\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " Jul 21 15:01:30.676907 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.676551 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-istio-envoy\") pod \"2d019175-2efe-412c-833f-6a769948bfb2\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " Jul 21 15:01:30.676907 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.676569 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zj2rf\" (UniqueName: \"kubernetes.io/projected/2d019175-2efe-412c-833f-6a769948bfb2-kube-api-access-zj2rf\") pod \"2d019175-2efe-412c-833f-6a769948bfb2\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " Jul 21 15:01:30.676907 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.676600 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d019175-2efe-412c-833f-6a769948bfb2-istio-podinfo\") pod \"2d019175-2efe-412c-833f-6a769948bfb2\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " Jul 21 15:01:30.676907 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.676629 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-credential-socket\") pod \"2d019175-2efe-412c-833f-6a769948bfb2\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " Jul 21 15:01:30.676907 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.676701 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-workload-certs\") pod \"2d019175-2efe-412c-833f-6a769948bfb2\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " Jul 21 15:01:30.676907 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.676747 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d019175-2efe-412c-833f-6a769948bfb2-istiod-ca-cert\") pod \"2d019175-2efe-412c-833f-6a769948bfb2\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " Jul 21 15:01:30.676907 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.676785 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-workload-socket\") pod \"2d019175-2efe-412c-833f-6a769948bfb2\" (UID: \"2d019175-2efe-412c-833f-6a769948bfb2\") " Jul 21 15:01:30.677282 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.677163 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2d019175-2efe-412c-833f-6a769948bfb2" (UID: "2d019175-2efe-412c-833f-6a769948bfb2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:01:30.677352 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.677299 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2d019175-2efe-412c-833f-6a769948bfb2" (UID: "2d019175-2efe-412c-833f-6a769948bfb2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:01:30.677458 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.677436 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2d019175-2efe-412c-833f-6a769948bfb2" (UID: "2d019175-2efe-412c-833f-6a769948bfb2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:01:30.677649 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.677621 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-istio-data" (OuterVolumeSpecName: "istio-data") pod "2d019175-2efe-412c-833f-6a769948bfb2" (UID: "2d019175-2efe-412c-833f-6a769948bfb2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:01:30.677706 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.677648 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d019175-2efe-412c-833f-6a769948bfb2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2d019175-2efe-412c-833f-6a769948bfb2" (UID: "2d019175-2efe-412c-833f-6a769948bfb2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:01:30.679190 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.679166 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2d019175-2efe-412c-833f-6a769948bfb2" (UID: "2d019175-2efe-412c-833f-6a769948bfb2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:01:30.679283 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.679225 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d019175-2efe-412c-833f-6a769948bfb2-kube-api-access-zj2rf" (OuterVolumeSpecName: "kube-api-access-zj2rf") pod "2d019175-2efe-412c-833f-6a769948bfb2" (UID: "2d019175-2efe-412c-833f-6a769948bfb2"). InnerVolumeSpecName "kube-api-access-zj2rf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:01:30.679355 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.679327 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2d019175-2efe-412c-833f-6a769948bfb2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2d019175-2efe-412c-833f-6a769948bfb2" (UID: "2d019175-2efe-412c-833f-6a769948bfb2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 15:01:30.679355 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.679343 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d019175-2efe-412c-833f-6a769948bfb2-istio-token" (OuterVolumeSpecName: "istio-token") pod "2d019175-2efe-412c-833f-6a769948bfb2" (UID: "2d019175-2efe-412c-833f-6a769948bfb2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:01:30.777698 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.777633 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-istio-data\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:01:30.777698 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.777691 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d019175-2efe-412c-833f-6a769948bfb2-istio-token\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:01:30.777698 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.777701 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-istio-envoy\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:01:30.777698 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.777714 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zj2rf\" (UniqueName: \"kubernetes.io/projected/2d019175-2efe-412c-833f-6a769948bfb2-kube-api-access-zj2rf\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:01:30.778066 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.777730 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d019175-2efe-412c-833f-6a769948bfb2-istio-podinfo\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:01:30.778066 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.777739 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-credential-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:01:30.778066 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.777748 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-workload-certs\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:01:30.778066 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.777756 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d019175-2efe-412c-833f-6a769948bfb2-istiod-ca-cert\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:01:30.778066 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:30.777764 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d019175-2efe-412c-833f-6a769948bfb2-workload-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:01:31.442255 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:31.442222 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" Jul 21 15:01:31.442833 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:31.442222 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g" event={"ID":"2d019175-2efe-412c-833f-6a769948bfb2","Type":"ContainerDied","Data":"2bd5ed9f40be7fbb81050ae7d664b54afc3caa5f88d7b51ebaaa89bd685b484d"} Jul 21 15:01:31.442833 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:31.442358 2559 scope.go:117] "RemoveContainer" containerID="b10936ab63f61af53927534be95432280d7fcb60b965eb42a5f916dcfb2ee5dd" Jul 21 15:01:31.467252 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:31.467208 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g"] Jul 21 15:01:31.471289 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:31.471253 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c42bc55b-openshift-default-5ccf9765c9-zs85g"] Jul 21 15:01:32.122194 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:32.122159 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d019175-2efe-412c-833f-6a769948bfb2" path="/var/lib/kubelet/pods/2d019175-2efe-412c-833f-6a769948bfb2/volumes" Jul 21 15:01:35.597845 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:35.597802 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:01:43.962431 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:43.961545 2559 patch_prober.go:28] interesting pod/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": read tcp 10.132.0.2:42580->10.132.0.46:15021: read: connection reset by peer" start-of-body= Jul 21 15:01:43.962431 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:43.961649 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" podUID="10d9fbfe-db5e-4126-a04e-e6899f3de2c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": read tcp 10.132.0.2:42580->10.132.0.46:15021: read: connection reset by peer" Jul 21 15:01:44.521804 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:44.521755 2559 generic.go:356] "Generic (PLEG): container finished" podID="10d9fbfe-db5e-4126-a04e-e6899f3de2c6" containerID="1f1657a4caf456a4d476854c0afa82ac0e416197f0ac143ae9819cc8daa09f67" exitCode=0 Jul 21 15:01:44.522034 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:44.521830 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" event={"ID":"10d9fbfe-db5e-4126-a04e-e6899f3de2c6","Type":"ContainerDied","Data":"1f1657a4caf456a4d476854c0afa82ac0e416197f0ac143ae9819cc8daa09f67"} Jul 21 15:01:44.522352 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:44.522317 2559 scope.go:117] "RemoveContainer" containerID="1f1657a4caf456a4d476854c0afa82ac0e416197f0ac143ae9819cc8daa09f67" Jul 21 15:01:44.523430 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:44.523399 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:01:44.523500 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:44.523478 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:01:44.523538 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:44.523510 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:01:45.530720 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:45.530679 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" event={"ID":"10d9fbfe-db5e-4126-a04e-e6899f3de2c6","Type":"ContainerStarted","Data":"2328f06bce78e6b3fe5bf8e306d2cf65178a8316bd1d0d0577b78739358d214d"} Jul 21 15:01:45.618372 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:45.618338 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:45.618645 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:45.618619 2559 patch_prober.go:28] interesting pod/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 21 15:01:45.618732 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:45.618681 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" podUID="10d9fbfe-db5e-4126-a04e-e6899f3de2c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 21 15:01:46.618403 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:46.618357 2559 patch_prober.go:28] interesting pod/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 21 15:01:46.618870 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:46.618422 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" podUID="10d9fbfe-db5e-4126-a04e-e6899f3de2c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 21 15:01:47.618252 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:47.618207 2559 patch_prober.go:28] interesting pod/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 21 15:01:47.618470 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:47.618283 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" podUID="10d9fbfe-db5e-4126-a04e-e6899f3de2c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 21 15:01:48.618270 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:48.618230 2559 patch_prober.go:28] interesting pod/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 21 15:01:48.618476 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:48.618301 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" podUID="10d9fbfe-db5e-4126-a04e-e6899f3de2c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 21 15:01:49.618013 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:49.617962 2559 patch_prober.go:28] interesting pod/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body= Jul 21 15:01:49.618465 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:49.618423 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" podUID="10d9fbfe-db5e-4126-a04e-e6899f3de2c6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" Jul 21 15:01:50.621487 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:50.621458 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:50.621961 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:50.621725 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:01:50.622733 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:01:50.622717 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:02:07.602359 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:07.602270 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:02:09.113584 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:09.113542 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v"] Jul 21 15:02:09.114129 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:09.113853 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" podUID="10d9fbfe-db5e-4126-a04e-e6899f3de2c6" containerName="istio-proxy" containerID="cri-o://2328f06bce78e6b3fe5bf8e306d2cf65178a8316bd1d0d0577b78739358d214d" gracePeriod=30 Jul 21 15:02:09.947515 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:09.947475 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7"] Jul 21 15:02:09.947969 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:09.947950 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d019175-2efe-412c-833f-6a769948bfb2" containerName="istio-proxy" Jul 21 15:02:09.948076 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:09.947970 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d019175-2efe-412c-833f-6a769948bfb2" containerName="istio-proxy" Jul 21 15:02:09.948076 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:09.948074 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d019175-2efe-412c-833f-6a769948bfb2" containerName="istio-proxy" Jul 21 15:02:09.948177 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:09.948088 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d019175-2efe-412c-833f-6a769948bfb2" containerName="istio-proxy" Jul 21 15:02:09.951588 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:09.951557 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:09.954405 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:09.954374 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2cd63d23-openshift-default-dockercfg-m4gfr\"" Jul 21 15:02:09.964912 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:09.964874 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7"] Jul 21 15:02:09.970397 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:09.970360 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-podinfo\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:09.970632 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:09.970408 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-data\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:09.970632 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:09.970496 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-envoy\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:09.970632 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:09.970526 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-token\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:09.970632 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:09.970551 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/763782ba-ac61-4785-9dcd-7aa4fb14615d-istiod-ca-cert\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:09.970900 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:09.970646 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-workload-socket\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:09.970900 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:09.970675 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs8s9\" (UniqueName: \"kubernetes.io/projected/763782ba-ac61-4785-9dcd-7aa4fb14615d-kube-api-access-xs8s9\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:09.970900 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:09.970759 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-credential-socket\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:09.970900 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:09.970832 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-workload-certs\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:10.071910 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.071871 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-envoy\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:10.072118 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.071917 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-token\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:10.072118 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.072048 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/763782ba-ac61-4785-9dcd-7aa4fb14615d-istiod-ca-cert\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:10.072271 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.072139 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-workload-socket\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:10.072271 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.072167 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs8s9\" (UniqueName: \"kubernetes.io/projected/763782ba-ac61-4785-9dcd-7aa4fb14615d-kube-api-access-xs8s9\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:10.072271 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.072235 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-credential-socket\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:10.072271 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.072266 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-workload-certs\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:10.072483 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.072316 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-podinfo\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:10.072483 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.072353 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-data\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:10.072598 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.072552 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-workload-socket\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:10.072655 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.072615 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-credential-socket\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:10.072772 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.072752 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-data\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:10.072866 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.072821 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-workload-certs\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:10.072866 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.072829 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/763782ba-ac61-4785-9dcd-7aa4fb14615d-istiod-ca-cert\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:10.074494 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.074468 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-envoy\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:10.074851 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.074833 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-podinfo\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:10.080942 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.080906 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-token\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:10.081092 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.081032 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs8s9\" (UniqueName: \"kubernetes.io/projected/763782ba-ac61-4785-9dcd-7aa4fb14615d-kube-api-access-xs8s9\") pod \"e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:10.212566 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.212529 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 15:02:10.216898 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.216868 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 15:02:10.266512 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.266490 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2cd63d23-openshift-default-dockercfg-m4gfr\"" Jul 21 15:02:10.274198 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.274165 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:10.430720 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.430692 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7"] Jul 21 15:02:10.433034 ip-10-0-131-241 kubenswrapper[2559]: W0721 15:02:10.433003 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod763782ba_ac61_4785_9dcd_7aa4fb14615d.slice/crio-5dc8b56a56879e0991e8707f7241f9b9848b7f28801eb14a52aab70de0c7f16b WatchSource:0}: Error finding container 5dc8b56a56879e0991e8707f7241f9b9848b7f28801eb14a52aab70de0c7f16b: Status 404 returned error can't find the container with id 5dc8b56a56879e0991e8707f7241f9b9848b7f28801eb14a52aab70de0c7f16b Jul 21 15:02:10.435895 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.435853 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:02:10.435975 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.435948 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:02:10.436013 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.435991 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:02:10.699154 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.699110 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" event={"ID":"763782ba-ac61-4785-9dcd-7aa4fb14615d","Type":"ContainerStarted","Data":"4226110591acb1a86d410b418351b2c94eb117742933cc4255b8d04baf4a0823"} Jul 21 15:02:10.699383 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.699175 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" event={"ID":"763782ba-ac61-4785-9dcd-7aa4fb14615d","Type":"ContainerStarted","Data":"5dc8b56a56879e0991e8707f7241f9b9848b7f28801eb14a52aab70de0c7f16b"} Jul 21 15:02:10.721751 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:10.721623 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" podStartSLOduration=1.721602223 podStartE2EDuration="1.721602223s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:02:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:10.718249726 +0000 UTC m=+1801.117394907" watchObservedRunningTime="2026-07-21 15:02:10.721602223 +0000 UTC m=+1801.120747414" Jul 21 15:02:11.275336 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:11.275301 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:11.281392 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:11.281347 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:11.704989 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:11.704959 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:11.705968 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:11.705943 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:14.380268 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.380180 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:02:14.412529 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.412494 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-workload-socket\") pod \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " Jul 21 15:02:14.412743 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.412545 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-podinfo\") pod \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " Jul 21 15:02:14.412743 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.412577 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-envoy\") pod \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " Jul 21 15:02:14.412743 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.412620 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istiod-ca-cert\") pod \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " Jul 21 15:02:14.412743 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.412644 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-token\") pod \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " Jul 21 15:02:14.412743 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.412667 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snlv4\" (UniqueName: \"kubernetes.io/projected/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-kube-api-access-snlv4\") pod \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " Jul 21 15:02:14.412743 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.412697 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-data\") pod \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " Jul 21 15:02:14.413089 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.412747 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-credential-socket\") pod \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " Jul 21 15:02:14.413089 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.412779 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-workload-certs\") pod \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\" (UID: \"10d9fbfe-db5e-4126-a04e-e6899f3de2c6\") " Jul 21 15:02:14.413089 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.412872 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "10d9fbfe-db5e-4126-a04e-e6899f3de2c6" (UID: "10d9fbfe-db5e-4126-a04e-e6899f3de2c6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:02:14.413239 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.413124 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-workload-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:02:14.413239 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.413153 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "10d9fbfe-db5e-4126-a04e-e6899f3de2c6" (UID: "10d9fbfe-db5e-4126-a04e-e6899f3de2c6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:02:14.413341 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.413312 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "10d9fbfe-db5e-4126-a04e-e6899f3de2c6" (UID: "10d9fbfe-db5e-4126-a04e-e6899f3de2c6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:02:14.413420 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.413331 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "10d9fbfe-db5e-4126-a04e-e6899f3de2c6" (UID: "10d9fbfe-db5e-4126-a04e-e6899f3de2c6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:02:14.413976 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.413944 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-data" (OuterVolumeSpecName: "istio-data") pod "10d9fbfe-db5e-4126-a04e-e6899f3de2c6" (UID: "10d9fbfe-db5e-4126-a04e-e6899f3de2c6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:02:14.415154 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.415126 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "10d9fbfe-db5e-4126-a04e-e6899f3de2c6" (UID: "10d9fbfe-db5e-4126-a04e-e6899f3de2c6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:02:14.415351 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.415330 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "10d9fbfe-db5e-4126-a04e-e6899f3de2c6" (UID: "10d9fbfe-db5e-4126-a04e-e6899f3de2c6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 15:02:14.415454 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.415437 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-kube-api-access-snlv4" (OuterVolumeSpecName: "kube-api-access-snlv4") pod "10d9fbfe-db5e-4126-a04e-e6899f3de2c6" (UID: "10d9fbfe-db5e-4126-a04e-e6899f3de2c6"). InnerVolumeSpecName "kube-api-access-snlv4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:02:14.415625 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.415608 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-token" (OuterVolumeSpecName: "istio-token") pod "10d9fbfe-db5e-4126-a04e-e6899f3de2c6" (UID: "10d9fbfe-db5e-4126-a04e-e6899f3de2c6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:02:14.513620 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.513576 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-podinfo\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:02:14.513620 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.513612 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-envoy\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:02:14.513620 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.513622 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istiod-ca-cert\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:02:14.513620 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.513630 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-token\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:02:14.513968 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.513639 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snlv4\" (UniqueName: \"kubernetes.io/projected/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-kube-api-access-snlv4\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:02:14.513968 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.513650 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-istio-data\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:02:14.513968 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.513659 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-credential-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:02:14.513968 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.513667 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10d9fbfe-db5e-4126-a04e-e6899f3de2c6-workload-certs\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:02:14.722242 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.722203 2559 generic.go:356] "Generic (PLEG): container finished" podID="10d9fbfe-db5e-4126-a04e-e6899f3de2c6" containerID="2328f06bce78e6b3fe5bf8e306d2cf65178a8316bd1d0d0577b78739358d214d" exitCode=0 Jul 21 15:02:14.722452 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.722267 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" Jul 21 15:02:14.722452 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.722284 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" event={"ID":"10d9fbfe-db5e-4126-a04e-e6899f3de2c6","Type":"ContainerDied","Data":"2328f06bce78e6b3fe5bf8e306d2cf65178a8316bd1d0d0577b78739358d214d"} Jul 21 15:02:14.722452 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.722370 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v" event={"ID":"10d9fbfe-db5e-4126-a04e-e6899f3de2c6","Type":"ContainerDied","Data":"c7f272014942ed3d8a3c5477be7cccd4aaa2f95a6bfccdb3c0668042c6943f12"} Jul 21 15:02:14.722452 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.722394 2559 scope.go:117] "RemoveContainer" containerID="2328f06bce78e6b3fe5bf8e306d2cf65178a8316bd1d0d0577b78739358d214d" Jul 21 15:02:14.732919 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.732899 2559 scope.go:117] "RemoveContainer" containerID="1f1657a4caf456a4d476854c0afa82ac0e416197f0ac143ae9819cc8daa09f67" Jul 21 15:02:14.743289 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.742871 2559 scope.go:117] "RemoveContainer" containerID="2328f06bce78e6b3fe5bf8e306d2cf65178a8316bd1d0d0577b78739358d214d" Jul 21 15:02:14.743867 ip-10-0-131-241 kubenswrapper[2559]: E0721 15:02:14.743786 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2328f06bce78e6b3fe5bf8e306d2cf65178a8316bd1d0d0577b78739358d214d\": container with ID starting with 2328f06bce78e6b3fe5bf8e306d2cf65178a8316bd1d0d0577b78739358d214d not found: ID does not exist" containerID="2328f06bce78e6b3fe5bf8e306d2cf65178a8316bd1d0d0577b78739358d214d" Jul 21 15:02:14.744014 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.743879 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2328f06bce78e6b3fe5bf8e306d2cf65178a8316bd1d0d0577b78739358d214d"} err="failed to get container status \"2328f06bce78e6b3fe5bf8e306d2cf65178a8316bd1d0d0577b78739358d214d\": rpc error: code = NotFound desc = could not find container \"2328f06bce78e6b3fe5bf8e306d2cf65178a8316bd1d0d0577b78739358d214d\": container with ID starting with 2328f06bce78e6b3fe5bf8e306d2cf65178a8316bd1d0d0577b78739358d214d not found: ID does not exist" Jul 21 15:02:14.744014 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.743902 2559 scope.go:117] "RemoveContainer" containerID="1f1657a4caf456a4d476854c0afa82ac0e416197f0ac143ae9819cc8daa09f67" Jul 21 15:02:14.744265 ip-10-0-131-241 kubenswrapper[2559]: E0721 15:02:14.744238 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f1657a4caf456a4d476854c0afa82ac0e416197f0ac143ae9819cc8daa09f67\": container with ID starting with 1f1657a4caf456a4d476854c0afa82ac0e416197f0ac143ae9819cc8daa09f67 not found: ID does not exist" containerID="1f1657a4caf456a4d476854c0afa82ac0e416197f0ac143ae9819cc8daa09f67" Jul 21 15:02:14.744324 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.744265 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f1657a4caf456a4d476854c0afa82ac0e416197f0ac143ae9819cc8daa09f67"} err="failed to get container status \"1f1657a4caf456a4d476854c0afa82ac0e416197f0ac143ae9819cc8daa09f67\": rpc error: code = NotFound desc = could not find container \"1f1657a4caf456a4d476854c0afa82ac0e416197f0ac143ae9819cc8daa09f67\": container with ID starting with 1f1657a4caf456a4d476854c0afa82ac0e416197f0ac143ae9819cc8daa09f67 not found: ID does not exist" Jul 21 15:02:14.746679 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.746604 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v"] Jul 21 15:02:14.749878 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:14.749843 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-7fd9f867-gw-openshift-default-d67864db7-dr25v"] Jul 21 15:02:16.121334 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:16.121299 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10d9fbfe-db5e-4126-a04e-e6899f3de2c6" path="/var/lib/kubelet/pods/10d9fbfe-db5e-4126-a04e-e6899f3de2c6/volumes" Jul 21 15:02:19.694982 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:19.694936 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:02:27.403011 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:27.401622 2559 patch_prober.go:28] interesting pod/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": read tcp 10.132.0.2:45530->10.132.0.47:15021: read: connection reset by peer" start-of-body= Jul 21 15:02:27.403011 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:27.401749 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" podUID="763782ba-ac61-4785-9dcd-7aa4fb14615d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": read tcp 10.132.0.2:45530->10.132.0.47:15021: read: connection reset by peer" Jul 21 15:02:27.806955 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:27.806916 2559 generic.go:356] "Generic (PLEG): container finished" podID="763782ba-ac61-4785-9dcd-7aa4fb14615d" containerID="4226110591acb1a86d410b418351b2c94eb117742933cc4255b8d04baf4a0823" exitCode=0 Jul 21 15:02:27.807189 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:27.806991 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" event={"ID":"763782ba-ac61-4785-9dcd-7aa4fb14615d","Type":"ContainerDied","Data":"4226110591acb1a86d410b418351b2c94eb117742933cc4255b8d04baf4a0823"} Jul 21 15:02:27.807513 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:27.807494 2559 scope.go:117] "RemoveContainer" containerID="4226110591acb1a86d410b418351b2c94eb117742933cc4255b8d04baf4a0823" Jul 21 15:02:27.808654 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:27.808621 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:02:27.808752 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:27.808711 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:02:27.808832 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:27.808763 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:02:28.815212 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:28.815170 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" event={"ID":"763782ba-ac61-4785-9dcd-7aa4fb14615d","Type":"ContainerStarted","Data":"e346f0de6241a2c41ab7414b55f7a031aa2b24b4704f23f818edacd38749360b"} Jul 21 15:02:29.275393 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:29.275346 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:29.275680 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:29.275651 2559 patch_prober.go:28] interesting pod/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 21 15:02:29.275777 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:29.275720 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" podUID="763782ba-ac61-4785-9dcd-7aa4fb14615d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 21 15:02:30.275644 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:30.275599 2559 patch_prober.go:28] interesting pod/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 21 15:02:30.276145 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:30.275673 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" podUID="763782ba-ac61-4785-9dcd-7aa4fb14615d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 21 15:02:31.274717 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:31.274675 2559 patch_prober.go:28] interesting pod/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 21 15:02:31.274970 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:31.274742 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" podUID="763782ba-ac61-4785-9dcd-7aa4fb14615d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 21 15:02:32.274995 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:32.274940 2559 patch_prober.go:28] interesting pod/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 21 15:02:32.275460 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:32.275025 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" podUID="763782ba-ac61-4785-9dcd-7aa4fb14615d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 21 15:02:33.275393 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:33.275355 2559 patch_prober.go:28] interesting pod/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 21 15:02:33.275890 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:33.275415 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" podUID="763782ba-ac61-4785-9dcd-7aa4fb14615d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 21 15:02:34.274863 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:34.274783 2559 patch_prober.go:28] interesting pod/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body= Jul 21 15:02:34.275084 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:34.274883 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" podUID="763782ba-ac61-4785-9dcd-7aa4fb14615d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" Jul 21 15:02:35.278615 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:35.278583 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:35.279049 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:35.278855 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:35.279856 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:35.279836 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:51.300988 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:51.300951 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:02:54.225325 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:54.225285 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7"] Jul 21 15:02:54.225848 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:54.225527 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" podUID="763782ba-ac61-4785-9dcd-7aa4fb14615d" containerName="istio-proxy" containerID="cri-o://e346f0de6241a2c41ab7414b55f7a031aa2b24b4704f23f818edacd38749360b" gracePeriod=30 Jul 21 15:02:54.986858 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:54.986815 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq"] Jul 21 15:02:54.987188 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:54.987176 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d9fbfe-db5e-4126-a04e-e6899f3de2c6" containerName="istio-proxy" Jul 21 15:02:54.987234 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:54.987189 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d9fbfe-db5e-4126-a04e-e6899f3de2c6" containerName="istio-proxy" Jul 21 15:02:54.987234 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:54.987210 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d019175-2efe-412c-833f-6a769948bfb2" containerName="istio-proxy" Jul 21 15:02:54.987234 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:54.987215 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d019175-2efe-412c-833f-6a769948bfb2" containerName="istio-proxy" Jul 21 15:02:54.987331 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:54.987285 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="10d9fbfe-db5e-4126-a04e-e6899f3de2c6" containerName="istio-proxy" Jul 21 15:02:54.990355 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:54.990334 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:54.992806 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:54.992769 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-068a27f9-openshift-default-dockercfg-g95nv\"" Jul 21 15:02:55.004917 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.004878 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-credential-socket\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.005086 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.004950 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-envoy\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.005086 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.005041 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-workload-certs\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.005196 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.005084 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-workload-socket\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.005196 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.005136 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istiod-ca-cert\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.005588 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.005555 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-data\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.005702 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.005603 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdgp5\" (UniqueName: \"kubernetes.io/projected/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-kube-api-access-qdgp5\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.005702 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.005637 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-podinfo\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.005876 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.005668 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-token\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.007138 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.007111 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq"] Jul 21 15:02:55.106438 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.106400 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-credential-socket\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.106438 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.106440 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-envoy\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.106692 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.106479 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-workload-certs\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.106692 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.106500 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-workload-socket\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.106692 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.106515 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istiod-ca-cert\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.106692 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.106535 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-data\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.106692 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.106552 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdgp5\" (UniqueName: \"kubernetes.io/projected/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-kube-api-access-qdgp5\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.106692 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.106575 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-podinfo\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.106692 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.106605 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-token\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.107092 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.106891 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-credential-socket\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.107092 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.107002 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-workload-certs\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.107092 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.107044 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-data\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.107092 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.107076 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-workload-socket\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.107320 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.107263 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istiod-ca-cert\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.109119 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.109095 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-envoy\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.109255 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.109239 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-podinfo\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.115286 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.115258 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-token\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.115408 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.115366 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdgp5\" (UniqueName: \"kubernetes.io/projected/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-kube-api-access-qdgp5\") pod \"e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.308247 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.308145 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:55.463706 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.463674 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq"] Jul 21 15:02:55.467091 ip-10-0-131-241 kubenswrapper[2559]: W0721 15:02:55.467058 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf6f5b84_ac89_41f3_ab24_25f2e2dcb3dd.slice/crio-b117f4cde4faea4ace5ed27e76df5af4e61e028e79b2c2c533e5a46ce702a259 WatchSource:0}: Error finding container b117f4cde4faea4ace5ed27e76df5af4e61e028e79b2c2c533e5a46ce702a259: Status 404 returned error can't find the container with id b117f4cde4faea4ace5ed27e76df5af4e61e028e79b2c2c533e5a46ce702a259 Jul 21 15:02:55.469379 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.469316 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:02:55.469504 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.469433 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:02:55.469576 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.469506 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:02:55.979810 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.979772 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" event={"ID":"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd","Type":"ContainerStarted","Data":"2311ff18c819cf1bea9884ae1f8a31d5d3d2bec6b6eb5dcae444d0de49042f47"} Jul 21 15:02:55.980006 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:55.979834 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" event={"ID":"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd","Type":"ContainerStarted","Data":"b117f4cde4faea4ace5ed27e76df5af4e61e028e79b2c2c533e5a46ce702a259"} Jul 21 15:02:56.003986 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:56.003932 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" podStartSLOduration=2.00391432 podStartE2EDuration="2.00391432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:02:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:02:56.001602262 +0000 UTC m=+1846.400747442" watchObservedRunningTime="2026-07-21 15:02:56.00391432 +0000 UTC m=+1846.403059575" Jul 21 15:02:56.308338 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:56.308239 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:56.314038 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:56.314009 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:56.985475 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:56.985445 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:56.986590 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:56.986565 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:02:59.476923 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.476898 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:02:59.546259 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.546176 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-workload-socket\") pod \"763782ba-ac61-4785-9dcd-7aa4fb14615d\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " Jul 21 15:02:59.546259 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.546220 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-credential-socket\") pod \"763782ba-ac61-4785-9dcd-7aa4fb14615d\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " Jul 21 15:02:59.546259 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.546252 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-token\") pod \"763782ba-ac61-4785-9dcd-7aa4fb14615d\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " Jul 21 15:02:59.546518 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.546273 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/763782ba-ac61-4785-9dcd-7aa4fb14615d-istiod-ca-cert\") pod \"763782ba-ac61-4785-9dcd-7aa4fb14615d\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " Jul 21 15:02:59.546518 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.546294 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-podinfo\") pod \"763782ba-ac61-4785-9dcd-7aa4fb14615d\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " Jul 21 15:02:59.546518 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.546316 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-envoy\") pod \"763782ba-ac61-4785-9dcd-7aa4fb14615d\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " Jul 21 15:02:59.546518 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.546346 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-data\") pod \"763782ba-ac61-4785-9dcd-7aa4fb14615d\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " Jul 21 15:02:59.546518 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.546369 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-workload-certs\") pod \"763782ba-ac61-4785-9dcd-7aa4fb14615d\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " Jul 21 15:02:59.546518 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.546453 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xs8s9\" (UniqueName: \"kubernetes.io/projected/763782ba-ac61-4785-9dcd-7aa4fb14615d-kube-api-access-xs8s9\") pod \"763782ba-ac61-4785-9dcd-7aa4fb14615d\" (UID: \"763782ba-ac61-4785-9dcd-7aa4fb14615d\") " Jul 21 15:02:59.546518 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.546479 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "763782ba-ac61-4785-9dcd-7aa4fb14615d" (UID: "763782ba-ac61-4785-9dcd-7aa4fb14615d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:02:59.546924 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.546639 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "763782ba-ac61-4785-9dcd-7aa4fb14615d" (UID: "763782ba-ac61-4785-9dcd-7aa4fb14615d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:02:59.546924 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.546727 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-workload-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:02:59.546924 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.546740 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "763782ba-ac61-4785-9dcd-7aa4fb14615d" (UID: "763782ba-ac61-4785-9dcd-7aa4fb14615d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:02:59.546924 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.546820 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/763782ba-ac61-4785-9dcd-7aa4fb14615d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "763782ba-ac61-4785-9dcd-7aa4fb14615d" (UID: "763782ba-ac61-4785-9dcd-7aa4fb14615d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:02:59.547384 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.547362 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-data" (OuterVolumeSpecName: "istio-data") pod "763782ba-ac61-4785-9dcd-7aa4fb14615d" (UID: "763782ba-ac61-4785-9dcd-7aa4fb14615d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:02:59.548637 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.548613 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/763782ba-ac61-4785-9dcd-7aa4fb14615d-kube-api-access-xs8s9" (OuterVolumeSpecName: "kube-api-access-xs8s9") pod "763782ba-ac61-4785-9dcd-7aa4fb14615d" (UID: "763782ba-ac61-4785-9dcd-7aa4fb14615d"). InnerVolumeSpecName "kube-api-access-xs8s9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:02:59.548896 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.548862 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "763782ba-ac61-4785-9dcd-7aa4fb14615d" (UID: "763782ba-ac61-4785-9dcd-7aa4fb14615d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 15:02:59.549015 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.548982 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-token" (OuterVolumeSpecName: "istio-token") pod "763782ba-ac61-4785-9dcd-7aa4fb14615d" (UID: "763782ba-ac61-4785-9dcd-7aa4fb14615d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:02:59.549075 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.549025 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "763782ba-ac61-4785-9dcd-7aa4fb14615d" (UID: "763782ba-ac61-4785-9dcd-7aa4fb14615d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:02:59.647327 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.647292 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-credential-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:02:59.647327 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.647322 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-token\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:02:59.647327 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.647332 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/763782ba-ac61-4785-9dcd-7aa4fb14615d-istiod-ca-cert\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:02:59.647630 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.647340 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-podinfo\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:02:59.647630 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.647348 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-envoy\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:02:59.647630 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.647357 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-istio-data\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:02:59.647630 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.647365 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/763782ba-ac61-4785-9dcd-7aa4fb14615d-workload-certs\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:02:59.647630 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:02:59.647372 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xs8s9\" (UniqueName: \"kubernetes.io/projected/763782ba-ac61-4785-9dcd-7aa4fb14615d-kube-api-access-xs8s9\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:03:00.003327 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:00.003292 2559 generic.go:356] "Generic (PLEG): container finished" podID="763782ba-ac61-4785-9dcd-7aa4fb14615d" containerID="e346f0de6241a2c41ab7414b55f7a031aa2b24b4704f23f818edacd38749360b" exitCode=0 Jul 21 15:03:00.003528 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:00.003350 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" Jul 21 15:03:00.003528 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:00.003354 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" event={"ID":"763782ba-ac61-4785-9dcd-7aa4fb14615d","Type":"ContainerDied","Data":"e346f0de6241a2c41ab7414b55f7a031aa2b24b4704f23f818edacd38749360b"} Jul 21 15:03:00.003528 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:00.003504 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7" event={"ID":"763782ba-ac61-4785-9dcd-7aa4fb14615d","Type":"ContainerDied","Data":"5dc8b56a56879e0991e8707f7241f9b9848b7f28801eb14a52aab70de0c7f16b"} Jul 21 15:03:00.003697 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:00.003535 2559 scope.go:117] "RemoveContainer" containerID="e346f0de6241a2c41ab7414b55f7a031aa2b24b4704f23f818edacd38749360b" Jul 21 15:03:00.012983 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:00.012965 2559 scope.go:117] "RemoveContainer" containerID="4226110591acb1a86d410b418351b2c94eb117742933cc4255b8d04baf4a0823" Jul 21 15:03:00.021286 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:00.021270 2559 scope.go:117] "RemoveContainer" containerID="e346f0de6241a2c41ab7414b55f7a031aa2b24b4704f23f818edacd38749360b" Jul 21 15:03:00.021544 ip-10-0-131-241 kubenswrapper[2559]: E0721 15:03:00.021524 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e346f0de6241a2c41ab7414b55f7a031aa2b24b4704f23f818edacd38749360b\": container with ID starting with e346f0de6241a2c41ab7414b55f7a031aa2b24b4704f23f818edacd38749360b not found: ID does not exist" containerID="e346f0de6241a2c41ab7414b55f7a031aa2b24b4704f23f818edacd38749360b" Jul 21 15:03:00.021593 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:00.021554 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e346f0de6241a2c41ab7414b55f7a031aa2b24b4704f23f818edacd38749360b"} err="failed to get container status \"e346f0de6241a2c41ab7414b55f7a031aa2b24b4704f23f818edacd38749360b\": rpc error: code = NotFound desc = could not find container \"e346f0de6241a2c41ab7414b55f7a031aa2b24b4704f23f818edacd38749360b\": container with ID starting with e346f0de6241a2c41ab7414b55f7a031aa2b24b4704f23f818edacd38749360b not found: ID does not exist" Jul 21 15:03:00.021593 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:00.021572 2559 scope.go:117] "RemoveContainer" containerID="4226110591acb1a86d410b418351b2c94eb117742933cc4255b8d04baf4a0823" Jul 21 15:03:00.021785 ip-10-0-131-241 kubenswrapper[2559]: E0721 15:03:00.021769 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4226110591acb1a86d410b418351b2c94eb117742933cc4255b8d04baf4a0823\": container with ID starting with 4226110591acb1a86d410b418351b2c94eb117742933cc4255b8d04baf4a0823 not found: ID does not exist" containerID="4226110591acb1a86d410b418351b2c94eb117742933cc4255b8d04baf4a0823" Jul 21 15:03:00.021938 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:00.021808 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4226110591acb1a86d410b418351b2c94eb117742933cc4255b8d04baf4a0823"} err="failed to get container status \"4226110591acb1a86d410b418351b2c94eb117742933cc4255b8d04baf4a0823\": rpc error: code = NotFound desc = could not find container \"4226110591acb1a86d410b418351b2c94eb117742933cc4255b8d04baf4a0823\": container with ID starting with 4226110591acb1a86d410b418351b2c94eb117742933cc4255b8d04baf4a0823 not found: ID does not exist" Jul 21 15:03:00.028171 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:00.028149 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7"] Jul 21 15:03:00.039007 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:00.038985 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2cd63d23-openshift-default-7995cd8689-4khf7"] Jul 21 15:03:00.121277 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:00.121247 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="763782ba-ac61-4785-9dcd-7aa4fb14615d" path="/var/lib/kubelet/pods/763782ba-ac61-4785-9dcd-7aa4fb14615d/volumes" Jul 21 15:03:02.291263 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:02.291234 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:03:11.066806 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:11.066770 2559 generic.go:356] "Generic (PLEG): container finished" podID="bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" containerID="2311ff18c819cf1bea9884ae1f8a31d5d3d2bec6b6eb5dcae444d0de49042f47" exitCode=0 Jul 21 15:03:11.067224 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:11.066858 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" event={"ID":"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd","Type":"ContainerDied","Data":"2311ff18c819cf1bea9884ae1f8a31d5d3d2bec6b6eb5dcae444d0de49042f47"} Jul 21 15:03:11.067290 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:11.067276 2559 scope.go:117] "RemoveContainer" containerID="2311ff18c819cf1bea9884ae1f8a31d5d3d2bec6b6eb5dcae444d0de49042f47" Jul 21 15:03:11.068393 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:11.068361 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:03:11.068496 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:11.068445 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:03:11.068565 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:11.068505 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:03:11.985679 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:11.985634 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:03:12.073673 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:12.073634 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" event={"ID":"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd","Type":"ContainerStarted","Data":"33c9367f6501a8e1facb55b9fdc8407c24bf65a3c7a2c77b33ce75275a14cebc"} Jul 21 15:03:12.308705 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:12.308611 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:03:12.309849 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:12.309826 2559 patch_prober.go:28] interesting pod/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 21 15:03:12.309961 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:12.309894 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" podUID="bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 21 15:03:13.308616 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:13.308574 2559 patch_prober.go:28] interesting pod/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 21 15:03:13.309040 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:13.308633 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" podUID="bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 21 15:03:14.308716 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:14.308676 2559 patch_prober.go:28] interesting pod/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 21 15:03:14.309147 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:14.308747 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" podUID="bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 21 15:03:15.309009 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:15.308971 2559 patch_prober.go:28] interesting pod/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 21 15:03:15.309417 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:15.309029 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" podUID="bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 21 15:03:16.309110 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:16.309072 2559 patch_prober.go:28] interesting pod/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body= Jul 21 15:03:16.309529 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:16.309134 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" podUID="bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" Jul 21 15:03:17.312318 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:17.312288 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:03:17.312748 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:17.312556 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:03:17.313329 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:17.313312 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:03:35.297726 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:35.297635 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:03:37.436891 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:37.436852 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq"] Jul 21 15:03:37.437306 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:37.437171 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" podUID="bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" containerName="istio-proxy" containerID="cri-o://33c9367f6501a8e1facb55b9fdc8407c24bf65a3c7a2c77b33ce75275a14cebc" gracePeriod=30 Jul 21 15:03:42.694571 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.694545 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:03:42.842848 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.842815 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-workload-socket\") pod \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " Jul 21 15:03:42.843052 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.842864 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-data\") pod \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " Jul 21 15:03:42.843052 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.842882 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qdgp5\" (UniqueName: \"kubernetes.io/projected/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-kube-api-access-qdgp5\") pod \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " Jul 21 15:03:42.843052 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.842933 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-token\") pod \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " Jul 21 15:03:42.843052 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.842967 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-credential-socket\") pod \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " Jul 21 15:03:42.843052 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.842991 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-workload-certs\") pod \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " Jul 21 15:03:42.843052 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.843021 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-envoy\") pod \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " Jul 21 15:03:42.843378 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.843182 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" (UID: "bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:03:42.843378 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.843319 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-podinfo\") pod \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " Jul 21 15:03:42.843489 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.843403 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istiod-ca-cert\") pod \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\" (UID: \"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd\") " Jul 21 15:03:42.843489 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.843314 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" (UID: "bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:03:42.843638 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.843330 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" (UID: "bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:03:42.843729 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.843678 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" (UID: "bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:03:42.843841 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.843789 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-workload-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:03:42.843841 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.843828 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-credential-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:03:42.843993 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.843843 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-workload-certs\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:03:42.843993 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.843856 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istiod-ca-cert\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:03:42.843993 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.843887 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-data" (OuterVolumeSpecName: "istio-data") pod "bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" (UID: "bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:03:42.845802 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.845767 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" (UID: "bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 15:03:42.845867 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.845786 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-kube-api-access-qdgp5" (OuterVolumeSpecName: "kube-api-access-qdgp5") pod "bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" (UID: "bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd"). InnerVolumeSpecName "kube-api-access-qdgp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:03:42.845867 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.845823 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" (UID: "bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:03:42.845867 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.845825 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-token" (OuterVolumeSpecName: "istio-token") pod "bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" (UID: "bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:03:42.944988 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.944953 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-data\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:03:42.944988 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.944983 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qdgp5\" (UniqueName: \"kubernetes.io/projected/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-kube-api-access-qdgp5\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:03:42.944988 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.944995 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-token\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:03:42.945236 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.945004 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-envoy\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:03:42.945236 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:42.945011 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd-istio-podinfo\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:03:43.241675 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:43.241637 2559 generic.go:356] "Generic (PLEG): container finished" podID="bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" containerID="33c9367f6501a8e1facb55b9fdc8407c24bf65a3c7a2c77b33ce75275a14cebc" exitCode=0 Jul 21 15:03:43.241893 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:43.241689 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" Jul 21 15:03:43.241893 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:43.241699 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" event={"ID":"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd","Type":"ContainerDied","Data":"33c9367f6501a8e1facb55b9fdc8407c24bf65a3c7a2c77b33ce75275a14cebc"} Jul 21 15:03:43.241893 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:43.241741 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq" event={"ID":"bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd","Type":"ContainerDied","Data":"b117f4cde4faea4ace5ed27e76df5af4e61e028e79b2c2c533e5a46ce702a259"} Jul 21 15:03:43.241893 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:43.241762 2559 scope.go:117] "RemoveContainer" containerID="33c9367f6501a8e1facb55b9fdc8407c24bf65a3c7a2c77b33ce75275a14cebc" Jul 21 15:03:43.251459 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:43.251438 2559 scope.go:117] "RemoveContainer" containerID="2311ff18c819cf1bea9884ae1f8a31d5d3d2bec6b6eb5dcae444d0de49042f47" Jul 21 15:03:43.259725 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:43.259708 2559 scope.go:117] "RemoveContainer" containerID="33c9367f6501a8e1facb55b9fdc8407c24bf65a3c7a2c77b33ce75275a14cebc" Jul 21 15:03:43.260057 ip-10-0-131-241 kubenswrapper[2559]: E0721 15:03:43.260035 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33c9367f6501a8e1facb55b9fdc8407c24bf65a3c7a2c77b33ce75275a14cebc\": container with ID starting with 33c9367f6501a8e1facb55b9fdc8407c24bf65a3c7a2c77b33ce75275a14cebc not found: ID does not exist" containerID="33c9367f6501a8e1facb55b9fdc8407c24bf65a3c7a2c77b33ce75275a14cebc" Jul 21 15:03:43.260158 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:43.260074 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33c9367f6501a8e1facb55b9fdc8407c24bf65a3c7a2c77b33ce75275a14cebc"} err="failed to get container status \"33c9367f6501a8e1facb55b9fdc8407c24bf65a3c7a2c77b33ce75275a14cebc\": rpc error: code = NotFound desc = could not find container \"33c9367f6501a8e1facb55b9fdc8407c24bf65a3c7a2c77b33ce75275a14cebc\": container with ID starting with 33c9367f6501a8e1facb55b9fdc8407c24bf65a3c7a2c77b33ce75275a14cebc not found: ID does not exist" Jul 21 15:03:43.260158 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:43.260097 2559 scope.go:117] "RemoveContainer" containerID="2311ff18c819cf1bea9884ae1f8a31d5d3d2bec6b6eb5dcae444d0de49042f47" Jul 21 15:03:43.260377 ip-10-0-131-241 kubenswrapper[2559]: E0721 15:03:43.260346 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2311ff18c819cf1bea9884ae1f8a31d5d3d2bec6b6eb5dcae444d0de49042f47\": container with ID starting with 2311ff18c819cf1bea9884ae1f8a31d5d3d2bec6b6eb5dcae444d0de49042f47 not found: ID does not exist" containerID="2311ff18c819cf1bea9884ae1f8a31d5d3d2bec6b6eb5dcae444d0de49042f47" Jul 21 15:03:43.260455 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:43.260378 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2311ff18c819cf1bea9884ae1f8a31d5d3d2bec6b6eb5dcae444d0de49042f47"} err="failed to get container status \"2311ff18c819cf1bea9884ae1f8a31d5d3d2bec6b6eb5dcae444d0de49042f47\": rpc error: code = NotFound desc = could not find container \"2311ff18c819cf1bea9884ae1f8a31d5d3d2bec6b6eb5dcae444d0de49042f47\": container with ID starting with 2311ff18c819cf1bea9884ae1f8a31d5d3d2bec6b6eb5dcae444d0de49042f47 not found: ID does not exist" Jul 21 15:03:43.263283 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:43.263261 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq"] Jul 21 15:03:43.266895 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:43.266876 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-068a27f9-openshift-default-5c47b9b975-v2prq"] Jul 21 15:03:44.120969 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:03:44.120939 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" path="/var/lib/kubelet/pods/bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd/volumes" Jul 21 15:05:02.199745 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:02.199707 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:05:12.910878 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:12.910842 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:05:19.890080 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.890047 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86"] Jul 21 15:05:19.890460 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.890392 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763782ba-ac61-4785-9dcd-7aa4fb14615d" containerName="istio-proxy" Jul 21 15:05:19.890460 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.890404 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="763782ba-ac61-4785-9dcd-7aa4fb14615d" containerName="istio-proxy" Jul 21 15:05:19.890460 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.890423 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" containerName="istio-proxy" Jul 21 15:05:19.890460 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.890429 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" containerName="istio-proxy" Jul 21 15:05:19.890460 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.890440 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10d9fbfe-db5e-4126-a04e-e6899f3de2c6" containerName="istio-proxy" Jul 21 15:05:19.890460 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.890445 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="10d9fbfe-db5e-4126-a04e-e6899f3de2c6" containerName="istio-proxy" Jul 21 15:05:19.890460 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.890458 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" containerName="istio-proxy" Jul 21 15:05:19.890460 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.890463 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" containerName="istio-proxy" Jul 21 15:05:19.890720 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.890524 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="10d9fbfe-db5e-4126-a04e-e6899f3de2c6" containerName="istio-proxy" Jul 21 15:05:19.890720 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.890531 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="763782ba-ac61-4785-9dcd-7aa4fb14615d" containerName="istio-proxy" Jul 21 15:05:19.890720 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.890538 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="763782ba-ac61-4785-9dcd-7aa4fb14615d" containerName="istio-proxy" Jul 21 15:05:19.890720 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.890545 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" containerName="istio-proxy" Jul 21 15:05:19.890720 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.890551 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf6f5b84-ac89-41f3-ab24-25f2e2dcb3dd" containerName="istio-proxy" Jul 21 15:05:19.893573 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.893557 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:19.895810 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.895779 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8f17ef39-openshift-default-dockercfg-hkcqc\"" Jul 21 15:05:19.913311 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.913280 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86"] Jul 21 15:05:19.966683 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.966646 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-podinfo\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:19.966868 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.966693 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-credential-socket\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:19.966868 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.966734 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-token\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:19.966868 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.966784 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-envoy\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:19.967001 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.966871 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb39686a-f18f-4932-abd8-accbd19a8f4f-istiod-ca-cert\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:19.967001 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.966935 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bk4ns\" (UniqueName: \"kubernetes.io/projected/cb39686a-f18f-4932-abd8-accbd19a8f4f-kube-api-access-bk4ns\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:19.967067 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.967012 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-workload-certs\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:19.967067 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.967045 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-workload-socket\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:19.967136 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:19.967071 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-data\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:20.068386 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.068345 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-workload-socket\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:20.068386 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.068392 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-data\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:20.068647 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.068441 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-podinfo\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:20.068647 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.068473 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-credential-socket\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:20.068771 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.068643 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-token\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:20.068771 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.068689 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-envoy\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:20.068771 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.068730 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb39686a-f18f-4932-abd8-accbd19a8f4f-istiod-ca-cert\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:20.068965 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.068769 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-workload-socket\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:20.068965 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.068869 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-credential-socket\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:20.068965 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.068775 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bk4ns\" (UniqueName: \"kubernetes.io/projected/cb39686a-f18f-4932-abd8-accbd19a8f4f-kube-api-access-bk4ns\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:20.069117 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.068963 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-data\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:20.069117 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.068967 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-workload-certs\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:20.069306 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.069286 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-workload-certs\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:20.069503 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.069482 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb39686a-f18f-4932-abd8-accbd19a8f4f-istiod-ca-cert\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:20.071120 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.071093 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-envoy\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:20.071483 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.071461 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-podinfo\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:20.076976 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.076953 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bk4ns\" (UniqueName: \"kubernetes.io/projected/cb39686a-f18f-4932-abd8-accbd19a8f4f-kube-api-access-bk4ns\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:20.077311 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.077290 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-token\") pod \"e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:20.203349 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.203309 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:20.345319 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.345287 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86"] Jul 21 15:05:20.346331 ip-10-0-131-241 kubenswrapper[2559]: W0721 15:05:20.346291 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb39686a_f18f_4932_abd8_accbd19a8f4f.slice/crio-d57ab172547268dca80fa3a659c3cdea265e8adf3d40d9bb2527c02290497af1 WatchSource:0}: Error finding container d57ab172547268dca80fa3a659c3cdea265e8adf3d40d9bb2527c02290497af1: Status 404 returned error can't find the container with id d57ab172547268dca80fa3a659c3cdea265e8adf3d40d9bb2527c02290497af1 Jul 21 15:05:20.348421 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.348390 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:05:20.348501 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.348459 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:05:20.348501 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.348488 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:05:20.763374 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.762874 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" event={"ID":"cb39686a-f18f-4932-abd8-accbd19a8f4f","Type":"ContainerStarted","Data":"f3597248dc95883af9c8342cdeced2c7097d689de34d407faa8e5dcd5bb5a250"} Jul 21 15:05:20.763374 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:20.762973 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" event={"ID":"cb39686a-f18f-4932-abd8-accbd19a8f4f","Type":"ContainerStarted","Data":"d57ab172547268dca80fa3a659c3cdea265e8adf3d40d9bb2527c02290497af1"} Jul 21 15:05:21.204403 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:21.204354 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:21.209060 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:21.209035 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:21.235094 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:21.235034 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" podStartSLOduration=2.235016828 podStartE2EDuration="2.235016828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:05:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:05:20.786853076 +0000 UTC m=+1991.185998256" watchObservedRunningTime="2026-07-21 15:05:21.235016828 +0000 UTC m=+1991.634162017" Jul 21 15:05:21.769174 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:21.769140 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:21.770447 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:21.770416 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:25.403242 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:25.403197 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:05:33.835470 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:33.835436 2559 generic.go:356] "Generic (PLEG): container finished" podID="cb39686a-f18f-4932-abd8-accbd19a8f4f" containerID="f3597248dc95883af9c8342cdeced2c7097d689de34d407faa8e5dcd5bb5a250" exitCode=0 Jul 21 15:05:33.836054 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:33.835494 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" event={"ID":"cb39686a-f18f-4932-abd8-accbd19a8f4f","Type":"ContainerDied","Data":"f3597248dc95883af9c8342cdeced2c7097d689de34d407faa8e5dcd5bb5a250"} Jul 21 15:05:33.836054 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:33.835917 2559 scope.go:117] "RemoveContainer" containerID="f3597248dc95883af9c8342cdeced2c7097d689de34d407faa8e5dcd5bb5a250" Jul 21 15:05:33.836968 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:33.836937 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:05:33.837068 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:33.837005 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:05:33.837068 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:33.837035 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:05:34.844717 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:34.844684 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" event={"ID":"cb39686a-f18f-4932-abd8-accbd19a8f4f","Type":"ContainerStarted","Data":"42a8b0ccd86e70a21f169b90650a0dbdd0bac0f4eef564bca926ab28674bd232"} Jul 21 15:05:35.204105 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:35.204067 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:35.205135 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:35.205108 2559 patch_prober.go:28] interesting pod/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 21 15:05:35.205250 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:35.205161 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" podUID="cb39686a-f18f-4932-abd8-accbd19a8f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 21 15:05:36.204320 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:36.204288 2559 patch_prober.go:28] interesting pod/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 21 15:05:36.204715 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:36.204341 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" podUID="cb39686a-f18f-4932-abd8-accbd19a8f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 21 15:05:36.769713 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:36.769671 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:37.203872 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:37.203837 2559 patch_prober.go:28] interesting pod/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 21 15:05:37.204035 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:37.203900 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" podUID="cb39686a-f18f-4932-abd8-accbd19a8f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 21 15:05:38.204372 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:38.204337 2559 patch_prober.go:28] interesting pod/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 21 15:05:38.204770 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:38.204390 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" podUID="cb39686a-f18f-4932-abd8-accbd19a8f4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 21 15:05:39.210973 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:39.210943 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:39.211936 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:39.211919 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:05:48.091574 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:48.091530 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:05:56.465944 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:56.465910 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86"] Jul 21 15:05:56.466389 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:05:56.466131 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" podUID="cb39686a-f18f-4932-abd8-accbd19a8f4f" containerName="istio-proxy" containerID="cri-o://42a8b0ccd86e70a21f169b90650a0dbdd0bac0f4eef564bca926ab28674bd232" gracePeriod=30 Jul 21 15:06:01.723682 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.723657 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:06:01.852196 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.852102 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bk4ns\" (UniqueName: \"kubernetes.io/projected/cb39686a-f18f-4932-abd8-accbd19a8f4f-kube-api-access-bk4ns\") pod \"cb39686a-f18f-4932-abd8-accbd19a8f4f\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " Jul 21 15:06:01.852196 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.852146 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-token\") pod \"cb39686a-f18f-4932-abd8-accbd19a8f4f\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " Jul 21 15:06:01.852433 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.852222 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-podinfo\") pod \"cb39686a-f18f-4932-abd8-accbd19a8f4f\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " Jul 21 15:06:01.852433 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.852251 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-credential-socket\") pod \"cb39686a-f18f-4932-abd8-accbd19a8f4f\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " Jul 21 15:06:01.852433 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.852272 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-envoy\") pod \"cb39686a-f18f-4932-abd8-accbd19a8f4f\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " Jul 21 15:06:01.852433 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.852311 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-workload-socket\") pod \"cb39686a-f18f-4932-abd8-accbd19a8f4f\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " Jul 21 15:06:01.852433 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.852337 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb39686a-f18f-4932-abd8-accbd19a8f4f-istiod-ca-cert\") pod \"cb39686a-f18f-4932-abd8-accbd19a8f4f\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " Jul 21 15:06:01.852433 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.852367 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-workload-certs\") pod \"cb39686a-f18f-4932-abd8-accbd19a8f4f\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " Jul 21 15:06:01.852433 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.852390 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-data\") pod \"cb39686a-f18f-4932-abd8-accbd19a8f4f\" (UID: \"cb39686a-f18f-4932-abd8-accbd19a8f4f\") " Jul 21 15:06:01.852783 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.852625 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cb39686a-f18f-4932-abd8-accbd19a8f4f" (UID: "cb39686a-f18f-4932-abd8-accbd19a8f4f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:06:01.852953 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.852910 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cb39686a-f18f-4932-abd8-accbd19a8f4f" (UID: "cb39686a-f18f-4932-abd8-accbd19a8f4f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:06:01.853021 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.852976 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cb39686a-f18f-4932-abd8-accbd19a8f4f" (UID: "cb39686a-f18f-4932-abd8-accbd19a8f4f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:06:01.853080 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.853057 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb39686a-f18f-4932-abd8-accbd19a8f4f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cb39686a-f18f-4932-abd8-accbd19a8f4f" (UID: "cb39686a-f18f-4932-abd8-accbd19a8f4f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:06:01.853367 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.853345 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-data" (OuterVolumeSpecName: "istio-data") pod "cb39686a-f18f-4932-abd8-accbd19a8f4f" (UID: "cb39686a-f18f-4932-abd8-accbd19a8f4f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:06:01.854465 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.854438 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-token" (OuterVolumeSpecName: "istio-token") pod "cb39686a-f18f-4932-abd8-accbd19a8f4f" (UID: "cb39686a-f18f-4932-abd8-accbd19a8f4f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:06:01.854555 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.854436 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cb39686a-f18f-4932-abd8-accbd19a8f4f" (UID: "cb39686a-f18f-4932-abd8-accbd19a8f4f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 15:06:01.854834 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.854812 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb39686a-f18f-4932-abd8-accbd19a8f4f-kube-api-access-bk4ns" (OuterVolumeSpecName: "kube-api-access-bk4ns") pod "cb39686a-f18f-4932-abd8-accbd19a8f4f" (UID: "cb39686a-f18f-4932-abd8-accbd19a8f4f"). InnerVolumeSpecName "kube-api-access-bk4ns". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:06:01.854834 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.854815 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cb39686a-f18f-4932-abd8-accbd19a8f4f" (UID: "cb39686a-f18f-4932-abd8-accbd19a8f4f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:06:01.953035 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.953005 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-podinfo\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:06:01.953035 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.953030 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-credential-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:06:01.953035 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.953040 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-envoy\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:06:01.953225 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.953048 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-workload-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:06:01.953225 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.953058 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb39686a-f18f-4932-abd8-accbd19a8f4f-istiod-ca-cert\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:06:01.953225 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.953066 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-workload-certs\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:06:01.953225 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.953073 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-data\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:06:01.953225 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.953081 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bk4ns\" (UniqueName: \"kubernetes.io/projected/cb39686a-f18f-4932-abd8-accbd19a8f4f-kube-api-access-bk4ns\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:06:01.953225 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.953090 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb39686a-f18f-4932-abd8-accbd19a8f4f-istio-token\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:06:01.996182 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.996158 2559 generic.go:356] "Generic (PLEG): container finished" podID="cb39686a-f18f-4932-abd8-accbd19a8f4f" containerID="42a8b0ccd86e70a21f169b90650a0dbdd0bac0f4eef564bca926ab28674bd232" exitCode=0 Jul 21 15:06:01.996281 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.996194 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" event={"ID":"cb39686a-f18f-4932-abd8-accbd19a8f4f","Type":"ContainerDied","Data":"42a8b0ccd86e70a21f169b90650a0dbdd0bac0f4eef564bca926ab28674bd232"} Jul 21 15:06:01.996281 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.996249 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" event={"ID":"cb39686a-f18f-4932-abd8-accbd19a8f4f","Type":"ContainerDied","Data":"d57ab172547268dca80fa3a659c3cdea265e8adf3d40d9bb2527c02290497af1"} Jul 21 15:06:01.996281 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.996271 2559 scope.go:117] "RemoveContainer" containerID="42a8b0ccd86e70a21f169b90650a0dbdd0bac0f4eef564bca926ab28674bd232" Jul 21 15:06:01.996407 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:01.996206 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86" Jul 21 15:06:02.005666 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:02.005516 2559 scope.go:117] "RemoveContainer" containerID="f3597248dc95883af9c8342cdeced2c7097d689de34d407faa8e5dcd5bb5a250" Jul 21 15:06:02.013606 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:02.013586 2559 scope.go:117] "RemoveContainer" containerID="42a8b0ccd86e70a21f169b90650a0dbdd0bac0f4eef564bca926ab28674bd232" Jul 21 15:06:02.013854 ip-10-0-131-241 kubenswrapper[2559]: E0721 15:06:02.013834 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42a8b0ccd86e70a21f169b90650a0dbdd0bac0f4eef564bca926ab28674bd232\": container with ID starting with 42a8b0ccd86e70a21f169b90650a0dbdd0bac0f4eef564bca926ab28674bd232 not found: ID does not exist" containerID="42a8b0ccd86e70a21f169b90650a0dbdd0bac0f4eef564bca926ab28674bd232" Jul 21 15:06:02.013919 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:02.013862 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42a8b0ccd86e70a21f169b90650a0dbdd0bac0f4eef564bca926ab28674bd232"} err="failed to get container status \"42a8b0ccd86e70a21f169b90650a0dbdd0bac0f4eef564bca926ab28674bd232\": rpc error: code = NotFound desc = could not find container \"42a8b0ccd86e70a21f169b90650a0dbdd0bac0f4eef564bca926ab28674bd232\": container with ID starting with 42a8b0ccd86e70a21f169b90650a0dbdd0bac0f4eef564bca926ab28674bd232 not found: ID does not exist" Jul 21 15:06:02.013919 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:02.013878 2559 scope.go:117] "RemoveContainer" containerID="f3597248dc95883af9c8342cdeced2c7097d689de34d407faa8e5dcd5bb5a250" Jul 21 15:06:02.014097 ip-10-0-131-241 kubenswrapper[2559]: E0721 15:06:02.014081 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3597248dc95883af9c8342cdeced2c7097d689de34d407faa8e5dcd5bb5a250\": container with ID starting with f3597248dc95883af9c8342cdeced2c7097d689de34d407faa8e5dcd5bb5a250 not found: ID does not exist" containerID="f3597248dc95883af9c8342cdeced2c7097d689de34d407faa8e5dcd5bb5a250" Jul 21 15:06:02.014137 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:02.014103 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3597248dc95883af9c8342cdeced2c7097d689de34d407faa8e5dcd5bb5a250"} err="failed to get container status \"f3597248dc95883af9c8342cdeced2c7097d689de34d407faa8e5dcd5bb5a250\": rpc error: code = NotFound desc = could not find container \"f3597248dc95883af9c8342cdeced2c7097d689de34d407faa8e5dcd5bb5a250\": container with ID starting with f3597248dc95883af9c8342cdeced2c7097d689de34d407faa8e5dcd5bb5a250 not found: ID does not exist" Jul 21 15:06:02.018106 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:02.018085 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86"] Jul 21 15:06:02.021781 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:02.021761 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8f17ef39-openshift-default-d7b96ff7f-csc86"] Jul 21 15:06:02.120640 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:02.120571 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb39686a-f18f-4932-abd8-accbd19a8f4f" path="/var/lib/kubelet/pods/cb39686a-f18f-4932-abd8-accbd19a8f4f/volumes" Jul 21 15:06:16.271868 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.271834 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm"] Jul 21 15:06:16.272317 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.272190 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb39686a-f18f-4932-abd8-accbd19a8f4f" containerName="istio-proxy" Jul 21 15:06:16.272317 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.272202 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb39686a-f18f-4932-abd8-accbd19a8f4f" containerName="istio-proxy" Jul 21 15:06:16.272317 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.272226 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="763782ba-ac61-4785-9dcd-7aa4fb14615d" containerName="istio-proxy" Jul 21 15:06:16.272317 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.272232 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="763782ba-ac61-4785-9dcd-7aa4fb14615d" containerName="istio-proxy" Jul 21 15:06:16.272317 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.272305 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb39686a-f18f-4932-abd8-accbd19a8f4f" containerName="istio-proxy" Jul 21 15:06:16.275272 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.275254 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.277684 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.277659 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-5e94d052-openshift-default-dockercfg-xrxz8\"" Jul 21 15:06:16.288439 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.288414 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm"] Jul 21 15:06:16.371388 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.371349 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p6zl\" (UniqueName: \"kubernetes.io/projected/bfa8c64b-e23c-4460-92d5-64561398602d-kube-api-access-9p6zl\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.371388 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.371384 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-workload-certs\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.371718 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.371455 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-istio-data\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.371718 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.371496 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-credential-socket\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.371718 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.371539 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-istio-envoy\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.371718 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.371555 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfa8c64b-e23c-4460-92d5-64561398602d-istio-token\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.371718 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.371661 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfa8c64b-e23c-4460-92d5-64561398602d-istio-podinfo\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.371718 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.371681 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-workload-socket\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.371718 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.371701 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfa8c64b-e23c-4460-92d5-64561398602d-istiod-ca-cert\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.472774 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.472738 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfa8c64b-e23c-4460-92d5-64561398602d-istio-podinfo\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.472774 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.472778 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-workload-socket\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.473003 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.472912 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfa8c64b-e23c-4460-92d5-64561398602d-istiod-ca-cert\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.473003 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.472973 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p6zl\" (UniqueName: \"kubernetes.io/projected/bfa8c64b-e23c-4460-92d5-64561398602d-kube-api-access-9p6zl\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.473087 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.473006 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-workload-certs\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.473087 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.473063 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-istio-data\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.473180 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.473092 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-credential-socket\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.473644 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.473432 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-workload-socket\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.473856 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.473833 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-workload-certs\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.473948 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.473148 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-istio-envoy\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.474008 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.473836 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-istio-data\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.474064 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.473947 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfa8c64b-e23c-4460-92d5-64561398602d-istio-token\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.474331 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.474306 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-credential-socket\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.474612 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.474590 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfa8c64b-e23c-4460-92d5-64561398602d-istiod-ca-cert\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.478774 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.477336 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfa8c64b-e23c-4460-92d5-64561398602d-istio-podinfo\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.481868 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.481837 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-istio-envoy\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.483063 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.483040 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfa8c64b-e23c-4460-92d5-64561398602d-istio-token\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.483379 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.483359 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p6zl\" (UniqueName: \"kubernetes.io/projected/bfa8c64b-e23c-4460-92d5-64561398602d-kube-api-access-9p6zl\") pod \"e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.585350 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.585246 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:16.730579 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.730550 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm"] Jul 21 15:06:16.732159 ip-10-0-131-241 kubenswrapper[2559]: W0721 15:06:16.732131 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfa8c64b_e23c_4460_92d5_64561398602d.slice/crio-55abd17816acc44eae950335af3de8ddcfc2b70c8cd64a486edc3de45a8f5776 WatchSource:0}: Error finding container 55abd17816acc44eae950335af3de8ddcfc2b70c8cd64a486edc3de45a8f5776: Status 404 returned error can't find the container with id 55abd17816acc44eae950335af3de8ddcfc2b70c8cd64a486edc3de45a8f5776 Jul 21 15:06:16.734149 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.734114 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:06:16.734235 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.734183 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:06:16.734235 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:16.734212 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:06:17.077867 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:17.077829 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" event={"ID":"bfa8c64b-e23c-4460-92d5-64561398602d","Type":"ContainerStarted","Data":"02b4f1f1708499f444b57d6d70ba12f5397a177232bacfd1780eead836f165e0"} Jul 21 15:06:17.078043 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:17.077889 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" event={"ID":"bfa8c64b-e23c-4460-92d5-64561398602d","Type":"ContainerStarted","Data":"55abd17816acc44eae950335af3de8ddcfc2b70c8cd64a486edc3de45a8f5776"} Jul 21 15:06:17.099012 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:17.098965 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" podStartSLOduration=1.098951431 podStartE2EDuration="1.098951431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:06:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:06:17.098034112 +0000 UTC m=+2047.497179292" watchObservedRunningTime="2026-07-21 15:06:17.098951431 +0000 UTC m=+2047.498096621" Jul 21 15:06:17.585609 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:17.585572 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:17.590539 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:17.590516 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:18.083146 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:18.083108 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:18.084118 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:18.084098 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:24.312459 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:24.312424 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:06:33.084841 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:33.084736 2559 patch_prober.go:28] interesting pod/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 21 15:06:33.084841 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:33.084787 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" podUID="bfa8c64b-e23c-4460-92d5-64561398602d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 21 15:06:33.166406 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:33.166378 2559 generic.go:356] "Generic (PLEG): container finished" podID="bfa8c64b-e23c-4460-92d5-64561398602d" containerID="02b4f1f1708499f444b57d6d70ba12f5397a177232bacfd1780eead836f165e0" exitCode=0 Jul 21 15:06:33.166579 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:33.166457 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" event={"ID":"bfa8c64b-e23c-4460-92d5-64561398602d","Type":"ContainerDied","Data":"02b4f1f1708499f444b57d6d70ba12f5397a177232bacfd1780eead836f165e0"} Jul 21 15:06:33.166908 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:33.166894 2559 scope.go:117] "RemoveContainer" containerID="02b4f1f1708499f444b57d6d70ba12f5397a177232bacfd1780eead836f165e0" Jul 21 15:06:33.167878 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:33.167852 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:06:33.167937 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:33.167926 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:06:33.167978 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:33.167959 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:06:34.174678 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:34.174645 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" event={"ID":"bfa8c64b-e23c-4460-92d5-64561398602d","Type":"ContainerStarted","Data":"79616fdd7f6ec75c6e0121d9374fa6306e70137e8cf8950d2da695240b4468a7"} Jul 21 15:06:34.585648 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:34.585608 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:34.585859 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:34.585834 2559 patch_prober.go:28] interesting pod/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 21 15:06:34.585913 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:34.585881 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" podUID="bfa8c64b-e23c-4460-92d5-64561398602d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 21 15:06:35.585898 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:35.585862 2559 patch_prober.go:28] interesting pod/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 21 15:06:35.586313 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:35.585937 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" podUID="bfa8c64b-e23c-4460-92d5-64561398602d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 21 15:06:36.585620 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:36.585581 2559 patch_prober.go:28] interesting pod/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 21 15:06:36.585954 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:36.585924 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" podUID="bfa8c64b-e23c-4460-92d5-64561398602d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 21 15:06:37.586051 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:37.586014 2559 patch_prober.go:28] interesting pod/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 21 15:06:37.586451 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:37.586071 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" podUID="bfa8c64b-e23c-4460-92d5-64561398602d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 21 15:06:38.586272 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:38.586232 2559 patch_prober.go:28] interesting pod/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" start-of-body= Jul 21 15:06:38.586678 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:38.586292 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" podUID="bfa8c64b-e23c-4460-92d5-64561398602d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.50:15021/healthz/ready\": dial tcp 10.132.0.50:15021: connect: connection refused" Jul 21 15:06:39.590223 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:39.590193 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:39.590681 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:39.590462 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:39.591246 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:39.591231 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:06:39.797417 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:39.797369 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:06:50.094738 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:06:50.094704 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:07:05.707784 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:07:05.707743 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:07:10.255761 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:07:10.255735 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 15:07:10.259918 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:07:10.259887 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 15:07:16.000376 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:07:16.000343 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:08:02.077694 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:02.077639 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm"] Jul 21 15:08:02.078402 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:02.078023 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" podUID="bfa8c64b-e23c-4460-92d5-64561398602d" containerName="istio-proxy" containerID="cri-o://79616fdd7f6ec75c6e0121d9374fa6306e70137e8cf8950d2da695240b4468a7" gracePeriod=30 Jul 21 15:08:06.128269 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:06.128232 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:08:07.359380 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.359297 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:08:07.378478 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.378386 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfa8c64b-e23c-4460-92d5-64561398602d-istio-token\") pod \"bfa8c64b-e23c-4460-92d5-64561398602d\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " Jul 21 15:08:07.378707 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.378579 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfa8c64b-e23c-4460-92d5-64561398602d-istio-podinfo\") pod \"bfa8c64b-e23c-4460-92d5-64561398602d\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " Jul 21 15:08:07.378707 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.378635 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-credential-socket\") pod \"bfa8c64b-e23c-4460-92d5-64561398602d\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " Jul 21 15:08:07.378707 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.378678 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9p6zl\" (UniqueName: \"kubernetes.io/projected/bfa8c64b-e23c-4460-92d5-64561398602d-kube-api-access-9p6zl\") pod \"bfa8c64b-e23c-4460-92d5-64561398602d\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " Jul 21 15:08:07.378921 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.378721 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-istio-data\") pod \"bfa8c64b-e23c-4460-92d5-64561398602d\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " Jul 21 15:08:07.378921 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.378746 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-istio-envoy\") pod \"bfa8c64b-e23c-4460-92d5-64561398602d\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " Jul 21 15:08:07.378921 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.378776 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-workload-socket\") pod \"bfa8c64b-e23c-4460-92d5-64561398602d\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " Jul 21 15:08:07.378921 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.378882 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-workload-certs\") pod \"bfa8c64b-e23c-4460-92d5-64561398602d\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " Jul 21 15:08:07.378921 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.378919 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfa8c64b-e23c-4460-92d5-64561398602d-istiod-ca-cert\") pod \"bfa8c64b-e23c-4460-92d5-64561398602d\" (UID: \"bfa8c64b-e23c-4460-92d5-64561398602d\") " Jul 21 15:08:07.379644 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.379510 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfa8c64b-e23c-4460-92d5-64561398602d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bfa8c64b-e23c-4460-92d5-64561398602d" (UID: "bfa8c64b-e23c-4460-92d5-64561398602d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:08:07.379854 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.379688 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-istio-data" (OuterVolumeSpecName: "istio-data") pod "bfa8c64b-e23c-4460-92d5-64561398602d" (UID: "bfa8c64b-e23c-4460-92d5-64561398602d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:08:07.379979 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.379876 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bfa8c64b-e23c-4460-92d5-64561398602d" (UID: "bfa8c64b-e23c-4460-92d5-64561398602d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:08:07.380073 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.380023 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bfa8c64b-e23c-4460-92d5-64561398602d" (UID: "bfa8c64b-e23c-4460-92d5-64561398602d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:08:07.380183 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.380120 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bfa8c64b-e23c-4460-92d5-64561398602d" (UID: "bfa8c64b-e23c-4460-92d5-64561398602d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:08:07.382518 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.382293 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfa8c64b-e23c-4460-92d5-64561398602d-istio-token" (OuterVolumeSpecName: "istio-token") pod "bfa8c64b-e23c-4460-92d5-64561398602d" (UID: "bfa8c64b-e23c-4460-92d5-64561398602d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:08:07.385148 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.384988 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfa8c64b-e23c-4460-92d5-64561398602d-kube-api-access-9p6zl" (OuterVolumeSpecName: "kube-api-access-9p6zl") pod "bfa8c64b-e23c-4460-92d5-64561398602d" (UID: "bfa8c64b-e23c-4460-92d5-64561398602d"). InnerVolumeSpecName "kube-api-access-9p6zl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:08:07.393878 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.392030 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bfa8c64b-e23c-4460-92d5-64561398602d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bfa8c64b-e23c-4460-92d5-64561398602d" (UID: "bfa8c64b-e23c-4460-92d5-64561398602d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 15:08:07.402115 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.402060 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bfa8c64b-e23c-4460-92d5-64561398602d" (UID: "bfa8c64b-e23c-4460-92d5-64561398602d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:08:07.480174 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.480123 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bfa8c64b-e23c-4460-92d5-64561398602d-istio-podinfo\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:08:07.480174 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.480159 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-credential-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:08:07.480174 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.480173 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9p6zl\" (UniqueName: \"kubernetes.io/projected/bfa8c64b-e23c-4460-92d5-64561398602d-kube-api-access-9p6zl\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:08:07.480174 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.480182 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-istio-data\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:08:07.480174 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.480191 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-istio-envoy\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:08:07.480670 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.480200 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-workload-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:08:07.480670 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.480208 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bfa8c64b-e23c-4460-92d5-64561398602d-workload-certs\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:08:07.480670 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.480217 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bfa8c64b-e23c-4460-92d5-64561398602d-istiod-ca-cert\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:08:07.480670 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.480225 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bfa8c64b-e23c-4460-92d5-64561398602d-istio-token\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:08:07.687699 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.687581 2559 generic.go:356] "Generic (PLEG): container finished" podID="bfa8c64b-e23c-4460-92d5-64561398602d" containerID="79616fdd7f6ec75c6e0121d9374fa6306e70137e8cf8950d2da695240b4468a7" exitCode=0 Jul 21 15:08:07.687957 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.687727 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" event={"ID":"bfa8c64b-e23c-4460-92d5-64561398602d","Type":"ContainerDied","Data":"79616fdd7f6ec75c6e0121d9374fa6306e70137e8cf8950d2da695240b4468a7"} Jul 21 15:08:07.687957 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.687869 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" event={"ID":"bfa8c64b-e23c-4460-92d5-64561398602d","Type":"ContainerDied","Data":"55abd17816acc44eae950335af3de8ddcfc2b70c8cd64a486edc3de45a8f5776"} Jul 21 15:08:07.687957 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.687909 2559 scope.go:117] "RemoveContainer" containerID="79616fdd7f6ec75c6e0121d9374fa6306e70137e8cf8950d2da695240b4468a7" Jul 21 15:08:07.688101 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.688081 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm" Jul 21 15:08:07.698917 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.698895 2559 scope.go:117] "RemoveContainer" containerID="02b4f1f1708499f444b57d6d70ba12f5397a177232bacfd1780eead836f165e0" Jul 21 15:08:07.712226 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.712063 2559 scope.go:117] "RemoveContainer" containerID="79616fdd7f6ec75c6e0121d9374fa6306e70137e8cf8950d2da695240b4468a7" Jul 21 15:08:07.712542 ip-10-0-131-241 kubenswrapper[2559]: E0721 15:08:07.712518 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79616fdd7f6ec75c6e0121d9374fa6306e70137e8cf8950d2da695240b4468a7\": container with ID starting with 79616fdd7f6ec75c6e0121d9374fa6306e70137e8cf8950d2da695240b4468a7 not found: ID does not exist" containerID="79616fdd7f6ec75c6e0121d9374fa6306e70137e8cf8950d2da695240b4468a7" Jul 21 15:08:07.712610 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.712555 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79616fdd7f6ec75c6e0121d9374fa6306e70137e8cf8950d2da695240b4468a7"} err="failed to get container status \"79616fdd7f6ec75c6e0121d9374fa6306e70137e8cf8950d2da695240b4468a7\": rpc error: code = NotFound desc = could not find container \"79616fdd7f6ec75c6e0121d9374fa6306e70137e8cf8950d2da695240b4468a7\": container with ID starting with 79616fdd7f6ec75c6e0121d9374fa6306e70137e8cf8950d2da695240b4468a7 not found: ID does not exist" Jul 21 15:08:07.712610 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.712577 2559 scope.go:117] "RemoveContainer" containerID="02b4f1f1708499f444b57d6d70ba12f5397a177232bacfd1780eead836f165e0" Jul 21 15:08:07.712948 ip-10-0-131-241 kubenswrapper[2559]: E0721 15:08:07.712923 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02b4f1f1708499f444b57d6d70ba12f5397a177232bacfd1780eead836f165e0\": container with ID starting with 02b4f1f1708499f444b57d6d70ba12f5397a177232bacfd1780eead836f165e0 not found: ID does not exist" containerID="02b4f1f1708499f444b57d6d70ba12f5397a177232bacfd1780eead836f165e0" Jul 21 15:08:07.713045 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.712956 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02b4f1f1708499f444b57d6d70ba12f5397a177232bacfd1780eead836f165e0"} err="failed to get container status \"02b4f1f1708499f444b57d6d70ba12f5397a177232bacfd1780eead836f165e0\": rpc error: code = NotFound desc = could not find container \"02b4f1f1708499f444b57d6d70ba12f5397a177232bacfd1780eead836f165e0\": container with ID starting with 02b4f1f1708499f444b57d6d70ba12f5397a177232bacfd1780eead836f165e0 not found: ID does not exist" Jul 21 15:08:07.713698 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.713677 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm"] Jul 21 15:08:07.717869 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:07.717831 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-5e94d052-openshift-default-7cdc689fbc-wmpfm"] Jul 21 15:08:08.122924 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:08.122891 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfa8c64b-e23c-4460-92d5-64561398602d" path="/var/lib/kubelet/pods/bfa8c64b-e23c-4460-92d5-64561398602d/volumes" Jul 21 15:08:18.513691 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:18.513646 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:08:57.574733 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.574694 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2"] Jul 21 15:08:57.575424 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.575369 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb39686a-f18f-4932-abd8-accbd19a8f4f" containerName="istio-proxy" Jul 21 15:08:57.575424 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.575393 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb39686a-f18f-4932-abd8-accbd19a8f4f" containerName="istio-proxy" Jul 21 15:08:57.575424 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.575410 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfa8c64b-e23c-4460-92d5-64561398602d" containerName="istio-proxy" Jul 21 15:08:57.575424 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.575418 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfa8c64b-e23c-4460-92d5-64561398602d" containerName="istio-proxy" Jul 21 15:08:57.575650 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.575438 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfa8c64b-e23c-4460-92d5-64561398602d" containerName="istio-proxy" Jul 21 15:08:57.575650 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.575447 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfa8c64b-e23c-4460-92d5-64561398602d" containerName="istio-proxy" Jul 21 15:08:57.575650 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.575539 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfa8c64b-e23c-4460-92d5-64561398602d" containerName="istio-proxy" Jul 21 15:08:57.575650 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.575554 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfa8c64b-e23c-4460-92d5-64561398602d" containerName="istio-proxy" Jul 21 15:08:57.575650 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.575564 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb39686a-f18f-4932-abd8-accbd19a8f4f" containerName="istio-proxy" Jul 21 15:08:57.579064 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.579036 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.581448 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.581414 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-d6d63a-openshift-default-dockercfg-kvwrb\"" Jul 21 15:08:57.590532 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.590494 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2"] Jul 21 15:08:57.655354 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.655298 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-data\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.655354 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.655364 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-workload-socket\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.655653 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.655465 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-credential-socket\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.655653 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.655572 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-envoy\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.655653 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.655633 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-token\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.655856 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.655658 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-podinfo\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.655856 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.655685 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/035025b8-d067-409e-a6b1-531bb7ea7bb3-istiod-ca-cert\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.655856 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.655710 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgqct\" (UniqueName: \"kubernetes.io/projected/035025b8-d067-409e-a6b1-531bb7ea7bb3-kube-api-access-qgqct\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.655856 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.655739 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-workload-certs\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.757292 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.757242 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-credential-socket\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.757557 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.757330 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-envoy\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.757557 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.757361 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-token\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.757557 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.757382 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-podinfo\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.757557 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.757406 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/035025b8-d067-409e-a6b1-531bb7ea7bb3-istiod-ca-cert\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.757557 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.757447 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgqct\" (UniqueName: \"kubernetes.io/projected/035025b8-d067-409e-a6b1-531bb7ea7bb3-kube-api-access-qgqct\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.757879 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.757572 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-workload-certs\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.757879 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.757691 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-data\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.757879 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.757727 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-workload-socket\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.757879 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.757819 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-credential-socket\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.758148 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.758122 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-workload-certs\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.758215 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.758132 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-data\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.758273 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.758245 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-workload-socket\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.758409 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.758386 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/035025b8-d067-409e-a6b1-531bb7ea7bb3-istiod-ca-cert\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.760077 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.760051 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-envoy\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.760306 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.760283 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-podinfo\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.765707 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.765676 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-token\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.766017 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.765994 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgqct\" (UniqueName: \"kubernetes.io/projected/035025b8-d067-409e-a6b1-531bb7ea7bb3-kube-api-access-qgqct\") pod \"e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:57.892359 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:57.892241 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:58.074930 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:58.074893 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2"] Jul 21 15:08:58.077293 ip-10-0-131-241 kubenswrapper[2559]: W0721 15:08:58.077257 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod035025b8_d067_409e_a6b1_531bb7ea7bb3.slice/crio-fb672c3e589fa985950262cbc481e281c8dbbbe3f3e9d4f50a3131f84c13722b WatchSource:0}: Error finding container fb672c3e589fa985950262cbc481e281c8dbbbe3f3e9d4f50a3131f84c13722b: Status 404 returned error can't find the container with id fb672c3e589fa985950262cbc481e281c8dbbbe3f3e9d4f50a3131f84c13722b Jul 21 15:08:58.079788 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:58.079740 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:08:58.079919 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:58.079844 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:08:58.079919 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:58.079878 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:08:58.991571 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:58.991526 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" event={"ID":"035025b8-d067-409e-a6b1-531bb7ea7bb3","Type":"ContainerStarted","Data":"99676887392d6c7f2f3191d76d1e3a103d7b3060c6d1c70c04ca7a845d8d5a4c"} Jul 21 15:08:58.992038 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:58.991598 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" event={"ID":"035025b8-d067-409e-a6b1-531bb7ea7bb3","Type":"ContainerStarted","Data":"fb672c3e589fa985950262cbc481e281c8dbbbe3f3e9d4f50a3131f84c13722b"} Jul 21 15:08:59.013449 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:59.013376 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" podStartSLOduration=2.013356996 podStartE2EDuration="2.013356996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:08:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:08:59.012096615 +0000 UTC m=+2209.411241795" watchObservedRunningTime="2026-07-21 15:08:59.013356996 +0000 UTC m=+2209.412502276" Jul 21 15:08:59.892742 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:59.892697 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:59.897975 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:59.897940 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:59.998341 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:59.998307 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:08:59.999646 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:08:59.999625 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:09:06.160629 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.160587 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6"] Jul 21 15:09:06.164692 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.164655 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.167480 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.167448 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-5ab9b1-openshift-default-dockercfg-nv7k5\"" Jul 21 15:09:06.177603 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.177568 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6"] Jul 21 15:09:06.241476 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.241417 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/486b4e23-6d58-4972-a784-7f9f20eb03cc-istiod-ca-cert\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.241476 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.241483 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-credential-socket\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.241773 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.241562 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztvg2\" (UniqueName: \"kubernetes.io/projected/486b4e23-6d58-4972-a784-7f9f20eb03cc-kube-api-access-ztvg2\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.241773 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.241615 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-workload-certs\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.241773 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.241688 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-podinfo\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.241773 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.241720 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-workload-socket\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.241773 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.241742 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-envoy\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.241773 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.241769 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-token\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.242124 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.241876 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-data\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.342891 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.342833 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-token\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.343142 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.342929 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-data\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.343142 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.343056 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/486b4e23-6d58-4972-a784-7f9f20eb03cc-istiod-ca-cert\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.343347 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.343141 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-credential-socket\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.343347 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.343178 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztvg2\" (UniqueName: \"kubernetes.io/projected/486b4e23-6d58-4972-a784-7f9f20eb03cc-kube-api-access-ztvg2\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.343347 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.343211 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-workload-certs\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.343347 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.343317 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-podinfo\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.343347 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.343344 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-workload-socket\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.343704 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.343366 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-envoy\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.344082 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.344048 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-workload-socket\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.344336 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.344279 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-credential-socket\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.344462 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.344369 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-workload-certs\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.344526 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.344496 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-data\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.345011 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.344981 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/486b4e23-6d58-4972-a784-7f9f20eb03cc-istiod-ca-cert\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.346338 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.346304 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-envoy\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.348052 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.348021 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-podinfo\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.352381 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.352345 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-token\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.352651 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.352357 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztvg2\" (UniqueName: \"kubernetes.io/projected/486b4e23-6d58-4972-a784-7f9f20eb03cc-kube-api-access-ztvg2\") pod \"e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.477323 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.477266 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:06.639985 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.639950 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6"] Jul 21 15:09:06.642147 ip-10-0-131-241 kubenswrapper[2559]: W0721 15:09:06.642112 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod486b4e23_6d58_4972_a784_7f9f20eb03cc.slice/crio-1a164ce49ba472dfbcad67d7a4bb0e03955b9ce76b2bab14320c2a9a3a09ecfb WatchSource:0}: Error finding container 1a164ce49ba472dfbcad67d7a4bb0e03955b9ce76b2bab14320c2a9a3a09ecfb: Status 404 returned error can't find the container with id 1a164ce49ba472dfbcad67d7a4bb0e03955b9ce76b2bab14320c2a9a3a09ecfb Jul 21 15:09:06.645055 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.645008 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:09:06.645182 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.645112 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:09:06.645182 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:06.645155 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:09:07.052723 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:07.052678 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" event={"ID":"486b4e23-6d58-4972-a784-7f9f20eb03cc","Type":"ContainerStarted","Data":"468325aff67cfbd01e2d9b75709eed9ac6d9595db3eada76b3da2ce1931e2abe"} Jul 21 15:09:07.052955 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:07.052766 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" event={"ID":"486b4e23-6d58-4972-a784-7f9f20eb03cc","Type":"ContainerStarted","Data":"1a164ce49ba472dfbcad67d7a4bb0e03955b9ce76b2bab14320c2a9a3a09ecfb"} Jul 21 15:09:07.076162 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:07.076096 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" podStartSLOduration=1.076076619 podStartE2EDuration="1.076076619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:09:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:09:07.073286527 +0000 UTC m=+2217.472431723" watchObservedRunningTime="2026-07-21 15:09:07.076076619 +0000 UTC m=+2217.475221867" Jul 21 15:09:07.477510 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:07.477472 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:07.483228 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:07.483193 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:08.058823 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:08.058737 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:08.059979 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:08.059957 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:08.603389 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:08.603337 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:09:16.040007 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:16.039958 2559 patch_prober.go:28] interesting pod/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 21 15:09:16.040690 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:16.040048 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" podUID="035025b8-d067-409e-a6b1-531bb7ea7bb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 21 15:09:17.111229 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:17.111134 2559 generic.go:356] "Generic (PLEG): container finished" podID="035025b8-d067-409e-a6b1-531bb7ea7bb3" containerID="99676887392d6c7f2f3191d76d1e3a103d7b3060c6d1c70c04ca7a845d8d5a4c" exitCode=0 Jul 21 15:09:17.111229 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:17.111190 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" event={"ID":"035025b8-d067-409e-a6b1-531bb7ea7bb3","Type":"ContainerDied","Data":"99676887392d6c7f2f3191d76d1e3a103d7b3060c6d1c70c04ca7a845d8d5a4c"} Jul 21 15:09:17.111734 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:17.111612 2559 scope.go:117] "RemoveContainer" containerID="99676887392d6c7f2f3191d76d1e3a103d7b3060c6d1c70c04ca7a845d8d5a4c" Jul 21 15:09:17.112776 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:17.112743 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:09:17.112872 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:17.112836 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:09:17.112918 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:17.112872 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:09:18.121310 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:18.121237 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" event={"ID":"035025b8-d067-409e-a6b1-531bb7ea7bb3","Type":"ContainerStarted","Data":"ca3636d73edd795d547faaf0a4174279624e3caf4a4c463b04a781fc6cadfe2f"} Jul 21 15:09:18.893605 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:18.893562 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:09:18.893943 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:18.893915 2559 patch_prober.go:28] interesting pod/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 21 15:09:18.894044 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:18.893969 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" podUID="035025b8-d067-409e-a6b1-531bb7ea7bb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 21 15:09:19.893001 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:19.892953 2559 patch_prober.go:28] interesting pod/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 21 15:09:19.893462 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:19.893015 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" podUID="035025b8-d067-409e-a6b1-531bb7ea7bb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 21 15:09:20.893249 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:20.893206 2559 patch_prober.go:28] interesting pod/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 21 15:09:20.893705 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:20.893270 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" podUID="035025b8-d067-409e-a6b1-531bb7ea7bb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 21 15:09:21.893029 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:21.892974 2559 patch_prober.go:28] interesting pod/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body= Jul 21 15:09:21.893267 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:21.893047 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" podUID="035025b8-d067-409e-a6b1-531bb7ea7bb3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" Jul 21 15:09:22.897106 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:22.897070 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:09:22.897621 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:22.897466 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:09:22.898558 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:22.898539 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:09:24.099999 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:24.099945 2559 patch_prober.go:28] interesting pod/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 21 15:09:24.100427 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:24.100031 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" podUID="486b4e23-6d58-4972-a784-7f9f20eb03cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 21 15:09:24.299557 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:24.299516 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:09:26.171638 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:26.171598 2559 generic.go:356] "Generic (PLEG): container finished" podID="486b4e23-6d58-4972-a784-7f9f20eb03cc" containerID="468325aff67cfbd01e2d9b75709eed9ac6d9595db3eada76b3da2ce1931e2abe" exitCode=0 Jul 21 15:09:26.172133 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:26.171685 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" event={"ID":"486b4e23-6d58-4972-a784-7f9f20eb03cc","Type":"ContainerDied","Data":"468325aff67cfbd01e2d9b75709eed9ac6d9595db3eada76b3da2ce1931e2abe"} Jul 21 15:09:26.172202 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:26.172185 2559 scope.go:117] "RemoveContainer" containerID="468325aff67cfbd01e2d9b75709eed9ac6d9595db3eada76b3da2ce1931e2abe" Jul 21 15:09:26.173376 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:26.173345 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:09:26.173481 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:26.173464 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:09:26.173521 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:26.173508 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:09:27.180044 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:27.180003 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" event={"ID":"486b4e23-6d58-4972-a784-7f9f20eb03cc","Type":"ContainerStarted","Data":"bbd26b0a6424453ee67f198f23007efdd4e4154f3f2c5f47e815a11f9721075f"} Jul 21 15:09:27.478002 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:27.477950 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:27.478220 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:27.478198 2559 patch_prober.go:28] interesting pod/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 21 15:09:27.478272 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:27.478246 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" podUID="486b4e23-6d58-4972-a784-7f9f20eb03cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 21 15:09:28.478740 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:28.478697 2559 patch_prober.go:28] interesting pod/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 21 15:09:28.479228 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:28.478762 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" podUID="486b4e23-6d58-4972-a784-7f9f20eb03cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 21 15:09:29.477722 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:29.477685 2559 patch_prober.go:28] interesting pod/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 21 15:09:29.477937 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:29.477746 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" podUID="486b4e23-6d58-4972-a784-7f9f20eb03cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 21 15:09:30.478027 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:30.477976 2559 patch_prober.go:28] interesting pod/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 21 15:09:30.478489 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:30.478053 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" podUID="486b4e23-6d58-4972-a784-7f9f20eb03cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 21 15:09:31.478030 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:31.477990 2559 patch_prober.go:28] interesting pod/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" start-of-body= Jul 21 15:09:31.478243 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:31.478054 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" podUID="486b4e23-6d58-4972-a784-7f9f20eb03cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.52:15021/healthz/ready\": dial tcp 10.132.0.52:15021: connect: connection refused" Jul 21 15:09:32.482027 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:32.481920 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:32.482475 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:32.482232 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:32.483039 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:32.483022 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:09:36.297360 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:09:36.297311 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:10:01.295074 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:10:01.295032 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:10:43.900617 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:10:43.900574 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:11:00.300079 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:00.300028 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:11:00.910852 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:00.910802 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2"] Jul 21 15:11:00.911148 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:00.911114 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" podUID="035025b8-d067-409e-a6b1-531bb7ea7bb3" containerName="istio-proxy" containerID="cri-o://ca3636d73edd795d547faaf0a4174279624e3caf4a4c463b04a781fc6cadfe2f" gracePeriod=30 Jul 21 15:11:06.212837 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.212782 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:11:06.329737 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.329693 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/035025b8-d067-409e-a6b1-531bb7ea7bb3-istiod-ca-cert\") pod \"035025b8-d067-409e-a6b1-531bb7ea7bb3\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " Jul 21 15:11:06.329964 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.329761 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-workload-certs\") pod \"035025b8-d067-409e-a6b1-531bb7ea7bb3\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " Jul 21 15:11:06.329964 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.329818 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-credential-socket\") pod \"035025b8-d067-409e-a6b1-531bb7ea7bb3\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " Jul 21 15:11:06.329964 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.329878 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-data\") pod \"035025b8-d067-409e-a6b1-531bb7ea7bb3\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " Jul 21 15:11:06.329964 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.329935 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgqct\" (UniqueName: \"kubernetes.io/projected/035025b8-d067-409e-a6b1-531bb7ea7bb3-kube-api-access-qgqct\") pod \"035025b8-d067-409e-a6b1-531bb7ea7bb3\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " Jul 21 15:11:06.329964 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.329963 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-workload-socket\") pod \"035025b8-d067-409e-a6b1-531bb7ea7bb3\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " Jul 21 15:11:06.330217 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.330017 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-token\") pod \"035025b8-d067-409e-a6b1-531bb7ea7bb3\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " Jul 21 15:11:06.330217 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.330063 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-podinfo\") pod \"035025b8-d067-409e-a6b1-531bb7ea7bb3\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " Jul 21 15:11:06.330217 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.330127 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-envoy\") pod \"035025b8-d067-409e-a6b1-531bb7ea7bb3\" (UID: \"035025b8-d067-409e-a6b1-531bb7ea7bb3\") " Jul 21 15:11:06.330217 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.330130 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "035025b8-d067-409e-a6b1-531bb7ea7bb3" (UID: "035025b8-d067-409e-a6b1-531bb7ea7bb3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:11:06.330217 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.330182 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "035025b8-d067-409e-a6b1-531bb7ea7bb3" (UID: "035025b8-d067-409e-a6b1-531bb7ea7bb3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:11:06.330217 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.330200 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/035025b8-d067-409e-a6b1-531bb7ea7bb3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "035025b8-d067-409e-a6b1-531bb7ea7bb3" (UID: "035025b8-d067-409e-a6b1-531bb7ea7bb3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:11:06.330535 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.330324 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "035025b8-d067-409e-a6b1-531bb7ea7bb3" (UID: "035025b8-d067-409e-a6b1-531bb7ea7bb3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:11:06.330535 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.330469 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/035025b8-d067-409e-a6b1-531bb7ea7bb3-istiod-ca-cert\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:11:06.330535 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.330488 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-workload-certs\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:11:06.330535 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.330503 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-credential-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:11:06.330535 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.330517 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-workload-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:11:06.330914 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.330870 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-data" (OuterVolumeSpecName: "istio-data") pod "035025b8-d067-409e-a6b1-531bb7ea7bb3" (UID: "035025b8-d067-409e-a6b1-531bb7ea7bb3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:11:06.332437 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.332415 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "035025b8-d067-409e-a6b1-531bb7ea7bb3" (UID: "035025b8-d067-409e-a6b1-531bb7ea7bb3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:11:06.332591 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.332435 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-token" (OuterVolumeSpecName: "istio-token") pod "035025b8-d067-409e-a6b1-531bb7ea7bb3" (UID: "035025b8-d067-409e-a6b1-531bb7ea7bb3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:11:06.332743 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.332720 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/035025b8-d067-409e-a6b1-531bb7ea7bb3-kube-api-access-qgqct" (OuterVolumeSpecName: "kube-api-access-qgqct") pod "035025b8-d067-409e-a6b1-531bb7ea7bb3" (UID: "035025b8-d067-409e-a6b1-531bb7ea7bb3"). InnerVolumeSpecName "kube-api-access-qgqct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:11:06.332831 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.332726 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "035025b8-d067-409e-a6b1-531bb7ea7bb3" (UID: "035025b8-d067-409e-a6b1-531bb7ea7bb3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 15:11:06.431838 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.431784 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-envoy\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:11:06.431838 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.431828 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-data\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:11:06.431838 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.431838 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgqct\" (UniqueName: \"kubernetes.io/projected/035025b8-d067-409e-a6b1-531bb7ea7bb3-kube-api-access-qgqct\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:11:06.431838 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.431849 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-token\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:11:06.431838 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.431858 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/035025b8-d067-409e-a6b1-531bb7ea7bb3-istio-podinfo\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:11:06.771513 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.771472 2559 generic.go:356] "Generic (PLEG): container finished" podID="035025b8-d067-409e-a6b1-531bb7ea7bb3" containerID="ca3636d73edd795d547faaf0a4174279624e3caf4a4c463b04a781fc6cadfe2f" exitCode=0 Jul 21 15:11:06.771736 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.771527 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" Jul 21 15:11:06.771736 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.771557 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" event={"ID":"035025b8-d067-409e-a6b1-531bb7ea7bb3","Type":"ContainerDied","Data":"ca3636d73edd795d547faaf0a4174279624e3caf4a4c463b04a781fc6cadfe2f"} Jul 21 15:11:06.771736 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.771619 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2" event={"ID":"035025b8-d067-409e-a6b1-531bb7ea7bb3","Type":"ContainerDied","Data":"fb672c3e589fa985950262cbc481e281c8dbbbe3f3e9d4f50a3131f84c13722b"} Jul 21 15:11:06.771736 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.771646 2559 scope.go:117] "RemoveContainer" containerID="ca3636d73edd795d547faaf0a4174279624e3caf4a4c463b04a781fc6cadfe2f" Jul 21 15:11:06.782450 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.782424 2559 scope.go:117] "RemoveContainer" containerID="99676887392d6c7f2f3191d76d1e3a103d7b3060c6d1c70c04ca7a845d8d5a4c" Jul 21 15:11:06.792878 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.792780 2559 scope.go:117] "RemoveContainer" containerID="ca3636d73edd795d547faaf0a4174279624e3caf4a4c463b04a781fc6cadfe2f" Jul 21 15:11:06.793237 ip-10-0-131-241 kubenswrapper[2559]: E0721 15:11:06.793216 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca3636d73edd795d547faaf0a4174279624e3caf4a4c463b04a781fc6cadfe2f\": container with ID starting with ca3636d73edd795d547faaf0a4174279624e3caf4a4c463b04a781fc6cadfe2f not found: ID does not exist" containerID="ca3636d73edd795d547faaf0a4174279624e3caf4a4c463b04a781fc6cadfe2f" Jul 21 15:11:06.793311 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.793246 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca3636d73edd795d547faaf0a4174279624e3caf4a4c463b04a781fc6cadfe2f"} err="failed to get container status \"ca3636d73edd795d547faaf0a4174279624e3caf4a4c463b04a781fc6cadfe2f\": rpc error: code = NotFound desc = could not find container \"ca3636d73edd795d547faaf0a4174279624e3caf4a4c463b04a781fc6cadfe2f\": container with ID starting with ca3636d73edd795d547faaf0a4174279624e3caf4a4c463b04a781fc6cadfe2f not found: ID does not exist" Jul 21 15:11:06.793311 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.793266 2559 scope.go:117] "RemoveContainer" containerID="99676887392d6c7f2f3191d76d1e3a103d7b3060c6d1c70c04ca7a845d8d5a4c" Jul 21 15:11:06.793525 ip-10-0-131-241 kubenswrapper[2559]: E0721 15:11:06.793501 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99676887392d6c7f2f3191d76d1e3a103d7b3060c6d1c70c04ca7a845d8d5a4c\": container with ID starting with 99676887392d6c7f2f3191d76d1e3a103d7b3060c6d1c70c04ca7a845d8d5a4c not found: ID does not exist" containerID="99676887392d6c7f2f3191d76d1e3a103d7b3060c6d1c70c04ca7a845d8d5a4c" Jul 21 15:11:06.793589 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.793535 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99676887392d6c7f2f3191d76d1e3a103d7b3060c6d1c70c04ca7a845d8d5a4c"} err="failed to get container status \"99676887392d6c7f2f3191d76d1e3a103d7b3060c6d1c70c04ca7a845d8d5a4c\": rpc error: code = NotFound desc = could not find container \"99676887392d6c7f2f3191d76d1e3a103d7b3060c6d1c70c04ca7a845d8d5a4c\": container with ID starting with 99676887392d6c7f2f3191d76d1e3a103d7b3060c6d1c70c04ca7a845d8d5a4c not found: ID does not exist" Jul 21 15:11:06.795097 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.795071 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2"] Jul 21 15:11:06.799490 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:06.799442 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-d6d63a-openshift-default-849948fbdf-pznk2"] Jul 21 15:11:08.122103 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:08.122062 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="035025b8-d067-409e-a6b1-531bb7ea7bb3" path="/var/lib/kubelet/pods/035025b8-d067-409e-a6b1-531bb7ea7bb3/volumes" Jul 21 15:11:14.798291 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:14.798243 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:11:22.910594 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:22.910547 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6"] Jul 21 15:11:22.911190 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:22.910834 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" podUID="486b4e23-6d58-4972-a784-7f9f20eb03cc" containerName="istio-proxy" containerID="cri-o://bbd26b0a6424453ee67f198f23007efdd4e4154f3f2c5f47e815a11f9721075f" gracePeriod=30 Jul 21 15:11:23.775771 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:23.775728 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7"] Jul 21 15:11:23.776355 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:23.776319 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="035025b8-d067-409e-a6b1-531bb7ea7bb3" containerName="istio-proxy" Jul 21 15:11:23.776355 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:23.776347 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="035025b8-d067-409e-a6b1-531bb7ea7bb3" containerName="istio-proxy" Jul 21 15:11:23.776539 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:23.776367 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="035025b8-d067-409e-a6b1-531bb7ea7bb3" containerName="istio-proxy" Jul 21 15:11:23.776539 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:23.776375 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="035025b8-d067-409e-a6b1-531bb7ea7bb3" containerName="istio-proxy" Jul 21 15:11:23.776539 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:23.776488 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="035025b8-d067-409e-a6b1-531bb7ea7bb3" containerName="istio-proxy" Jul 21 15:11:23.779933 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:23.779896 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:23.782466 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:23.782437 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-712877-openshift-default-dockercfg-c9fsb\"" Jul 21 15:11:23.791483 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:23.791448 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7"] Jul 21 15:11:23.902624 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:23.902581 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-data\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:23.902624 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:23.902622 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-token\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:23.902922 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:23.902661 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istiod-ca-cert\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:23.902922 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:23.902765 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-workload-socket\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:23.902922 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:23.902871 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-workload-certs\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:23.902922 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:23.902897 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89gps\" (UniqueName: \"kubernetes.io/projected/7e110a76-30af-4f1a-9f53-93ae3071b8d1-kube-api-access-89gps\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:23.903110 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:23.902935 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-credential-socket\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:23.903110 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:23.902954 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-podinfo\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:23.903110 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:23.903028 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-envoy\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:24.003542 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.003488 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-workload-certs\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:24.003542 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.003541 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89gps\" (UniqueName: \"kubernetes.io/projected/7e110a76-30af-4f1a-9f53-93ae3071b8d1-kube-api-access-89gps\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:24.004204 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.003573 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-credential-socket\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:24.004204 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.003590 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-podinfo\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:24.004204 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.003611 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-envoy\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:24.004204 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.004058 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-data\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:24.004204 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.004110 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-token\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:24.004204 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.004136 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-credential-socket\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:24.004204 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.004061 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-workload-certs\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:24.004204 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.004190 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istiod-ca-cert\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:24.004592 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.004264 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-workload-socket\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:24.004592 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.004394 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-data\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:24.004661 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.004618 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-workload-socket\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:24.004979 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.004957 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istiod-ca-cert\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:24.006760 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.006732 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-envoy\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:24.007052 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.007030 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-podinfo\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:24.014575 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.014541 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-token\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:24.014767 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.014595 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89gps\" (UniqueName: \"kubernetes.io/projected/7e110a76-30af-4f1a-9f53-93ae3071b8d1-kube-api-access-89gps\") pod \"e2e-api-a-712877-openshift-default-79f4bd7895-95fb7\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:24.092569 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.092459 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:24.264193 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.264164 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7"] Jul 21 15:11:24.266636 ip-10-0-131-241 kubenswrapper[2559]: W0721 15:11:24.266604 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e110a76_30af_4f1a_9f53_93ae3071b8d1.slice/crio-8af3b50ed5588fe1608083480c2699a67ca98e9e1c77fb561ed2f87eaa93c387 WatchSource:0}: Error finding container 8af3b50ed5588fe1608083480c2699a67ca98e9e1c77fb561ed2f87eaa93c387: Status 404 returned error can't find the container with id 8af3b50ed5588fe1608083480c2699a67ca98e9e1c77fb561ed2f87eaa93c387 Jul 21 15:11:24.268900 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.268777 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:11:24.269012 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.268941 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:11:24.269012 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.268973 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:11:24.879673 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.879629 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" event={"ID":"7e110a76-30af-4f1a-9f53-93ae3071b8d1","Type":"ContainerStarted","Data":"e9cd79096dbc0b5e425b07c64a433034b50c20a692328bf6ac92e903ca04830d"} Jul 21 15:11:24.879988 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.879725 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" event={"ID":"7e110a76-30af-4f1a-9f53-93ae3071b8d1","Type":"ContainerStarted","Data":"8af3b50ed5588fe1608083480c2699a67ca98e9e1c77fb561ed2f87eaa93c387"} Jul 21 15:11:24.901571 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:24.901506 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" podStartSLOduration=1.901487135 podStartE2EDuration="1.901487135s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:11:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:11:24.899362017 +0000 UTC m=+2355.298507197" watchObservedRunningTime="2026-07-21 15:11:24.901487135 +0000 UTC m=+2355.300632314" Jul 21 15:11:25.092975 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:25.092933 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:25.098418 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:25.098387 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:25.886719 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:25.886685 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:25.887915 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:25.887891 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:28.179200 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.179119 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:11:28.242637 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.242587 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-token\") pod \"486b4e23-6d58-4972-a784-7f9f20eb03cc\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " Jul 21 15:11:28.242876 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.242658 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-data\") pod \"486b4e23-6d58-4972-a784-7f9f20eb03cc\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " Jul 21 15:11:28.242876 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.242709 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztvg2\" (UniqueName: \"kubernetes.io/projected/486b4e23-6d58-4972-a784-7f9f20eb03cc-kube-api-access-ztvg2\") pod \"486b4e23-6d58-4972-a784-7f9f20eb03cc\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " Jul 21 15:11:28.242876 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.242737 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-podinfo\") pod \"486b4e23-6d58-4972-a784-7f9f20eb03cc\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " Jul 21 15:11:28.242876 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.242765 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-workload-certs\") pod \"486b4e23-6d58-4972-a784-7f9f20eb03cc\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " Jul 21 15:11:28.242876 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.242810 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-credential-socket\") pod \"486b4e23-6d58-4972-a784-7f9f20eb03cc\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " Jul 21 15:11:28.242876 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.242832 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-envoy\") pod \"486b4e23-6d58-4972-a784-7f9f20eb03cc\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " Jul 21 15:11:28.242876 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.242862 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/486b4e23-6d58-4972-a784-7f9f20eb03cc-istiod-ca-cert\") pod \"486b4e23-6d58-4972-a784-7f9f20eb03cc\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " Jul 21 15:11:28.243261 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.242903 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-workload-socket\") pod \"486b4e23-6d58-4972-a784-7f9f20eb03cc\" (UID: \"486b4e23-6d58-4972-a784-7f9f20eb03cc\") " Jul 21 15:11:28.243621 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.243314 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "486b4e23-6d58-4972-a784-7f9f20eb03cc" (UID: "486b4e23-6d58-4972-a784-7f9f20eb03cc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:11:28.243621 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.243399 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "486b4e23-6d58-4972-a784-7f9f20eb03cc" (UID: "486b4e23-6d58-4972-a784-7f9f20eb03cc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:11:28.243621 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.243447 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "486b4e23-6d58-4972-a784-7f9f20eb03cc" (UID: "486b4e23-6d58-4972-a784-7f9f20eb03cc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:11:28.243838 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.243689 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/486b4e23-6d58-4972-a784-7f9f20eb03cc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "486b4e23-6d58-4972-a784-7f9f20eb03cc" (UID: "486b4e23-6d58-4972-a784-7f9f20eb03cc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:11:28.243838 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.243761 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-data" (OuterVolumeSpecName: "istio-data") pod "486b4e23-6d58-4972-a784-7f9f20eb03cc" (UID: "486b4e23-6d58-4972-a784-7f9f20eb03cc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:11:28.245591 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.245557 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "486b4e23-6d58-4972-a784-7f9f20eb03cc" (UID: "486b4e23-6d58-4972-a784-7f9f20eb03cc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:11:28.245752 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.245729 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/486b4e23-6d58-4972-a784-7f9f20eb03cc-kube-api-access-ztvg2" (OuterVolumeSpecName: "kube-api-access-ztvg2") pod "486b4e23-6d58-4972-a784-7f9f20eb03cc" (UID: "486b4e23-6d58-4972-a784-7f9f20eb03cc"). InnerVolumeSpecName "kube-api-access-ztvg2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:11:28.245841 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.245753 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "486b4e23-6d58-4972-a784-7f9f20eb03cc" (UID: "486b4e23-6d58-4972-a784-7f9f20eb03cc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 15:11:28.245886 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.245847 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-token" (OuterVolumeSpecName: "istio-token") pod "486b4e23-6d58-4972-a784-7f9f20eb03cc" (UID: "486b4e23-6d58-4972-a784-7f9f20eb03cc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:11:28.344015 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.343955 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztvg2\" (UniqueName: \"kubernetes.io/projected/486b4e23-6d58-4972-a784-7f9f20eb03cc-kube-api-access-ztvg2\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:11:28.344015 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.343996 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-podinfo\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:11:28.344015 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.344011 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-workload-certs\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:11:28.344015 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.344019 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-credential-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:11:28.344015 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.344029 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-envoy\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:11:28.344333 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.344038 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/486b4e23-6d58-4972-a784-7f9f20eb03cc-istiod-ca-cert\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:11:28.344333 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.344046 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-workload-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:11:28.344333 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.344057 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-token\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:11:28.344333 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.344065 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/486b4e23-6d58-4972-a784-7f9f20eb03cc-istio-data\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:11:28.906876 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.906834 2559 generic.go:356] "Generic (PLEG): container finished" podID="486b4e23-6d58-4972-a784-7f9f20eb03cc" containerID="bbd26b0a6424453ee67f198f23007efdd4e4154f3f2c5f47e815a11f9721075f" exitCode=0 Jul 21 15:11:28.907079 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.906900 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" Jul 21 15:11:28.907079 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.906901 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" event={"ID":"486b4e23-6d58-4972-a784-7f9f20eb03cc","Type":"ContainerDied","Data":"bbd26b0a6424453ee67f198f23007efdd4e4154f3f2c5f47e815a11f9721075f"} Jul 21 15:11:28.907079 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.906993 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6" event={"ID":"486b4e23-6d58-4972-a784-7f9f20eb03cc","Type":"ContainerDied","Data":"1a164ce49ba472dfbcad67d7a4bb0e03955b9ce76b2bab14320c2a9a3a09ecfb"} Jul 21 15:11:28.907079 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.907019 2559 scope.go:117] "RemoveContainer" containerID="bbd26b0a6424453ee67f198f23007efdd4e4154f3f2c5f47e815a11f9721075f" Jul 21 15:11:28.917672 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.917649 2559 scope.go:117] "RemoveContainer" containerID="468325aff67cfbd01e2d9b75709eed9ac6d9595db3eada76b3da2ce1931e2abe" Jul 21 15:11:28.927565 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.927535 2559 scope.go:117] "RemoveContainer" containerID="bbd26b0a6424453ee67f198f23007efdd4e4154f3f2c5f47e815a11f9721075f" Jul 21 15:11:28.927982 ip-10-0-131-241 kubenswrapper[2559]: E0721 15:11:28.927932 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbd26b0a6424453ee67f198f23007efdd4e4154f3f2c5f47e815a11f9721075f\": container with ID starting with bbd26b0a6424453ee67f198f23007efdd4e4154f3f2c5f47e815a11f9721075f not found: ID does not exist" containerID="bbd26b0a6424453ee67f198f23007efdd4e4154f3f2c5f47e815a11f9721075f" Jul 21 15:11:28.928207 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.927981 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbd26b0a6424453ee67f198f23007efdd4e4154f3f2c5f47e815a11f9721075f"} err="failed to get container status \"bbd26b0a6424453ee67f198f23007efdd4e4154f3f2c5f47e815a11f9721075f\": rpc error: code = NotFound desc = could not find container \"bbd26b0a6424453ee67f198f23007efdd4e4154f3f2c5f47e815a11f9721075f\": container with ID starting with bbd26b0a6424453ee67f198f23007efdd4e4154f3f2c5f47e815a11f9721075f not found: ID does not exist" Jul 21 15:11:28.928207 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.928013 2559 scope.go:117] "RemoveContainer" containerID="468325aff67cfbd01e2d9b75709eed9ac6d9595db3eada76b3da2ce1931e2abe" Jul 21 15:11:28.928568 ip-10-0-131-241 kubenswrapper[2559]: E0721 15:11:28.928513 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"468325aff67cfbd01e2d9b75709eed9ac6d9595db3eada76b3da2ce1931e2abe\": container with ID starting with 468325aff67cfbd01e2d9b75709eed9ac6d9595db3eada76b3da2ce1931e2abe not found: ID does not exist" containerID="468325aff67cfbd01e2d9b75709eed9ac6d9595db3eada76b3da2ce1931e2abe" Jul 21 15:11:28.928710 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.928575 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"468325aff67cfbd01e2d9b75709eed9ac6d9595db3eada76b3da2ce1931e2abe"} err="failed to get container status \"468325aff67cfbd01e2d9b75709eed9ac6d9595db3eada76b3da2ce1931e2abe\": rpc error: code = NotFound desc = could not find container \"468325aff67cfbd01e2d9b75709eed9ac6d9595db3eada76b3da2ce1931e2abe\": container with ID starting with 468325aff67cfbd01e2d9b75709eed9ac6d9595db3eada76b3da2ce1931e2abe not found: ID does not exist" Jul 21 15:11:28.931218 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.931188 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6"] Jul 21 15:11:28.934939 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:28.934904 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-5ab9b1-openshift-default-7599d5c8cf-4jmt6"] Jul 21 15:11:30.121097 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:30.120994 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="486b4e23-6d58-4972-a784-7f9f20eb03cc" path="/var/lib/kubelet/pods/486b4e23-6d58-4972-a784-7f9f20eb03cc/volumes" Jul 21 15:11:32.064440 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.064406 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6"] Jul 21 15:11:32.064881 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.064783 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="486b4e23-6d58-4972-a784-7f9f20eb03cc" containerName="istio-proxy" Jul 21 15:11:32.064881 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.064810 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="486b4e23-6d58-4972-a784-7f9f20eb03cc" containerName="istio-proxy" Jul 21 15:11:32.064981 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.064903 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="035025b8-d067-409e-a6b1-531bb7ea7bb3" containerName="istio-proxy" Jul 21 15:11:32.064981 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.064913 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="486b4e23-6d58-4972-a784-7f9f20eb03cc" containerName="istio-proxy" Jul 21 15:11:32.064981 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.064922 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="486b4e23-6d58-4972-a784-7f9f20eb03cc" containerName="istio-proxy" Jul 21 15:11:32.069805 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.069756 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.072337 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.072309 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-99a04e-openshift-default-dockercfg-bbbqt\"" Jul 21 15:11:32.074147 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.074120 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-workload-certs\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.074288 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.074151 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-envoy\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.074288 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.074201 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-podinfo\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.074288 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.074221 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istiod-ca-cert\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.074288 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.074239 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-token\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.074288 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.074277 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-data\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.074476 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.074313 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-workload-socket\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.074476 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.074344 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk5t4\" (UniqueName: \"kubernetes.io/projected/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-kube-api-access-mk5t4\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.074476 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.074401 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-credential-socket\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.079644 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.079613 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6"] Jul 21 15:11:32.175484 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.175452 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-workload-certs\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.175484 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.175488 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-envoy\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.175781 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.175540 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-podinfo\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.175781 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.175562 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istiod-ca-cert\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.175781 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.175587 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-token\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.175781 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.175677 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-data\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.175781 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.175721 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-workload-socket\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.175781 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.175756 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk5t4\" (UniqueName: \"kubernetes.io/projected/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-kube-api-access-mk5t4\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.176152 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.175868 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-credential-socket\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.176152 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.175956 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-workload-certs\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.176282 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.176251 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-credential-socket\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.176346 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.176313 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-workload-socket\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.176675 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.176646 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istiod-ca-cert\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.176776 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.176755 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-data\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.179251 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.179207 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-envoy\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.179584 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.179562 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-podinfo\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.184947 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.184905 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-token\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.185135 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.185055 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk5t4\" (UniqueName: \"kubernetes.io/projected/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-kube-api-access-mk5t4\") pod \"e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.383049 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.382940 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:32.538855 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.538821 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6"] Jul 21 15:11:32.540631 ip-10-0-131-241 kubenswrapper[2559]: W0721 15:11:32.540588 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7f010f0_4de2_4a8a_a474_be0a4cf5daad.slice/crio-15eaf9077f4f85812028106886467686ff7dc01aae160d96bb220fc3484882be WatchSource:0}: Error finding container 15eaf9077f4f85812028106886467686ff7dc01aae160d96bb220fc3484882be: Status 404 returned error can't find the container with id 15eaf9077f4f85812028106886467686ff7dc01aae160d96bb220fc3484882be Jul 21 15:11:32.543265 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.543226 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:11:32.543370 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.543319 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:11:32.543370 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.543364 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:11:32.933831 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.933777 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" event={"ID":"e7f010f0-4de2-4a8a-a474-be0a4cf5daad","Type":"ContainerStarted","Data":"7d5339ac643d747bdaef157b7258bb3ec1e3181d6f97cde131e260bc17adbd26"} Jul 21 15:11:32.934078 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.933860 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" event={"ID":"e7f010f0-4de2-4a8a-a474-be0a4cf5daad","Type":"ContainerStarted","Data":"15eaf9077f4f85812028106886467686ff7dc01aae160d96bb220fc3484882be"} Jul 21 15:11:32.954709 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:32.954648 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" podStartSLOduration=0.954629037 podStartE2EDuration="954.629037ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:11:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:11:32.952561974 +0000 UTC m=+2363.351707153" watchObservedRunningTime="2026-07-21 15:11:32.954629037 +0000 UTC m=+2363.353774226" Jul 21 15:11:33.383292 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:33.383249 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:33.388885 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:33.388851 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:33.940050 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:33.940009 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:33.941083 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:33.941042 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:35.404462 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:35.404410 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:11:45.011585 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:45.011546 2559 generic.go:356] "Generic (PLEG): container finished" podID="7e110a76-30af-4f1a-9f53-93ae3071b8d1" containerID="e9cd79096dbc0b5e425b07c64a433034b50c20a692328bf6ac92e903ca04830d" exitCode=0 Jul 21 15:11:45.012223 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:45.011621 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" event={"ID":"7e110a76-30af-4f1a-9f53-93ae3071b8d1","Type":"ContainerDied","Data":"e9cd79096dbc0b5e425b07c64a433034b50c20a692328bf6ac92e903ca04830d"} Jul 21 15:11:45.012223 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:45.012190 2559 scope.go:117] "RemoveContainer" containerID="e9cd79096dbc0b5e425b07c64a433034b50c20a692328bf6ac92e903ca04830d" Jul 21 15:11:45.013386 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:45.013354 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:11:45.013463 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:45.013446 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:11:45.013503 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:45.013491 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:11:46.021081 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:46.021044 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" event={"ID":"7e110a76-30af-4f1a-9f53-93ae3071b8d1","Type":"ContainerStarted","Data":"88d66f74448985f44f03d2c33bdff8bae2cf42b2ba0bc4e009f8df88f9934e95"} Jul 21 15:11:46.093004 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:46.092964 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:46.093253 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:46.093220 2559 patch_prober.go:28] interesting pod/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 21 15:11:46.093380 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:46.093287 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" podUID="7e110a76-30af-4f1a-9f53-93ae3071b8d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 21 15:11:47.093729 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:47.093686 2559 patch_prober.go:28] interesting pod/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 21 15:11:47.094182 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:47.093762 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" podUID="7e110a76-30af-4f1a-9f53-93ae3071b8d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 21 15:11:48.093382 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:48.093339 2559 patch_prober.go:28] interesting pod/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 21 15:11:48.093603 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:48.093416 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" podUID="7e110a76-30af-4f1a-9f53-93ae3071b8d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 21 15:11:49.093807 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:49.093751 2559 patch_prober.go:28] interesting pod/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 21 15:11:49.094243 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:49.093833 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" podUID="7e110a76-30af-4f1a-9f53-93ae3071b8d1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 21 15:11:50.127081 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:50.127041 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:50.127928 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:50.127367 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:50.128466 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:50.128447 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:11:54.093010 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:54.092963 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:11:56.095405 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:56.095367 2559 generic.go:356] "Generic (PLEG): container finished" podID="e7f010f0-4de2-4a8a-a474-be0a4cf5daad" containerID="7d5339ac643d747bdaef157b7258bb3ec1e3181d6f97cde131e260bc17adbd26" exitCode=0 Jul 21 15:11:56.095942 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:56.095435 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" event={"ID":"e7f010f0-4de2-4a8a-a474-be0a4cf5daad","Type":"ContainerDied","Data":"7d5339ac643d747bdaef157b7258bb3ec1e3181d6f97cde131e260bc17adbd26"} Jul 21 15:11:56.095942 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:56.095885 2559 scope.go:117] "RemoveContainer" containerID="7d5339ac643d747bdaef157b7258bb3ec1e3181d6f97cde131e260bc17adbd26" Jul 21 15:11:56.096983 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:56.096945 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:11:56.097099 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:56.097039 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:11:56.097099 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:56.097075 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:11:57.103461 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:57.103423 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" event={"ID":"e7f010f0-4de2-4a8a-a474-be0a4cf5daad","Type":"ContainerStarted","Data":"dd654abd68846e7aed5db389a9611c87ef12a232aed6d2b777661c7ff509798b"} Jul 21 15:11:57.383361 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:57.383251 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:11:57.383611 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:57.383589 2559 patch_prober.go:28] interesting pod/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 21 15:11:57.383666 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:57.383647 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" podUID="e7f010f0-4de2-4a8a-a474-be0a4cf5daad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 21 15:11:58.383596 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:58.383552 2559 patch_prober.go:28] interesting pod/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 21 15:11:58.384203 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:58.383634 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" podUID="e7f010f0-4de2-4a8a-a474-be0a4cf5daad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 21 15:11:59.383892 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:59.383856 2559 patch_prober.go:28] interesting pod/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 21 15:11:59.384334 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:11:59.383920 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" podUID="e7f010f0-4de2-4a8a-a474-be0a4cf5daad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 21 15:12:00.384493 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:00.384436 2559 patch_prober.go:28] interesting pod/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 21 15:12:00.384985 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:00.384509 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" podUID="e7f010f0-4de2-4a8a-a474-be0a4cf5daad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 21 15:12:01.388514 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:01.388476 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:12:01.388977 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:01.388764 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:12:01.389571 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:01.389553 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:12:09.707400 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:09.707341 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:12:10.296518 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:10.296489 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 15:12:10.303769 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:10.303742 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 15:12:14.009616 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:14.009573 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7"] Jul 21 15:12:14.010151 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:14.009902 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" podUID="7e110a76-30af-4f1a-9f53-93ae3071b8d1" containerName="istio-proxy" containerID="cri-o://88d66f74448985f44f03d2c33bdff8bae2cf42b2ba0bc4e009f8df88f9934e95" gracePeriod=30 Jul 21 15:12:19.228684 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.228652 2559 generic.go:356] "Generic (PLEG): container finished" podID="7e110a76-30af-4f1a-9f53-93ae3071b8d1" containerID="88d66f74448985f44f03d2c33bdff8bae2cf42b2ba0bc4e009f8df88f9934e95" exitCode=0 Jul 21 15:12:19.229182 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.228719 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" event={"ID":"7e110a76-30af-4f1a-9f53-93ae3071b8d1","Type":"ContainerDied","Data":"88d66f74448985f44f03d2c33bdff8bae2cf42b2ba0bc4e009f8df88f9934e95"} Jul 21 15:12:19.229182 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.228785 2559 scope.go:117] "RemoveContainer" containerID="e9cd79096dbc0b5e425b07c64a433034b50c20a692328bf6ac92e903ca04830d" Jul 21 15:12:19.285616 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.285531 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:12:19.449741 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.449691 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89gps\" (UniqueName: \"kubernetes.io/projected/7e110a76-30af-4f1a-9f53-93ae3071b8d1-kube-api-access-89gps\") pod \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " Jul 21 15:12:19.450016 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.449760 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-workload-certs\") pod \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " Jul 21 15:12:19.450016 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.449835 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-podinfo\") pod \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " Jul 21 15:12:19.450016 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.449897 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-data\") pod \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " Jul 21 15:12:19.450016 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.449924 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-token\") pod \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " Jul 21 15:12:19.450016 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.449957 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-envoy\") pod \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " Jul 21 15:12:19.450016 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.449996 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-credential-socket\") pod \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " Jul 21 15:12:19.450325 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.450043 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-workload-socket\") pod \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " Jul 21 15:12:19.450325 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.450106 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istiod-ca-cert\") pod \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\" (UID: \"7e110a76-30af-4f1a-9f53-93ae3071b8d1\") " Jul 21 15:12:19.450325 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.450178 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7e110a76-30af-4f1a-9f53-93ae3071b8d1" (UID: "7e110a76-30af-4f1a-9f53-93ae3071b8d1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:12:19.450505 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.450411 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7e110a76-30af-4f1a-9f53-93ae3071b8d1" (UID: "7e110a76-30af-4f1a-9f53-93ae3071b8d1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:12:19.450505 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.450484 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-workload-certs\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:12:19.450617 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.450593 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7e110a76-30af-4f1a-9f53-93ae3071b8d1" (UID: "7e110a76-30af-4f1a-9f53-93ae3071b8d1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:12:19.450899 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.450852 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-data" (OuterVolumeSpecName: "istio-data") pod "7e110a76-30af-4f1a-9f53-93ae3071b8d1" (UID: "7e110a76-30af-4f1a-9f53-93ae3071b8d1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:12:19.451114 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.451088 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7e110a76-30af-4f1a-9f53-93ae3071b8d1" (UID: "7e110a76-30af-4f1a-9f53-93ae3071b8d1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:12:19.452401 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.452374 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e110a76-30af-4f1a-9f53-93ae3071b8d1-kube-api-access-89gps" (OuterVolumeSpecName: "kube-api-access-89gps") pod "7e110a76-30af-4f1a-9f53-93ae3071b8d1" (UID: "7e110a76-30af-4f1a-9f53-93ae3071b8d1"). InnerVolumeSpecName "kube-api-access-89gps". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:12:19.452521 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.452395 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-token" (OuterVolumeSpecName: "istio-token") pod "7e110a76-30af-4f1a-9f53-93ae3071b8d1" (UID: "7e110a76-30af-4f1a-9f53-93ae3071b8d1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:12:19.452521 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.452422 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7e110a76-30af-4f1a-9f53-93ae3071b8d1" (UID: "7e110a76-30af-4f1a-9f53-93ae3071b8d1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 15:12:19.452693 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.452677 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7e110a76-30af-4f1a-9f53-93ae3071b8d1" (UID: "7e110a76-30af-4f1a-9f53-93ae3071b8d1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:12:19.551346 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.551243 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-data\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:12:19.551346 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.551278 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-token\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:12:19.551346 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.551287 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-envoy\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:12:19.551346 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.551296 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-credential-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:12:19.551346 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.551305 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e110a76-30af-4f1a-9f53-93ae3071b8d1-workload-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:12:19.551346 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.551315 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istiod-ca-cert\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:12:19.551346 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.551323 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89gps\" (UniqueName: \"kubernetes.io/projected/7e110a76-30af-4f1a-9f53-93ae3071b8d1-kube-api-access-89gps\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:12:19.551346 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:19.551333 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e110a76-30af-4f1a-9f53-93ae3071b8d1-istio-podinfo\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:12:20.235907 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:20.235872 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" event={"ID":"7e110a76-30af-4f1a-9f53-93ae3071b8d1","Type":"ContainerDied","Data":"8af3b50ed5588fe1608083480c2699a67ca98e9e1c77fb561ed2f87eaa93c387"} Jul 21 15:12:20.236371 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:20.235935 2559 scope.go:117] "RemoveContainer" containerID="88d66f74448985f44f03d2c33bdff8bae2cf42b2ba0bc4e009f8df88f9934e95" Jul 21 15:12:20.236371 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:20.235938 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7" Jul 21 15:12:20.255926 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:20.255879 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7"] Jul 21 15:12:20.260761 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:20.260724 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-712877-openshift-default-79f4bd7895-95fb7"] Jul 21 15:12:22.121520 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:22.121483 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e110a76-30af-4f1a-9f53-93ae3071b8d1" path="/var/lib/kubelet/pods/7e110a76-30af-4f1a-9f53-93ae3071b8d1/volumes" Jul 21 15:12:35.199410 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:35.199310 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:12:41.174573 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:41.173441 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6"] Jul 21 15:12:41.174573 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:41.173727 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" podUID="e7f010f0-4de2-4a8a-a474-be0a4cf5daad" containerName="istio-proxy" containerID="cri-o://dd654abd68846e7aed5db389a9611c87ef12a232aed6d2b777661c7ff509798b" gracePeriod=30 Jul 21 15:12:42.072917 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.072877 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6"] Jul 21 15:12:42.073254 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.073241 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e110a76-30af-4f1a-9f53-93ae3071b8d1" containerName="istio-proxy" Jul 21 15:12:42.073301 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.073255 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e110a76-30af-4f1a-9f53-93ae3071b8d1" containerName="istio-proxy" Jul 21 15:12:42.073301 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.073267 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="486b4e23-6d58-4972-a784-7f9f20eb03cc" containerName="istio-proxy" Jul 21 15:12:42.073301 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.073272 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="486b4e23-6d58-4972-a784-7f9f20eb03cc" containerName="istio-proxy" Jul 21 15:12:42.073301 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.073288 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e110a76-30af-4f1a-9f53-93ae3071b8d1" containerName="istio-proxy" Jul 21 15:12:42.073301 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.073293 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e110a76-30af-4f1a-9f53-93ae3071b8d1" containerName="istio-proxy" Jul 21 15:12:42.073472 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.073355 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e110a76-30af-4f1a-9f53-93ae3071b8d1" containerName="istio-proxy" Jul 21 15:12:42.077980 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.077954 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.080394 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.080366 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-9b06ae-openshift-default-dockercfg-s2pjj\"" Jul 21 15:12:42.088084 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.088051 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6"] Jul 21 15:12:42.162283 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.162243 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-workload-socket\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.162505 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.162346 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-data\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.162505 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.162394 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4pmh\" (UniqueName: \"kubernetes.io/projected/c349160b-4160-465b-a3eb-46f4b591b6ed-kube-api-access-n4pmh\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.162505 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.162479 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-podinfo\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.162668 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.162521 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-token\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.162668 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.162595 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-envoy\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.162668 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.162629 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c349160b-4160-465b-a3eb-46f4b591b6ed-istiod-ca-cert\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.162668 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.162660 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-workload-certs\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.162864 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.162776 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-credential-socket\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.264030 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.263977 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-workload-socket\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.264543 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.264042 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-data\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.264543 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.264076 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4pmh\" (UniqueName: \"kubernetes.io/projected/c349160b-4160-465b-a3eb-46f4b591b6ed-kube-api-access-n4pmh\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.264543 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.264109 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-podinfo\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.264543 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.264138 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-token\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.264543 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.264177 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-envoy\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.264543 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.264207 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c349160b-4160-465b-a3eb-46f4b591b6ed-istiod-ca-cert\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.264543 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.264237 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-workload-certs\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.264543 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.264291 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-credential-socket\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.264543 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.264534 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-workload-socket\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.265121 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.264558 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-data\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.265121 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.264922 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-credential-socket\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.265121 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.265035 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-workload-certs\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.265121 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.265044 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c349160b-4160-465b-a3eb-46f4b591b6ed-istiod-ca-cert\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.267306 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.267273 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-envoy\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.267538 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.267515 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-podinfo\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.271978 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.271942 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-token\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.272293 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.272274 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4pmh\" (UniqueName: \"kubernetes.io/projected/c349160b-4160-465b-a3eb-46f4b591b6ed-kube-api-access-n4pmh\") pod \"e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.391118 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.390994 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:42.553884 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.553850 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6"] Jul 21 15:12:42.555446 ip-10-0-131-241 kubenswrapper[2559]: W0721 15:12:42.555416 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc349160b_4160_465b_a3eb_46f4b591b6ed.slice/crio-44c98c5d739f577205bf3ff8b9890c177ae4abc0a5e1e36f01cad0532b357592 WatchSource:0}: Error finding container 44c98c5d739f577205bf3ff8b9890c177ae4abc0a5e1e36f01cad0532b357592: Status 404 returned error can't find the container with id 44c98c5d739f577205bf3ff8b9890c177ae4abc0a5e1e36f01cad0532b357592 Jul 21 15:12:42.557745 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.557710 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:12:42.557897 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.557786 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:12:42.557897 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:42.557846 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:12:43.374807 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:43.374748 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" event={"ID":"c349160b-4160-465b-a3eb-46f4b591b6ed","Type":"ContainerStarted","Data":"66ac955187b4a5177cd2d07763c6b499e9aade0e3f5d93c5f12689bcc988f3ea"} Jul 21 15:12:43.375237 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:43.374829 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" event={"ID":"c349160b-4160-465b-a3eb-46f4b591b6ed","Type":"ContainerStarted","Data":"44c98c5d739f577205bf3ff8b9890c177ae4abc0a5e1e36f01cad0532b357592"} Jul 21 15:12:43.391618 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:43.391574 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:43.395112 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:43.395057 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" podStartSLOduration=1.395036747 podStartE2EDuration="1.395036747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:12:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:12:43.394371457 +0000 UTC m=+2433.793516654" watchObservedRunningTime="2026-07-21 15:12:43.395036747 +0000 UTC m=+2433.794181937" Jul 21 15:12:43.397373 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:43.397341 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:44.380110 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:44.380074 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:44.381385 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:44.381360 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:12:46.394262 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.394228 2559 generic.go:356] "Generic (PLEG): container finished" podID="e7f010f0-4de2-4a8a-a474-be0a4cf5daad" containerID="dd654abd68846e7aed5db389a9611c87ef12a232aed6d2b777661c7ff509798b" exitCode=0 Jul 21 15:12:46.394731 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.394302 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" event={"ID":"e7f010f0-4de2-4a8a-a474-be0a4cf5daad","Type":"ContainerDied","Data":"dd654abd68846e7aed5db389a9611c87ef12a232aed6d2b777661c7ff509798b"} Jul 21 15:12:46.394731 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.394365 2559 scope.go:117] "RemoveContainer" containerID="7d5339ac643d747bdaef157b7258bb3ec1e3181d6f97cde131e260bc17adbd26" Jul 21 15:12:46.454534 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.454510 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:12:46.509007 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.508968 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-token\") pod \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " Jul 21 15:12:46.509228 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.509018 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-credential-socket\") pod \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " Jul 21 15:12:46.509228 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.509059 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk5t4\" (UniqueName: \"kubernetes.io/projected/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-kube-api-access-mk5t4\") pod \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " Jul 21 15:12:46.509228 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.509131 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-envoy\") pod \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " Jul 21 15:12:46.509228 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.509159 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istiod-ca-cert\") pod \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " Jul 21 15:12:46.509228 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.509190 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-podinfo\") pod \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " Jul 21 15:12:46.509512 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.509250 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-data\") pod \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " Jul 21 15:12:46.509512 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.509340 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-workload-certs\") pod \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " Jul 21 15:12:46.509512 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.509394 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e7f010f0-4de2-4a8a-a474-be0a4cf5daad" (UID: "e7f010f0-4de2-4a8a-a474-be0a4cf5daad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:12:46.509673 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.509650 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e7f010f0-4de2-4a8a-a474-be0a4cf5daad" (UID: "e7f010f0-4de2-4a8a-a474-be0a4cf5daad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:12:46.509736 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.509679 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e7f010f0-4de2-4a8a-a474-be0a4cf5daad" (UID: "e7f010f0-4de2-4a8a-a474-be0a4cf5daad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:12:46.509937 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.509901 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-workload-socket\") pod \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\" (UID: \"e7f010f0-4de2-4a8a-a474-be0a4cf5daad\") " Jul 21 15:12:46.510079 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.509945 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e7f010f0-4de2-4a8a-a474-be0a4cf5daad" (UID: "e7f010f0-4de2-4a8a-a474-be0a4cf5daad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:12:46.510351 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.510321 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-data" (OuterVolumeSpecName: "istio-data") pod "e7f010f0-4de2-4a8a-a474-be0a4cf5daad" (UID: "e7f010f0-4de2-4a8a-a474-be0a4cf5daad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:12:46.510351 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.510336 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-workload-certs\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:12:46.510511 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.510371 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-workload-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:12:46.510511 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.510389 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-credential-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:12:46.510511 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.510405 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istiod-ca-cert\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:12:46.511537 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.511513 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e7f010f0-4de2-4a8a-a474-be0a4cf5daad" (UID: "e7f010f0-4de2-4a8a-a474-be0a4cf5daad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:12:46.511657 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.511640 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-kube-api-access-mk5t4" (OuterVolumeSpecName: "kube-api-access-mk5t4") pod "e7f010f0-4de2-4a8a-a474-be0a4cf5daad" (UID: "e7f010f0-4de2-4a8a-a474-be0a4cf5daad"). InnerVolumeSpecName "kube-api-access-mk5t4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:12:46.511846 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.511783 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e7f010f0-4de2-4a8a-a474-be0a4cf5daad" (UID: "e7f010f0-4de2-4a8a-a474-be0a4cf5daad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 15:12:46.511846 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.511820 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-token" (OuterVolumeSpecName: "istio-token") pod "e7f010f0-4de2-4a8a-a474-be0a4cf5daad" (UID: "e7f010f0-4de2-4a8a-a474-be0a4cf5daad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:12:46.612060 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.611982 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-envoy\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:12:46.612060 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.612039 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-podinfo\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:12:46.612060 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.612055 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-data\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:12:46.612060 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.612068 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-istio-token\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:12:46.612060 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:46.612082 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mk5t4\" (UniqueName: \"kubernetes.io/projected/e7f010f0-4de2-4a8a-a474-be0a4cf5daad-kube-api-access-mk5t4\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:12:47.390101 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:47.390053 2559 patch_prober.go:28] interesting pod/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 21 15:12:47.390338 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:47.390149 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" podUID="e7f010f0-4de2-4a8a-a474-be0a4cf5daad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 21 15:12:47.401736 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:47.401698 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" Jul 21 15:12:47.402221 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:47.401739 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6" event={"ID":"e7f010f0-4de2-4a8a-a474-be0a4cf5daad","Type":"ContainerDied","Data":"15eaf9077f4f85812028106886467686ff7dc01aae160d96bb220fc3484882be"} Jul 21 15:12:47.402221 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:47.401821 2559 scope.go:117] "RemoveContainer" containerID="dd654abd68846e7aed5db389a9611c87ef12a232aed6d2b777661c7ff509798b" Jul 21 15:12:47.424217 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:47.424173 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6"] Jul 21 15:12:47.430287 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:47.430251 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-99a04e-openshift-default-56c5545c49-4kqf6"] Jul 21 15:12:48.121266 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:48.121230 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7f010f0-4de2-4a8a-a474-be0a4cf5daad" path="/var/lib/kubelet/pods/e7f010f0-4de2-4a8a-a474-be0a4cf5daad/volumes" Jul 21 15:12:50.421065 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.421024 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8"] Jul 21 15:12:50.421648 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.421447 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7f010f0-4de2-4a8a-a474-be0a4cf5daad" containerName="istio-proxy" Jul 21 15:12:50.421648 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.421460 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7f010f0-4de2-4a8a-a474-be0a4cf5daad" containerName="istio-proxy" Jul 21 15:12:50.421648 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.421475 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7f010f0-4de2-4a8a-a474-be0a4cf5daad" containerName="istio-proxy" Jul 21 15:12:50.421648 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.421480 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7f010f0-4de2-4a8a-a474-be0a4cf5daad" containerName="istio-proxy" Jul 21 15:12:50.421648 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.421537 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7f010f0-4de2-4a8a-a474-be0a4cf5daad" containerName="istio-proxy" Jul 21 15:12:50.421648 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.421547 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7f010f0-4de2-4a8a-a474-be0a4cf5daad" containerName="istio-proxy" Jul 21 15:12:50.421648 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.421554 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e110a76-30af-4f1a-9f53-93ae3071b8d1" containerName="istio-proxy" Jul 21 15:12:50.425658 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.425635 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.428013 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.427986 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-26fa51-openshift-default-dockercfg-6tp4q\"" Jul 21 15:12:50.435670 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.435628 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8"] Jul 21 15:12:50.553145 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.553100 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbpwj\" (UniqueName: \"kubernetes.io/projected/bc96b80e-0899-4fc5-90ed-303e8e82cda0-kube-api-access-zbpwj\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.553353 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.553152 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-workload-socket\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.553353 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.553185 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-credential-socket\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.553353 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.553240 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-data\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.553353 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.553263 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-podinfo\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.553353 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.553278 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istiod-ca-cert\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.553353 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.553301 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-envoy\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.553353 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.553325 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-token\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.553612 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.553400 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-workload-certs\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.654741 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.654677 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-data\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.654741 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.654738 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-podinfo\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.654741 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.654756 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istiod-ca-cert\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.655118 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.654781 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-envoy\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.655118 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.654829 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-token\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.655118 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.654858 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-workload-certs\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.655118 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.654918 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbpwj\" (UniqueName: \"kubernetes.io/projected/bc96b80e-0899-4fc5-90ed-303e8e82cda0-kube-api-access-zbpwj\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.655118 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.654966 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-workload-socket\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.655118 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.654999 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-credential-socket\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.655431 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.655237 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-data\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.655431 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.655406 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-workload-certs\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.655667 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.655644 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-credential-socket\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.655667 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.655655 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istiod-ca-cert\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.655851 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.655713 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-workload-socket\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.657354 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.657323 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-envoy\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.657567 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.657547 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-podinfo\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.662864 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.662789 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-token\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.662864 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.662862 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbpwj\" (UniqueName: \"kubernetes.io/projected/bc96b80e-0899-4fc5-90ed-303e8e82cda0-kube-api-access-zbpwj\") pod \"e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.737916 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.737872 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:50.904964 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.904930 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8"] Jul 21 15:12:50.912541 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.912498 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:12:50.912686 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.912598 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:12:50.912686 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:50.912643 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:12:51.303182 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:51.303142 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:12:51.432582 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:51.432543 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" event={"ID":"bc96b80e-0899-4fc5-90ed-303e8e82cda0","Type":"ContainerStarted","Data":"1cce7edcf4d020c5090f9d30e36cf8a6553ba0717a796acc4f2ceb065806dbd2"} Jul 21 15:12:51.433147 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:51.432599 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" event={"ID":"bc96b80e-0899-4fc5-90ed-303e8e82cda0","Type":"ContainerStarted","Data":"684ffc892bc66d96a56da13c5691f96eadd3bcd588e215ae5725426564424fe0"} Jul 21 15:12:51.453930 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:51.453867 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" podStartSLOduration=1.453845926 podStartE2EDuration="1.453845926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:12:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:12:51.451999345 +0000 UTC m=+2441.851144523" watchObservedRunningTime="2026-07-21 15:12:51.453845926 +0000 UTC m=+2441.852991106" Jul 21 15:12:51.738230 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:51.738183 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:51.744162 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:51.744126 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:52.440190 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:52.440149 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:52.441552 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:52.441523 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:12:59.926107 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:59.925408 2559 patch_prober.go:28] interesting pod/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": read tcp 10.132.0.2:33942->10.132.0.55:15021: read: connection reset by peer" start-of-body= Jul 21 15:12:59.926107 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:12:59.925475 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" podUID="c349160b-4160-465b-a3eb-46f4b591b6ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": read tcp 10.132.0.2:33942->10.132.0.55:15021: read: connection reset by peer" Jul 21 15:13:00.498844 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:00.498785 2559 generic.go:356] "Generic (PLEG): container finished" podID="c349160b-4160-465b-a3eb-46f4b591b6ed" containerID="66ac955187b4a5177cd2d07763c6b499e9aade0e3f5d93c5f12689bcc988f3ea" exitCode=0 Jul 21 15:13:00.499052 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:00.498864 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" event={"ID":"c349160b-4160-465b-a3eb-46f4b591b6ed","Type":"ContainerDied","Data":"66ac955187b4a5177cd2d07763c6b499e9aade0e3f5d93c5f12689bcc988f3ea"} Jul 21 15:13:00.499369 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:00.499351 2559 scope.go:117] "RemoveContainer" containerID="66ac955187b4a5177cd2d07763c6b499e9aade0e3f5d93c5f12689bcc988f3ea" Jul 21 15:13:00.500531 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:00.500499 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:13:00.500646 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:00.500596 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:13:00.500723 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:00.500656 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:13:01.507213 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:01.507176 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" event={"ID":"c349160b-4160-465b-a3eb-46f4b591b6ed","Type":"ContainerStarted","Data":"24f6d3a1b1f8cbe8f13c5210cb2cb6d7ab5e4fcef02cdffac6258ebff11a434e"} Jul 21 15:13:02.392252 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:02.392200 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:13:02.392525 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:02.392498 2559 patch_prober.go:28] interesting pod/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 21 15:13:02.392582 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:02.392553 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" podUID="c349160b-4160-465b-a3eb-46f4b591b6ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 21 15:13:03.392307 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:03.392256 2559 patch_prober.go:28] interesting pod/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 21 15:13:03.392733 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:03.392363 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" podUID="c349160b-4160-465b-a3eb-46f4b591b6ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 21 15:13:04.392141 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:04.392026 2559 patch_prober.go:28] interesting pod/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 21 15:13:04.392141 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:04.392098 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" podUID="c349160b-4160-465b-a3eb-46f4b591b6ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 21 15:13:05.391849 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:05.391813 2559 patch_prober.go:28] interesting pod/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 21 15:13:05.392067 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:05.391886 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" podUID="c349160b-4160-465b-a3eb-46f4b591b6ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 21 15:13:06.391604 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:06.391565 2559 patch_prober.go:28] interesting pod/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 21 15:13:06.392074 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:06.391624 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" podUID="c349160b-4160-465b-a3eb-46f4b591b6ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 21 15:13:07.392240 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:07.392197 2559 patch_prober.go:28] interesting pod/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 21 15:13:07.392676 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:07.392270 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" podUID="c349160b-4160-465b-a3eb-46f4b591b6ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 21 15:13:07.817670 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:07.816536 2559 patch_prober.go:28] interesting pod/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:54356->10.132.0.56:15021: read: connection reset by peer" start-of-body= Jul 21 15:13:07.817670 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:07.816622 2559 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" podUID="bc96b80e-0899-4fc5-90ed-303e8e82cda0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:54356->10.132.0.56:15021: read: connection reset by peer" Jul 21 15:13:08.396174 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:08.396135 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:13:08.396643 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:08.396469 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:13:08.397384 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:08.397362 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:13:08.554295 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:08.554261 2559 generic.go:356] "Generic (PLEG): container finished" podID="bc96b80e-0899-4fc5-90ed-303e8e82cda0" containerID="1cce7edcf4d020c5090f9d30e36cf8a6553ba0717a796acc4f2ceb065806dbd2" exitCode=0 Jul 21 15:13:08.554514 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:08.554338 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" event={"ID":"bc96b80e-0899-4fc5-90ed-303e8e82cda0","Type":"ContainerDied","Data":"1cce7edcf4d020c5090f9d30e36cf8a6553ba0717a796acc4f2ceb065806dbd2"} Jul 21 15:13:08.554818 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:08.554771 2559 scope.go:117] "RemoveContainer" containerID="1cce7edcf4d020c5090f9d30e36cf8a6553ba0717a796acc4f2ceb065806dbd2" Jul 21 15:13:08.555878 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:08.555845 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:13:08.555954 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:08.555937 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:13:08.556002 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:08.555991 2559 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 21 15:13:08.896179 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:08.896129 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:13:09.567539 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:09.567487 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" event={"ID":"bc96b80e-0899-4fc5-90ed-303e8e82cda0","Type":"ContainerStarted","Data":"20a584485859246148a57976644d02cbec71ce02b0b4948b790f2358ef69dac4"} Jul 21 15:13:09.738413 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:09.738367 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:13:09.738855 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:09.738822 2559 patch_prober.go:28] interesting pod/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 21 15:13:09.738986 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:09.738889 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" podUID="bc96b80e-0899-4fc5-90ed-303e8e82cda0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 21 15:13:10.738732 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:10.738680 2559 patch_prober.go:28] interesting pod/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 21 15:13:10.739344 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:10.738759 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" podUID="bc96b80e-0899-4fc5-90ed-303e8e82cda0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 21 15:13:11.739452 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:11.739409 2559 patch_prober.go:28] interesting pod/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 21 15:13:11.740065 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:11.739490 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" podUID="bc96b80e-0899-4fc5-90ed-303e8e82cda0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 21 15:13:12.738605 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:12.738558 2559 patch_prober.go:28] interesting pod/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 21 15:13:12.738851 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:12.738634 2559 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" podUID="bc96b80e-0899-4fc5-90ed-303e8e82cda0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 21 15:13:13.751620 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:13.751586 2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:13:13.752043 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:13.751976 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:13:13.752755 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:13.752737 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:13:18.789614 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:18.789569 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:13:35.701407 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:13:35.701349 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:14:02.201552 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:14:02.201508 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:14:19.401280 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:14:19.401241 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:14:37.304346 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:14:37.304312 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:14:54.896570 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:14:54.896534 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:15:13.802365 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:15:13.802331 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:15:31.495666 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:15:31.495629 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:15:48.599975 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:15:48.599898 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:15:58.796060 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:15:58.796025 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:16:34.995893 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:16:34.995854 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:16:54.092587 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:16:54.092554 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:17:10.332184 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:17:10.332107 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 15:17:10.340413 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:17:10.340392 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 15:17:11.110246 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:17:11.110212 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:17:30.295858 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:17:30.295819 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:18:07.800619 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:18:07.800587 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:18:49.602009 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:18:49.601929 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:19:05.005275 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:05.005242 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:19:13.872936 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:13.872900 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7282-140419710122288"] Jul 21 15:19:13.876214 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:13.876198 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710122288" Jul 21 15:19:13.878653 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:13.878637 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-d2ldv\"" Jul 21 15:19:13.883164 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:13.883143 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7282-140419710122288"] Jul 21 15:19:14.014398 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:14.014365 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5mtv\" (UniqueName: \"kubernetes.io/projected/4d3e023e-c067-43fc-8d3f-807014a3cd87-kube-api-access-c5mtv\") pod \"test-curl-7282-140419710122288\" (UID: \"4d3e023e-c067-43fc-8d3f-807014a3cd87\") " pod="opendatahub/test-curl-7282-140419710122288" Jul 21 15:19:14.115002 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:14.114963 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5mtv\" (UniqueName: \"kubernetes.io/projected/4d3e023e-c067-43fc-8d3f-807014a3cd87-kube-api-access-c5mtv\") pod \"test-curl-7282-140419710122288\" (UID: \"4d3e023e-c067-43fc-8d3f-807014a3cd87\") " pod="opendatahub/test-curl-7282-140419710122288" Jul 21 15:19:14.123391 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:14.123329 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5mtv\" (UniqueName: \"kubernetes.io/projected/4d3e023e-c067-43fc-8d3f-807014a3cd87-kube-api-access-c5mtv\") pod \"test-curl-7282-140419710122288\" (UID: \"4d3e023e-c067-43fc-8d3f-807014a3cd87\") " pod="opendatahub/test-curl-7282-140419710122288" Jul 21 15:19:14.186140 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:14.186107 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710122288" Jul 21 15:19:14.320095 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:14.320069 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7282-140419710122288"] Jul 21 15:19:14.322148 ip-10-0-131-241 kubenswrapper[2559]: W0721 15:19:14.322122 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d3e023e_c067_43fc_8d3f_807014a3cd87.slice/crio-fa8bfdf2c36e1d1b3d3166def3d2a5d07ec4a7a405c1dc30b9bec8cc8ddae07a WatchSource:0}: Error finding container fa8bfdf2c36e1d1b3d3166def3d2a5d07ec4a7a405c1dc30b9bec8cc8ddae07a: Status 404 returned error can't find the container with id fa8bfdf2c36e1d1b3d3166def3d2a5d07ec4a7a405c1dc30b9bec8cc8ddae07a Jul 21 15:19:14.323354 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:14.323335 2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 15:19:14.513909 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:14.513877 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7282-140419710122288" event={"ID":"4d3e023e-c067-43fc-8d3f-807014a3cd87","Type":"ContainerStarted","Data":"fa8bfdf2c36e1d1b3d3166def3d2a5d07ec4a7a405c1dc30b9bec8cc8ddae07a"} Jul 21 15:19:15.527782 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:15.527750 2559 generic.go:356] "Generic (PLEG): container finished" podID="4d3e023e-c067-43fc-8d3f-807014a3cd87" containerID="8781d7b6d205aac4164faac9de242a3a5e5361500ab43a17d08ba053f60fece0" exitCode=0 Jul 21 15:19:15.528194 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:15.527826 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7282-140419710122288" event={"ID":"4d3e023e-c067-43fc-8d3f-807014a3cd87","Type":"ContainerDied","Data":"8781d7b6d205aac4164faac9de242a3a5e5361500ab43a17d08ba053f60fece0"} Jul 21 15:19:16.668601 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:16.668577 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710122288" Jul 21 15:19:16.703026 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:16.702996 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7282-140419710122288_4d3e023e-c067-43fc-8d3f-807014a3cd87/test-curl-7282-140419710122288/0.log" Jul 21 15:19:16.729013 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:16.728980 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7282-140419710122288"] Jul 21 15:19:16.731065 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:16.731045 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7282-140419710122288"] Jul 21 15:19:16.737634 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:16.737611 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5mtv\" (UniqueName: \"kubernetes.io/projected/4d3e023e-c067-43fc-8d3f-807014a3cd87-kube-api-access-c5mtv\") pod \"4d3e023e-c067-43fc-8d3f-807014a3cd87\" (UID: \"4d3e023e-c067-43fc-8d3f-807014a3cd87\") " Jul 21 15:19:16.739969 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:16.739938 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d3e023e-c067-43fc-8d3f-807014a3cd87-kube-api-access-c5mtv" (OuterVolumeSpecName: "kube-api-access-c5mtv") pod "4d3e023e-c067-43fc-8d3f-807014a3cd87" (UID: "4d3e023e-c067-43fc-8d3f-807014a3cd87"). InnerVolumeSpecName "kube-api-access-c5mtv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:19:16.839375 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:16.839280 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5mtv\" (UniqueName: \"kubernetes.io/projected/4d3e023e-c067-43fc-8d3f-807014a3cd87-kube-api-access-c5mtv\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:19:16.850203 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:16.850166 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7282-140419710234928"] Jul 21 15:19:16.850745 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:16.850715 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d3e023e-c067-43fc-8d3f-807014a3cd87" containerName="test-curl-7282-140419710122288" Jul 21 15:19:16.850898 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:16.850842 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d3e023e-c067-43fc-8d3f-807014a3cd87" containerName="test-curl-7282-140419710122288" Jul 21 15:19:16.850989 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:16.850965 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d3e023e-c067-43fc-8d3f-807014a3cd87" containerName="test-curl-7282-140419710122288" Jul 21 15:19:16.854802 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:16.854762 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710234928" Jul 21 15:19:16.859288 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:16.859181 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7282-140419710234928"] Jul 21 15:19:16.940185 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:16.940140 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvn2b\" (UniqueName: \"kubernetes.io/projected/044e6114-2bb5-4fb3-8ef5-ed1b653996e1-kube-api-access-bvn2b\") pod \"test-curl-7282-140419710234928\" (UID: \"044e6114-2bb5-4fb3-8ef5-ed1b653996e1\") " pod="opendatahub/test-curl-7282-140419710234928" Jul 21 15:19:17.041435 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:17.041390 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvn2b\" (UniqueName: \"kubernetes.io/projected/044e6114-2bb5-4fb3-8ef5-ed1b653996e1-kube-api-access-bvn2b\") pod \"test-curl-7282-140419710234928\" (UID: \"044e6114-2bb5-4fb3-8ef5-ed1b653996e1\") " pod="opendatahub/test-curl-7282-140419710234928" Jul 21 15:19:17.052018 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:17.051990 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvn2b\" (UniqueName: \"kubernetes.io/projected/044e6114-2bb5-4fb3-8ef5-ed1b653996e1-kube-api-access-bvn2b\") pod \"test-curl-7282-140419710234928\" (UID: \"044e6114-2bb5-4fb3-8ef5-ed1b653996e1\") " pod="opendatahub/test-curl-7282-140419710234928" Jul 21 15:19:17.168591 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:17.168499 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710234928" Jul 21 15:19:17.310842 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:17.310815 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7282-140419710234928"] Jul 21 15:19:17.312671 ip-10-0-131-241 kubenswrapper[2559]: W0721 15:19:17.312641 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod044e6114_2bb5_4fb3_8ef5_ed1b653996e1.slice/crio-2cf42c397aaed26f3db00b2072cd37dd47503df9f74f5e083a3631e6180efac7 WatchSource:0}: Error finding container 2cf42c397aaed26f3db00b2072cd37dd47503df9f74f5e083a3631e6180efac7: Status 404 returned error can't find the container with id 2cf42c397aaed26f3db00b2072cd37dd47503df9f74f5e083a3631e6180efac7 Jul 21 15:19:17.540473 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:17.540437 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa8bfdf2c36e1d1b3d3166def3d2a5d07ec4a7a405c1dc30b9bec8cc8ddae07a" Jul 21 15:19:17.540473 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:17.540444 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710122288" Jul 21 15:19:17.541778 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:17.541749 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7282-140419710234928" event={"ID":"044e6114-2bb5-4fb3-8ef5-ed1b653996e1","Type":"ContainerStarted","Data":"2cf42c397aaed26f3db00b2072cd37dd47503df9f74f5e083a3631e6180efac7"} Jul 21 15:19:17.551122 ip-10-0-131-241 kubenswrapper[2559]: E0721 15:19:17.551094 2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7282-140419710122288\" is forbidden: User \"system:node:ip-10-0-131-241.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-241.ec2.internal' and this object" podUID="4d3e023e-c067-43fc-8d3f-807014a3cd87" pod="opendatahub/test-curl-7282-140419710122288" Jul 21 15:19:18.121059 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:18.121027 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d3e023e-c067-43fc-8d3f-807014a3cd87" path="/var/lib/kubelet/pods/4d3e023e-c067-43fc-8d3f-807014a3cd87/volumes" Jul 21 15:19:18.548851 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:18.548818 2559 generic.go:356] "Generic (PLEG): container finished" podID="044e6114-2bb5-4fb3-8ef5-ed1b653996e1" containerID="c512a5170f8ac54aedaa78a82362d754b434d3d4a3ca8c55348224fb410fb584" exitCode=0 Jul 21 15:19:18.549052 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:18.548879 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7282-140419710234928" event={"ID":"044e6114-2bb5-4fb3-8ef5-ed1b653996e1","Type":"ContainerDied","Data":"c512a5170f8ac54aedaa78a82362d754b434d3d4a3ca8c55348224fb410fb584"} Jul 21 15:19:19.694558 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:19.694529 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710234928" Jul 21 15:19:19.714277 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:19.714248 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7282-140419710234928_044e6114-2bb5-4fb3-8ef5-ed1b653996e1/test-curl-7282-140419710234928/0.log" Jul 21 15:19:19.736666 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:19.736629 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7282-140419710234928"] Jul 21 15:19:19.740400 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:19.740368 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7282-140419710234928"] Jul 21 15:19:19.763306 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:19.763283 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bvn2b\" (UniqueName: \"kubernetes.io/projected/044e6114-2bb5-4fb3-8ef5-ed1b653996e1-kube-api-access-bvn2b\") pod \"044e6114-2bb5-4fb3-8ef5-ed1b653996e1\" (UID: \"044e6114-2bb5-4fb3-8ef5-ed1b653996e1\") " Jul 21 15:19:19.765293 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:19.765269 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/044e6114-2bb5-4fb3-8ef5-ed1b653996e1-kube-api-access-bvn2b" (OuterVolumeSpecName: "kube-api-access-bvn2b") pod "044e6114-2bb5-4fb3-8ef5-ed1b653996e1" (UID: "044e6114-2bb5-4fb3-8ef5-ed1b653996e1"). InnerVolumeSpecName "kube-api-access-bvn2b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:19:19.864017 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:19.863942 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bvn2b\" (UniqueName: \"kubernetes.io/projected/044e6114-2bb5-4fb3-8ef5-ed1b653996e1-kube-api-access-bvn2b\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:19:19.895129 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:19.895097 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7282-140419710187248"] Jul 21 15:19:19.895463 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:19.895451 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="044e6114-2bb5-4fb3-8ef5-ed1b653996e1" containerName="test-curl-7282-140419710234928" Jul 21 15:19:19.895501 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:19.895464 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="044e6114-2bb5-4fb3-8ef5-ed1b653996e1" containerName="test-curl-7282-140419710234928" Jul 21 15:19:19.895552 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:19.895523 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="044e6114-2bb5-4fb3-8ef5-ed1b653996e1" containerName="test-curl-7282-140419710234928" Jul 21 15:19:19.898449 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:19.898434 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710187248" Jul 21 15:19:19.904229 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:19.904205 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7282-140419710187248"] Jul 21 15:19:19.964839 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:19.964783 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kh2h2\" (UniqueName: \"kubernetes.io/projected/6b9d2f41-5948-46a3-9a09-505f915eb015-kube-api-access-kh2h2\") pod \"test-curl-7282-140419710187248\" (UID: \"6b9d2f41-5948-46a3-9a09-505f915eb015\") " pod="opendatahub/test-curl-7282-140419710187248" Jul 21 15:19:20.066137 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:20.066096 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kh2h2\" (UniqueName: \"kubernetes.io/projected/6b9d2f41-5948-46a3-9a09-505f915eb015-kube-api-access-kh2h2\") pod \"test-curl-7282-140419710187248\" (UID: \"6b9d2f41-5948-46a3-9a09-505f915eb015\") " pod="opendatahub/test-curl-7282-140419710187248" Jul 21 15:19:20.074412 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:20.074381 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kh2h2\" (UniqueName: \"kubernetes.io/projected/6b9d2f41-5948-46a3-9a09-505f915eb015-kube-api-access-kh2h2\") pod \"test-curl-7282-140419710187248\" (UID: \"6b9d2f41-5948-46a3-9a09-505f915eb015\") " pod="opendatahub/test-curl-7282-140419710187248" Jul 21 15:19:20.120391 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:20.120325 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="044e6114-2bb5-4fb3-8ef5-ed1b653996e1" path="/var/lib/kubelet/pods/044e6114-2bb5-4fb3-8ef5-ed1b653996e1/volumes" Jul 21 15:19:20.208644 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:20.208618 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710187248" Jul 21 15:19:20.340669 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:20.340593 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7282-140419710187248"] Jul 21 15:19:20.342839 ip-10-0-131-241 kubenswrapper[2559]: W0721 15:19:20.342783 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b9d2f41_5948_46a3_9a09_505f915eb015.slice/crio-5360321127ff2fe5d75fe42dd7ec2eb2fbd7a2b32d9b118b5cf835892fae47b2 WatchSource:0}: Error finding container 5360321127ff2fe5d75fe42dd7ec2eb2fbd7a2b32d9b118b5cf835892fae47b2: Status 404 returned error can't find the container with id 5360321127ff2fe5d75fe42dd7ec2eb2fbd7a2b32d9b118b5cf835892fae47b2 Jul 21 15:19:20.560517 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:20.560485 2559 scope.go:117] "RemoveContainer" containerID="c512a5170f8ac54aedaa78a82362d754b434d3d4a3ca8c55348224fb410fb584" Jul 21 15:19:20.560517 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:20.560498 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710234928" Jul 21 15:19:20.561783 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:20.561757 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7282-140419710187248" event={"ID":"6b9d2f41-5948-46a3-9a09-505f915eb015","Type":"ContainerStarted","Data":"5360321127ff2fe5d75fe42dd7ec2eb2fbd7a2b32d9b118b5cf835892fae47b2"} Jul 21 15:19:21.570671 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:21.570636 2559 generic.go:356] "Generic (PLEG): container finished" podID="6b9d2f41-5948-46a3-9a09-505f915eb015" containerID="d0300a48a9729bebcc7236757b9c57fc6169a64680dd53861b137a316666c4fe" exitCode=0 Jul 21 15:19:21.571079 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:21.570716 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7282-140419710187248" event={"ID":"6b9d2f41-5948-46a3-9a09-505f915eb015","Type":"ContainerDied","Data":"d0300a48a9729bebcc7236757b9c57fc6169a64680dd53861b137a316666c4fe"} Jul 21 15:19:22.712138 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:22.712114 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710187248" Jul 21 15:19:22.730743 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:22.730717 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7282-140419710187248_6b9d2f41-5948-46a3-9a09-505f915eb015/test-curl-7282-140419710187248/0.log" Jul 21 15:19:22.752811 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:22.752769 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7282-140419710187248"] Jul 21 15:19:22.756455 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:22.756433 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7282-140419710187248"] Jul 21 15:19:22.788276 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:22.788245 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kh2h2\" (UniqueName: \"kubernetes.io/projected/6b9d2f41-5948-46a3-9a09-505f915eb015-kube-api-access-kh2h2\") pod \"6b9d2f41-5948-46a3-9a09-505f915eb015\" (UID: \"6b9d2f41-5948-46a3-9a09-505f915eb015\") " Jul 21 15:19:22.790297 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:22.790273 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b9d2f41-5948-46a3-9a09-505f915eb015-kube-api-access-kh2h2" (OuterVolumeSpecName: "kube-api-access-kh2h2") pod "6b9d2f41-5948-46a3-9a09-505f915eb015" (UID: "6b9d2f41-5948-46a3-9a09-505f915eb015"). InnerVolumeSpecName "kube-api-access-kh2h2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:19:22.873603 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:22.873533 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7282-140419710187248"] Jul 21 15:19:22.873893 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:22.873879 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b9d2f41-5948-46a3-9a09-505f915eb015" containerName="test-curl-7282-140419710187248" Jul 21 15:19:22.873935 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:22.873894 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b9d2f41-5948-46a3-9a09-505f915eb015" containerName="test-curl-7282-140419710187248" Jul 21 15:19:22.873979 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:22.873970 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b9d2f41-5948-46a3-9a09-505f915eb015" containerName="test-curl-7282-140419710187248" Jul 21 15:19:22.876856 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:22.876841 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710187248" Jul 21 15:19:22.882432 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:22.882410 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7282-140419710187248"] Jul 21 15:19:22.889765 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:22.889740 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kh2h2\" (UniqueName: \"kubernetes.io/projected/6b9d2f41-5948-46a3-9a09-505f915eb015-kube-api-access-kh2h2\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:19:22.990108 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:22.990079 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtstw\" (UniqueName: \"kubernetes.io/projected/5e09ee62-0cae-49f9-a161-029e149ed4aa-kube-api-access-qtstw\") pod \"test-curl-7282-140419710187248\" (UID: \"5e09ee62-0cae-49f9-a161-029e149ed4aa\") " pod="opendatahub/test-curl-7282-140419710187248" Jul 21 15:19:23.091313 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:23.091280 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtstw\" (UniqueName: \"kubernetes.io/projected/5e09ee62-0cae-49f9-a161-029e149ed4aa-kube-api-access-qtstw\") pod \"test-curl-7282-140419710187248\" (UID: \"5e09ee62-0cae-49f9-a161-029e149ed4aa\") " pod="opendatahub/test-curl-7282-140419710187248" Jul 21 15:19:23.099638 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:23.099609 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtstw\" (UniqueName: \"kubernetes.io/projected/5e09ee62-0cae-49f9-a161-029e149ed4aa-kube-api-access-qtstw\") pod \"test-curl-7282-140419710187248\" (UID: \"5e09ee62-0cae-49f9-a161-029e149ed4aa\") " pod="opendatahub/test-curl-7282-140419710187248" Jul 21 15:19:23.188155 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:23.188094 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710187248" Jul 21 15:19:23.316214 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:23.316189 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7282-140419710187248"] Jul 21 15:19:23.317693 ip-10-0-131-241 kubenswrapper[2559]: W0721 15:19:23.317668 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5e09ee62_0cae_49f9_a161_029e149ed4aa.slice/crio-4ade0d2b7bcc60a6fef43edfb86ab0c6f72ae9537e1abcd4d23bb03baa6be239 WatchSource:0}: Error finding container 4ade0d2b7bcc60a6fef43edfb86ab0c6f72ae9537e1abcd4d23bb03baa6be239: Status 404 returned error can't find the container with id 4ade0d2b7bcc60a6fef43edfb86ab0c6f72ae9537e1abcd4d23bb03baa6be239 Jul 21 15:19:23.582710 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:23.582682 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710187248" Jul 21 15:19:23.582877 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:23.582727 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5360321127ff2fe5d75fe42dd7ec2eb2fbd7a2b32d9b118b5cf835892fae47b2" Jul 21 15:19:23.583889 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:23.583867 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7282-140419710187248" event={"ID":"5e09ee62-0cae-49f9-a161-029e149ed4aa","Type":"ContainerStarted","Data":"4ade0d2b7bcc60a6fef43edfb86ab0c6f72ae9537e1abcd4d23bb03baa6be239"} Jul 21 15:19:23.594523 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:23.594496 2559 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7282-140419710187248" oldPodUID="6b9d2f41-5948-46a3-9a09-505f915eb015" podUID="5e09ee62-0cae-49f9-a161-029e149ed4aa" Jul 21 15:19:24.121695 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:24.121663 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b9d2f41-5948-46a3-9a09-505f915eb015" path="/var/lib/kubelet/pods/6b9d2f41-5948-46a3-9a09-505f915eb015/volumes" Jul 21 15:19:24.503012 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:24.502975 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:19:24.590206 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:24.590175 2559 generic.go:356] "Generic (PLEG): container finished" podID="5e09ee62-0cae-49f9-a161-029e149ed4aa" containerID="fda10cf0f8741c15793597cd1f72a48c90dd14db9c7d37e2912034ae88965f77" exitCode=0 Jul 21 15:19:24.590396 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:24.590245 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7282-140419710187248" event={"ID":"5e09ee62-0cae-49f9-a161-029e149ed4aa","Type":"ContainerDied","Data":"fda10cf0f8741c15793597cd1f72a48c90dd14db9c7d37e2912034ae88965f77"} Jul 21 15:19:25.741627 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:25.741597 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710187248" Jul 21 15:19:25.761307 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:25.761282 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7282-140419710187248_5e09ee62-0cae-49f9-a161-029e149ed4aa/test-curl-7282-140419710187248/0.log" Jul 21 15:19:25.786486 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:25.786460 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7282-140419710187248"] Jul 21 15:19:25.790332 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:25.790310 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7282-140419710187248"] Jul 21 15:19:25.812401 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:25.812381 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtstw\" (UniqueName: \"kubernetes.io/projected/5e09ee62-0cae-49f9-a161-029e149ed4aa-kube-api-access-qtstw\") pod \"5e09ee62-0cae-49f9-a161-029e149ed4aa\" (UID: \"5e09ee62-0cae-49f9-a161-029e149ed4aa\") " Jul 21 15:19:25.814382 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:25.814358 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e09ee62-0cae-49f9-a161-029e149ed4aa-kube-api-access-qtstw" (OuterVolumeSpecName: "kube-api-access-qtstw") pod "5e09ee62-0cae-49f9-a161-029e149ed4aa" (UID: "5e09ee62-0cae-49f9-a161-029e149ed4aa"). InnerVolumeSpecName "kube-api-access-qtstw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:19:25.913189 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:25.913123 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtstw\" (UniqueName: \"kubernetes.io/projected/5e09ee62-0cae-49f9-a161-029e149ed4aa-kube-api-access-qtstw\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:19:25.918225 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:25.918202 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7282-140419710211392"] Jul 21 15:19:25.918536 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:25.918524 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e09ee62-0cae-49f9-a161-029e149ed4aa" containerName="test-curl-7282-140419710187248" Jul 21 15:19:25.918578 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:25.918538 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e09ee62-0cae-49f9-a161-029e149ed4aa" containerName="test-curl-7282-140419710187248" Jul 21 15:19:25.918624 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:25.918614 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e09ee62-0cae-49f9-a161-029e149ed4aa" containerName="test-curl-7282-140419710187248" Jul 21 15:19:25.921359 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:25.921346 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710211392" Jul 21 15:19:25.927428 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:25.927406 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7282-140419710211392"] Jul 21 15:19:26.013992 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:26.013958 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm4sv\" (UniqueName: \"kubernetes.io/projected/0ead74c2-6e62-4725-8bf7-450999e0a28e-kube-api-access-nm4sv\") pod \"test-curl-7282-140419710211392\" (UID: \"0ead74c2-6e62-4725-8bf7-450999e0a28e\") " pod="opendatahub/test-curl-7282-140419710211392" Jul 21 15:19:26.115214 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:26.115180 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm4sv\" (UniqueName: \"kubernetes.io/projected/0ead74c2-6e62-4725-8bf7-450999e0a28e-kube-api-access-nm4sv\") pod \"test-curl-7282-140419710211392\" (UID: \"0ead74c2-6e62-4725-8bf7-450999e0a28e\") " pod="opendatahub/test-curl-7282-140419710211392" Jul 21 15:19:26.120968 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:26.120943 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e09ee62-0cae-49f9-a161-029e149ed4aa" path="/var/lib/kubelet/pods/5e09ee62-0cae-49f9-a161-029e149ed4aa/volumes" Jul 21 15:19:26.123297 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:26.123275 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm4sv\" (UniqueName: \"kubernetes.io/projected/0ead74c2-6e62-4725-8bf7-450999e0a28e-kube-api-access-nm4sv\") pod \"test-curl-7282-140419710211392\" (UID: \"0ead74c2-6e62-4725-8bf7-450999e0a28e\") " pod="opendatahub/test-curl-7282-140419710211392" Jul 21 15:19:26.231850 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:26.231822 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710211392" Jul 21 15:19:26.363772 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:26.363746 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7282-140419710211392"] Jul 21 15:19:26.365507 ip-10-0-131-241 kubenswrapper[2559]: W0721 15:19:26.365480 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ead74c2_6e62_4725_8bf7_450999e0a28e.slice/crio-d03bdc53f18fec0ee61740415b4b6f252df2cdfcb9a4bd96e51c9d951e2843f7 WatchSource:0}: Error finding container d03bdc53f18fec0ee61740415b4b6f252df2cdfcb9a4bd96e51c9d951e2843f7: Status 404 returned error can't find the container with id d03bdc53f18fec0ee61740415b4b6f252df2cdfcb9a4bd96e51c9d951e2843f7 Jul 21 15:19:26.602250 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:26.602165 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7282-140419710211392" event={"ID":"0ead74c2-6e62-4725-8bf7-450999e0a28e","Type":"ContainerStarted","Data":"d03bdc53f18fec0ee61740415b4b6f252df2cdfcb9a4bd96e51c9d951e2843f7"} Jul 21 15:19:26.603272 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:26.603250 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710187248" Jul 21 15:19:26.603357 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:26.603305 2559 scope.go:117] "RemoveContainer" containerID="fda10cf0f8741c15793597cd1f72a48c90dd14db9c7d37e2912034ae88965f77" Jul 21 15:19:27.610035 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:27.610006 2559 generic.go:356] "Generic (PLEG): container finished" podID="0ead74c2-6e62-4725-8bf7-450999e0a28e" containerID="9acc4418bcbcf8301651b850e0e829a95102b6124f6220c9d6846ff7294000c4" exitCode=0 Jul 21 15:19:27.610464 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:27.610086 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7282-140419710211392" event={"ID":"0ead74c2-6e62-4725-8bf7-450999e0a28e","Type":"ContainerDied","Data":"9acc4418bcbcf8301651b850e0e829a95102b6124f6220c9d6846ff7294000c4"} Jul 21 15:19:28.759947 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:28.759923 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710211392" Jul 21 15:19:28.780095 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:28.780068 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7282-140419710211392_0ead74c2-6e62-4725-8bf7-450999e0a28e/test-curl-7282-140419710211392/0.log" Jul 21 15:19:28.802890 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:28.802630 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7282-140419710211392"] Jul 21 15:19:28.804936 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:28.804920 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7282-140419710211392"] Jul 21 15:19:28.836766 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:28.836745 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nm4sv\" (UniqueName: \"kubernetes.io/projected/0ead74c2-6e62-4725-8bf7-450999e0a28e-kube-api-access-nm4sv\") pod \"0ead74c2-6e62-4725-8bf7-450999e0a28e\" (UID: \"0ead74c2-6e62-4725-8bf7-450999e0a28e\") " Jul 21 15:19:28.838773 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:28.838739 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ead74c2-6e62-4725-8bf7-450999e0a28e-kube-api-access-nm4sv" (OuterVolumeSpecName: "kube-api-access-nm4sv") pod "0ead74c2-6e62-4725-8bf7-450999e0a28e" (UID: "0ead74c2-6e62-4725-8bf7-450999e0a28e"). InnerVolumeSpecName "kube-api-access-nm4sv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:19:28.925626 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:28.925563 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7282-140419710211392"] Jul 21 15:19:28.925940 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:28.925926 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ead74c2-6e62-4725-8bf7-450999e0a28e" containerName="test-curl-7282-140419710211392" Jul 21 15:19:28.925992 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:28.925941 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ead74c2-6e62-4725-8bf7-450999e0a28e" containerName="test-curl-7282-140419710211392" Jul 21 15:19:28.926028 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:28.925996 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ead74c2-6e62-4725-8bf7-450999e0a28e" containerName="test-curl-7282-140419710211392" Jul 21 15:19:28.928890 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:28.928875 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710211392" Jul 21 15:19:28.935484 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:28.935451 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7282-140419710211392"] Jul 21 15:19:28.938311 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:28.938289 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm4sv\" (UniqueName: \"kubernetes.io/projected/0ead74c2-6e62-4725-8bf7-450999e0a28e-kube-api-access-nm4sv\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:19:29.039008 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:29.038962 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flnk7\" (UniqueName: \"kubernetes.io/projected/c3ee5298-ed14-4b23-9e51-025f5634cefd-kube-api-access-flnk7\") pod \"test-curl-7282-140419710211392\" (UID: \"c3ee5298-ed14-4b23-9e51-025f5634cefd\") " pod="opendatahub/test-curl-7282-140419710211392" Jul 21 15:19:29.139615 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:29.139582 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flnk7\" (UniqueName: \"kubernetes.io/projected/c3ee5298-ed14-4b23-9e51-025f5634cefd-kube-api-access-flnk7\") pod \"test-curl-7282-140419710211392\" (UID: \"c3ee5298-ed14-4b23-9e51-025f5634cefd\") " pod="opendatahub/test-curl-7282-140419710211392" Jul 21 15:19:29.148643 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:29.148617 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flnk7\" (UniqueName: \"kubernetes.io/projected/c3ee5298-ed14-4b23-9e51-025f5634cefd-kube-api-access-flnk7\") pod \"test-curl-7282-140419710211392\" (UID: \"c3ee5298-ed14-4b23-9e51-025f5634cefd\") " pod="opendatahub/test-curl-7282-140419710211392" Jul 21 15:19:29.250333 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:29.250305 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710211392" Jul 21 15:19:29.388168 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:29.388145 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7282-140419710211392"] Jul 21 15:19:29.389847 ip-10-0-131-241 kubenswrapper[2559]: W0721 15:19:29.389820 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3ee5298_ed14_4b23_9e51_025f5634cefd.slice/crio-1012091a0c4ff4432384682a19f4f90bcb7a278cbed56a56189fbfc268d39a6a WatchSource:0}: Error finding container 1012091a0c4ff4432384682a19f4f90bcb7a278cbed56a56189fbfc268d39a6a: Status 404 returned error can't find the container with id 1012091a0c4ff4432384682a19f4f90bcb7a278cbed56a56189fbfc268d39a6a Jul 21 15:19:29.623605 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:29.623517 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7282-140419710211392" event={"ID":"c3ee5298-ed14-4b23-9e51-025f5634cefd","Type":"ContainerStarted","Data":"1012091a0c4ff4432384682a19f4f90bcb7a278cbed56a56189fbfc268d39a6a"} Jul 21 15:19:29.624680 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:29.624658 2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d03bdc53f18fec0ee61740415b4b6f252df2cdfcb9a4bd96e51c9d951e2843f7" Jul 21 15:19:29.624837 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:29.624701 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710211392" Jul 21 15:19:29.636502 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:29.636476 2559 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7282-140419710211392" oldPodUID="0ead74c2-6e62-4725-8bf7-450999e0a28e" podUID="c3ee5298-ed14-4b23-9e51-025f5634cefd" Jul 21 15:19:30.120315 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:30.120282 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ead74c2-6e62-4725-8bf7-450999e0a28e" path="/var/lib/kubelet/pods/0ead74c2-6e62-4725-8bf7-450999e0a28e/volumes" Jul 21 15:19:30.631061 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:30.631029 2559 generic.go:356] "Generic (PLEG): container finished" podID="c3ee5298-ed14-4b23-9e51-025f5634cefd" containerID="6f358dd8d1eb16496b9d449ba9949ad57867638274969c1f104ea64657d1f014" exitCode=0 Jul 21 15:19:30.631237 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:30.631118 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7282-140419710211392" event={"ID":"c3ee5298-ed14-4b23-9e51-025f5634cefd","Type":"ContainerDied","Data":"6f358dd8d1eb16496b9d449ba9949ad57867638274969c1f104ea64657d1f014"} Jul 21 15:19:31.773533 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:31.773505 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710211392" Jul 21 15:19:31.794561 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:31.794534 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7282-140419710211392_c3ee5298-ed14-4b23-9e51-025f5634cefd/test-curl-7282-140419710211392/0.log" Jul 21 15:19:31.820327 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:31.820297 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7282-140419710211392"] Jul 21 15:19:31.822410 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:31.822385 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7282-140419710211392"] Jul 21 15:19:31.862343 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:31.862305 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flnk7\" (UniqueName: \"kubernetes.io/projected/c3ee5298-ed14-4b23-9e51-025f5634cefd-kube-api-access-flnk7\") pod \"c3ee5298-ed14-4b23-9e51-025f5634cefd\" (UID: \"c3ee5298-ed14-4b23-9e51-025f5634cefd\") " Jul 21 15:19:31.864383 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:31.864357 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3ee5298-ed14-4b23-9e51-025f5634cefd-kube-api-access-flnk7" (OuterVolumeSpecName: "kube-api-access-flnk7") pod "c3ee5298-ed14-4b23-9e51-025f5634cefd" (UID: "c3ee5298-ed14-4b23-9e51-025f5634cefd"). InnerVolumeSpecName "kube-api-access-flnk7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:19:31.963335 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:31.963309 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flnk7\" (UniqueName: \"kubernetes.io/projected/c3ee5298-ed14-4b23-9e51-025f5634cefd-kube-api-access-flnk7\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:19:32.120441 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:32.120408 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3ee5298-ed14-4b23-9e51-025f5634cefd" path="/var/lib/kubelet/pods/c3ee5298-ed14-4b23-9e51-025f5634cefd/volumes" Jul 21 15:19:32.645853 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:32.645824 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7282-140419710211392" Jul 21 15:19:32.646053 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:32.645861 2559 scope.go:117] "RemoveContainer" containerID="6f358dd8d1eb16496b9d449ba9949ad57867638274969c1f104ea64657d1f014" Jul 21 15:19:45.102967 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:45.102930 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:19:53.662775 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:53.662739 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6"] Jul 21 15:19:53.663288 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:53.663053 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" podUID="c349160b-4160-465b-a3eb-46f4b591b6ed" containerName="istio-proxy" containerID="cri-o://24f6d3a1b1f8cbe8f13c5210cb2cb6d7ab5e4fcef02cdffac6258ebff11a434e" gracePeriod=30 Jul 21 15:19:58.794488 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.794454 2559 generic.go:356] "Generic (PLEG): container finished" podID="c349160b-4160-465b-a3eb-46f4b591b6ed" containerID="24f6d3a1b1f8cbe8f13c5210cb2cb6d7ab5e4fcef02cdffac6258ebff11a434e" exitCode=0 Jul 21 15:19:58.794926 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.794527 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" event={"ID":"c349160b-4160-465b-a3eb-46f4b591b6ed","Type":"ContainerDied","Data":"24f6d3a1b1f8cbe8f13c5210cb2cb6d7ab5e4fcef02cdffac6258ebff11a434e"} Jul 21 15:19:58.794926 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.794589 2559 scope.go:117] "RemoveContainer" containerID="66ac955187b4a5177cd2d07763c6b499e9aade0e3f5d93c5f12689bcc988f3ea" Jul 21 15:19:58.919378 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.919353 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:19:58.994650 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.994618 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c349160b-4160-465b-a3eb-46f4b591b6ed-istiod-ca-cert\") pod \"c349160b-4160-465b-a3eb-46f4b591b6ed\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " Jul 21 15:19:58.994823 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.994661 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-token\") pod \"c349160b-4160-465b-a3eb-46f4b591b6ed\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " Jul 21 15:19:58.994823 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.994680 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-workload-certs\") pod \"c349160b-4160-465b-a3eb-46f4b591b6ed\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " Jul 21 15:19:58.994823 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.994710 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-credential-socket\") pod \"c349160b-4160-465b-a3eb-46f4b591b6ed\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " Jul 21 15:19:58.994823 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.994768 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-podinfo\") pod \"c349160b-4160-465b-a3eb-46f4b591b6ed\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " Jul 21 15:19:58.995105 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.994864 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-workload-socket\") pod \"c349160b-4160-465b-a3eb-46f4b591b6ed\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " Jul 21 15:19:58.995105 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.994886 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-data\") pod \"c349160b-4160-465b-a3eb-46f4b591b6ed\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " Jul 21 15:19:58.995105 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.994914 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4pmh\" (UniqueName: \"kubernetes.io/projected/c349160b-4160-465b-a3eb-46f4b591b6ed-kube-api-access-n4pmh\") pod \"c349160b-4160-465b-a3eb-46f4b591b6ed\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " Jul 21 15:19:58.995105 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.994941 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-envoy\") pod \"c349160b-4160-465b-a3eb-46f4b591b6ed\" (UID: \"c349160b-4160-465b-a3eb-46f4b591b6ed\") " Jul 21 15:19:58.995105 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.995058 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c349160b-4160-465b-a3eb-46f4b591b6ed" (UID: "c349160b-4160-465b-a3eb-46f4b591b6ed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:19:58.995380 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.995155 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c349160b-4160-465b-a3eb-46f4b591b6ed" (UID: "c349160b-4160-465b-a3eb-46f4b591b6ed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:19:58.995380 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.995222 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c349160b-4160-465b-a3eb-46f4b591b6ed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c349160b-4160-465b-a3eb-46f4b591b6ed" (UID: "c349160b-4160-465b-a3eb-46f4b591b6ed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:19:58.995380 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.995314 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c349160b-4160-465b-a3eb-46f4b591b6ed-istiod-ca-cert\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:19:58.995380 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.995330 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-credential-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:19:58.995380 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.995343 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-workload-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:19:58.995640 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.995444 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c349160b-4160-465b-a3eb-46f4b591b6ed" (UID: "c349160b-4160-465b-a3eb-46f4b591b6ed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:19:58.995921 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.995892 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-data" (OuterVolumeSpecName: "istio-data") pod "c349160b-4160-465b-a3eb-46f4b591b6ed" (UID: "c349160b-4160-465b-a3eb-46f4b591b6ed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:19:58.996966 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.996932 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-token" (OuterVolumeSpecName: "istio-token") pod "c349160b-4160-465b-a3eb-46f4b591b6ed" (UID: "c349160b-4160-465b-a3eb-46f4b591b6ed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:19:58.997070 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.997022 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c349160b-4160-465b-a3eb-46f4b591b6ed" (UID: "c349160b-4160-465b-a3eb-46f4b591b6ed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 15:19:58.997121 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.997072 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c349160b-4160-465b-a3eb-46f4b591b6ed" (UID: "c349160b-4160-465b-a3eb-46f4b591b6ed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:19:58.997245 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:58.997227 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c349160b-4160-465b-a3eb-46f4b591b6ed-kube-api-access-n4pmh" (OuterVolumeSpecName: "kube-api-access-n4pmh") pod "c349160b-4160-465b-a3eb-46f4b591b6ed" (UID: "c349160b-4160-465b-a3eb-46f4b591b6ed"). InnerVolumeSpecName "kube-api-access-n4pmh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:19:59.096561 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:59.096533 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-data\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:19:59.096561 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:59.096558 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4pmh\" (UniqueName: \"kubernetes.io/projected/c349160b-4160-465b-a3eb-46f4b591b6ed-kube-api-access-n4pmh\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:19:59.096713 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:59.096568 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-envoy\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:19:59.096713 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:59.096577 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-token\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:19:59.096713 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:59.096584 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c349160b-4160-465b-a3eb-46f4b591b6ed-workload-certs\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:19:59.096713 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:59.096591 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c349160b-4160-465b-a3eb-46f4b591b6ed-istio-podinfo\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:19:59.801586 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:59.801556 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" Jul 21 15:19:59.801586 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:59.801577 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6" event={"ID":"c349160b-4160-465b-a3eb-46f4b591b6ed","Type":"ContainerDied","Data":"44c98c5d739f577205bf3ff8b9890c177ae4abc0a5e1e36f01cad0532b357592"} Jul 21 15:19:59.802152 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:59.801629 2559 scope.go:117] "RemoveContainer" containerID="24f6d3a1b1f8cbe8f13c5210cb2cb6d7ab5e4fcef02cdffac6258ebff11a434e" Jul 21 15:19:59.823351 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:59.823327 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6"] Jul 21 15:19:59.830175 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:19:59.830152 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-9b06ae-openshift-default-846867959-kf8d6"] Jul 21 15:20:00.121887 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:00.121808 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c349160b-4160-465b-a3eb-46f4b591b6ed" path="/var/lib/kubelet/pods/c349160b-4160-465b-a3eb-46f4b591b6ed/volumes" Jul 21 15:20:07.595955 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:07.595869 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8h5zq"] Jul 21 15:20:15.604930 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:15.604894 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8"] Jul 21 15:20:15.605350 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:15.605094 2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" podUID="bc96b80e-0899-4fc5-90ed-303e8e82cda0" containerName="istio-proxy" containerID="cri-o://20a584485859246148a57976644d02cbec71ce02b0b4948b790f2358ef69dac4" gracePeriod=30 Jul 21 15:20:16.364687 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:16.364654 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5486f9cb8-g8q9n_1b407ae5-83a1-4c91-a9aa-e03cb3aa0bdd/authorino/0.log" Jul 21 15:20:20.857867 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.857846 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:20:20.925953 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.925873 2559 generic.go:356] "Generic (PLEG): container finished" podID="bc96b80e-0899-4fc5-90ed-303e8e82cda0" containerID="20a584485859246148a57976644d02cbec71ce02b0b4948b790f2358ef69dac4" exitCode=0 Jul 21 15:20:20.925953 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.925913 2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" Jul 21 15:20:20.926113 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.925962 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" event={"ID":"bc96b80e-0899-4fc5-90ed-303e8e82cda0","Type":"ContainerDied","Data":"20a584485859246148a57976644d02cbec71ce02b0b4948b790f2358ef69dac4"} Jul 21 15:20:20.926113 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.926015 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8" event={"ID":"bc96b80e-0899-4fc5-90ed-303e8e82cda0","Type":"ContainerDied","Data":"684ffc892bc66d96a56da13c5691f96eadd3bcd588e215ae5725426564424fe0"} Jul 21 15:20:20.926113 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.926043 2559 scope.go:117] "RemoveContainer" containerID="20a584485859246148a57976644d02cbec71ce02b0b4948b790f2358ef69dac4" Jul 21 15:20:20.934746 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.934729 2559 scope.go:117] "RemoveContainer" containerID="1cce7edcf4d020c5090f9d30e36cf8a6553ba0717a796acc4f2ceb065806dbd2" Jul 21 15:20:20.942463 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.942444 2559 scope.go:117] "RemoveContainer" containerID="20a584485859246148a57976644d02cbec71ce02b0b4948b790f2358ef69dac4" Jul 21 15:20:20.942710 ip-10-0-131-241 kubenswrapper[2559]: E0721 15:20:20.942691 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20a584485859246148a57976644d02cbec71ce02b0b4948b790f2358ef69dac4\": container with ID starting with 20a584485859246148a57976644d02cbec71ce02b0b4948b790f2358ef69dac4 not found: ID does not exist" containerID="20a584485859246148a57976644d02cbec71ce02b0b4948b790f2358ef69dac4" Jul 21 15:20:20.942778 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.942720 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20a584485859246148a57976644d02cbec71ce02b0b4948b790f2358ef69dac4"} err="failed to get container status \"20a584485859246148a57976644d02cbec71ce02b0b4948b790f2358ef69dac4\": rpc error: code = NotFound desc = could not find container \"20a584485859246148a57976644d02cbec71ce02b0b4948b790f2358ef69dac4\": container with ID starting with 20a584485859246148a57976644d02cbec71ce02b0b4948b790f2358ef69dac4 not found: ID does not exist" Jul 21 15:20:20.942778 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.942737 2559 scope.go:117] "RemoveContainer" containerID="1cce7edcf4d020c5090f9d30e36cf8a6553ba0717a796acc4f2ceb065806dbd2" Jul 21 15:20:20.942949 ip-10-0-131-241 kubenswrapper[2559]: E0721 15:20:20.942932 2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cce7edcf4d020c5090f9d30e36cf8a6553ba0717a796acc4f2ceb065806dbd2\": container with ID starting with 1cce7edcf4d020c5090f9d30e36cf8a6553ba0717a796acc4f2ceb065806dbd2 not found: ID does not exist" containerID="1cce7edcf4d020c5090f9d30e36cf8a6553ba0717a796acc4f2ceb065806dbd2" Jul 21 15:20:20.942990 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.942954 2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cce7edcf4d020c5090f9d30e36cf8a6553ba0717a796acc4f2ceb065806dbd2"} err="failed to get container status \"1cce7edcf4d020c5090f9d30e36cf8a6553ba0717a796acc4f2ceb065806dbd2\": rpc error: code = NotFound desc = could not find container \"1cce7edcf4d020c5090f9d30e36cf8a6553ba0717a796acc4f2ceb065806dbd2\": container with ID starting with 1cce7edcf4d020c5090f9d30e36cf8a6553ba0717a796acc4f2ceb065806dbd2 not found: ID does not exist" Jul 21 15:20:20.973241 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.973223 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbpwj\" (UniqueName: \"kubernetes.io/projected/bc96b80e-0899-4fc5-90ed-303e8e82cda0-kube-api-access-zbpwj\") pod \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " Jul 21 15:20:20.973331 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.973264 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-token\") pod \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " Jul 21 15:20:20.973331 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.973304 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-workload-certs\") pod \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " Jul 21 15:20:20.973454 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.973341 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-podinfo\") pod \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " Jul 21 15:20:20.973454 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.973385 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istiod-ca-cert\") pod \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " Jul 21 15:20:20.973567 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.973460 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-envoy\") pod \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " Jul 21 15:20:20.973567 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.973547 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-workload-socket\") pod \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " Jul 21 15:20:20.973676 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.973609 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc96b80e-0899-4fc5-90ed-303e8e82cda0" (UID: "bc96b80e-0899-4fc5-90ed-303e8e82cda0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:20:20.973676 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.973621 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-data\") pod \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " Jul 21 15:20:20.973676 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.973656 2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-credential-socket\") pod \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\" (UID: \"bc96b80e-0899-4fc5-90ed-303e8e82cda0\") " Jul 21 15:20:20.973869 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.973824 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc96b80e-0899-4fc5-90ed-303e8e82cda0" (UID: "bc96b80e-0899-4fc5-90ed-303e8e82cda0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:20:20.973950 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.973921 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc96b80e-0899-4fc5-90ed-303e8e82cda0" (UID: "bc96b80e-0899-4fc5-90ed-303e8e82cda0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 21 15:20:20.974065 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.974039 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc96b80e-0899-4fc5-90ed-303e8e82cda0" (UID: "bc96b80e-0899-4fc5-90ed-303e8e82cda0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:20:20.974178 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.974046 2559 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-workload-certs\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:20:20.974178 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.974091 2559 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istiod-ca-cert\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:20:20.974178 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.974108 2559 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-workload-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:20:20.974671 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.974643 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc96b80e-0899-4fc5-90ed-303e8e82cda0" (UID: "bc96b80e-0899-4fc5-90ed-303e8e82cda0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:20:20.975381 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.975360 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc96b80e-0899-4fc5-90ed-303e8e82cda0" (UID: "bc96b80e-0899-4fc5-90ed-303e8e82cda0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:20:20.975468 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.975449 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc96b80e-0899-4fc5-90ed-303e8e82cda0" (UID: "bc96b80e-0899-4fc5-90ed-303e8e82cda0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 15:20:20.975695 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.975671 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc96b80e-0899-4fc5-90ed-303e8e82cda0-kube-api-access-zbpwj" (OuterVolumeSpecName: "kube-api-access-zbpwj") pod "bc96b80e-0899-4fc5-90ed-303e8e82cda0" (UID: "bc96b80e-0899-4fc5-90ed-303e8e82cda0"). InnerVolumeSpecName "kube-api-access-zbpwj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 15:20:20.975786 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:20.975678 2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc96b80e-0899-4fc5-90ed-303e8e82cda0" (UID: "bc96b80e-0899-4fc5-90ed-303e8e82cda0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 21 15:20:21.075503 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:21.075478 2559 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-podinfo\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:20:21.075503 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:21.075501 2559 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-envoy\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:20:21.075503 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:21.075510 2559 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-data\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:20:21.075503 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:21.075518 2559 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc96b80e-0899-4fc5-90ed-303e8e82cda0-credential-socket\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:20:21.075761 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:21.075526 2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbpwj\" (UniqueName: \"kubernetes.io/projected/bc96b80e-0899-4fc5-90ed-303e8e82cda0-kube-api-access-zbpwj\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:20:21.075761 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:21.075537 2559 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc96b80e-0899-4fc5-90ed-303e8e82cda0-istio-token\") on node \"ip-10-0-131-241.ec2.internal\" DevicePath \"\"" Jul 21 15:20:21.249624 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:21.249595 2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8"] Jul 21 15:20:21.255740 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:21.255715 2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-26fa51-openshift-default-7bb4f6b9f-nxwx8"] Jul 21 15:20:22.120601 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:22.120571 2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc96b80e-0899-4fc5-90ed-303e8e82cda0" path="/var/lib/kubelet/pods/bc96b80e-0899-4fc5-90ed-303e8e82cda0/volumes" Jul 21 15:20:22.208896 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:22.208862 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7vvkl_a77170e4-3129-44d3-8f60-a594b3e89a6f/server/0.log" Jul 21 15:20:22.739157 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:22.739131 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b978d8c-vds4t_2f2dd5e8-d872-4c26-bdb2-6d879f1da786/copy-manifests/0.log" Jul 21 15:20:22.746435 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:22.746405 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b978d8c-vds4t_2f2dd5e8-d872-4c26-bdb2-6d879f1da786/manager/0.log" Jul 21 15:20:24.400703 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:24.400671 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95_f8490783-5a85-402f-811e-113358f568b7/util/0.log" Jul 21 15:20:24.406865 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:24.406842 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95_f8490783-5a85-402f-811e-113358f568b7/pull/0.log" Jul 21 15:20:24.412591 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:24.412566 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95_f8490783-5a85-402f-811e-113358f568b7/extract/0.log" Jul 21 15:20:24.536677 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:24.536647 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6_5923e0a3-8d11-4cc6-99de-d72974f07495/pull/0.log" Jul 21 15:20:24.542998 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:24.542972 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6_5923e0a3-8d11-4cc6-99de-d72974f07495/extract/0.log" Jul 21 15:20:24.552547 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:24.552527 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6_5923e0a3-8d11-4cc6-99de-d72974f07495/util/0.log" Jul 21 15:20:24.668093 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:24.668029 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw_cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7/util/0.log" Jul 21 15:20:24.675033 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:24.675011 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw_cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7/pull/0.log" Jul 21 15:20:24.681913 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:24.681890 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw_cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7/extract/0.log" Jul 21 15:20:24.808762 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:24.808741 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq_4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93/util/0.log" Jul 21 15:20:24.815197 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:24.815181 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq_4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93/pull/0.log" Jul 21 15:20:24.821833 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:24.821811 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq_4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93/extract/0.log" Jul 21 15:20:24.952899 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:24.952873 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5486f9cb8-g8q9n_1b407ae5-83a1-4c91-a9aa-e03cb3aa0bdd/authorino/0.log" Jul 21 15:20:25.341668 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:25.341590 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-shzzq_38c8b955-07c1-4aff-8a83-5a502e59110e/kuadrant-console-plugin/0.log" Jul 21 15:20:25.598502 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:25.598426 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fhd7m_32861055-e4d6-4dac-9d9d-2c1b9fd2711d/manager/0.log" Jul 21 15:20:25.751279 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:25.751247 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-8h5zq_d5f187bb-a49d-4ca6-8e1e-c8534f841eaf/limitador/0.log" Jul 21 15:20:26.253767 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:26.253737 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4gglhd_d2b5d575-a413-41af-8d3b-a81b778b6048/istio-proxy/0.log" Jul 21 15:20:26.737136 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:26.737101 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-4l6jn_f113d286-fe9b-4fd2-80e2-1184eea72d4e/istio-proxy/1.log" Jul 21 15:20:27.122780 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:27.122704 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56b4b5f45d-9tkdk_ebc3dc3f-3b6d-4745-bad2-b20b2c84f417/router/0.log" Jul 21 15:20:33.767171 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.767141 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-scg49/must-gather-29t8w"] Jul 21 15:20:33.767589 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.767502 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3ee5298-ed14-4b23-9e51-025f5634cefd" containerName="test-curl-7282-140419710211392" Jul 21 15:20:33.767589 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.767516 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3ee5298-ed14-4b23-9e51-025f5634cefd" containerName="test-curl-7282-140419710211392" Jul 21 15:20:33.767589 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.767532 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c349160b-4160-465b-a3eb-46f4b591b6ed" containerName="istio-proxy" Jul 21 15:20:33.767589 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.767538 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c349160b-4160-465b-a3eb-46f4b591b6ed" containerName="istio-proxy" Jul 21 15:20:33.767589 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.767550 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc96b80e-0899-4fc5-90ed-303e8e82cda0" containerName="istio-proxy" Jul 21 15:20:33.767589 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.767558 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc96b80e-0899-4fc5-90ed-303e8e82cda0" containerName="istio-proxy" Jul 21 15:20:33.767589 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.767576 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c349160b-4160-465b-a3eb-46f4b591b6ed" containerName="istio-proxy" Jul 21 15:20:33.767589 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.767584 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c349160b-4160-465b-a3eb-46f4b591b6ed" containerName="istio-proxy" Jul 21 15:20:33.767965 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.767684 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3ee5298-ed14-4b23-9e51-025f5634cefd" containerName="test-curl-7282-140419710211392" Jul 21 15:20:33.767965 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.767698 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc96b80e-0899-4fc5-90ed-303e8e82cda0" containerName="istio-proxy" Jul 21 15:20:33.767965 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.767714 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c349160b-4160-465b-a3eb-46f4b591b6ed" containerName="istio-proxy" Jul 21 15:20:33.767965 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.767719 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c349160b-4160-465b-a3eb-46f4b591b6ed" containerName="istio-proxy" Jul 21 15:20:33.767965 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.767786 2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc96b80e-0899-4fc5-90ed-303e8e82cda0" containerName="istio-proxy" Jul 21 15:20:33.767965 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.767808 2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc96b80e-0899-4fc5-90ed-303e8e82cda0" containerName="istio-proxy" Jul 21 15:20:33.767965 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.767896 2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc96b80e-0899-4fc5-90ed-303e8e82cda0" containerName="istio-proxy" Jul 21 15:20:33.772374 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.772352 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-scg49/must-gather-29t8w" Jul 21 15:20:33.775012 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.774991 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-scg49\"/\"openshift-service-ca.crt\"" Jul 21 15:20:33.775178 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.774993 2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-scg49\"/\"default-dockercfg-bd55p\"" Jul 21 15:20:33.775178 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.774996 2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-scg49\"/\"kube-root-ca.crt\"" Jul 21 15:20:33.778511 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.778491 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-scg49/must-gather-29t8w"] Jul 21 15:20:33.883831 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.883785 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9z7k\" (UniqueName: \"kubernetes.io/projected/00dd5e17-24ed-4c75-88a6-3cc5383717ca-kube-api-access-h9z7k\") pod \"must-gather-29t8w\" (UID: \"00dd5e17-24ed-4c75-88a6-3cc5383717ca\") " pod="openshift-must-gather-scg49/must-gather-29t8w" Jul 21 15:20:33.883952 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.883893 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/00dd5e17-24ed-4c75-88a6-3cc5383717ca-must-gather-output\") pod \"must-gather-29t8w\" (UID: \"00dd5e17-24ed-4c75-88a6-3cc5383717ca\") " pod="openshift-must-gather-scg49/must-gather-29t8w" Jul 21 15:20:33.984962 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.984937 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9z7k\" (UniqueName: \"kubernetes.io/projected/00dd5e17-24ed-4c75-88a6-3cc5383717ca-kube-api-access-h9z7k\") pod \"must-gather-29t8w\" (UID: \"00dd5e17-24ed-4c75-88a6-3cc5383717ca\") " pod="openshift-must-gather-scg49/must-gather-29t8w" Jul 21 15:20:33.985084 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.984987 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/00dd5e17-24ed-4c75-88a6-3cc5383717ca-must-gather-output\") pod \"must-gather-29t8w\" (UID: \"00dd5e17-24ed-4c75-88a6-3cc5383717ca\") " pod="openshift-must-gather-scg49/must-gather-29t8w" Jul 21 15:20:33.985251 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.985234 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/00dd5e17-24ed-4c75-88a6-3cc5383717ca-must-gather-output\") pod \"must-gather-29t8w\" (UID: \"00dd5e17-24ed-4c75-88a6-3cc5383717ca\") " pod="openshift-must-gather-scg49/must-gather-29t8w" Jul 21 15:20:33.993280 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:33.993257 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9z7k\" (UniqueName: \"kubernetes.io/projected/00dd5e17-24ed-4c75-88a6-3cc5383717ca-kube-api-access-h9z7k\") pod \"must-gather-29t8w\" (UID: \"00dd5e17-24ed-4c75-88a6-3cc5383717ca\") " pod="openshift-must-gather-scg49/must-gather-29t8w" Jul 21 15:20:34.082575 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:34.082500 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-scg49/must-gather-29t8w" Jul 21 15:20:34.211425 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:34.211395 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-scg49/must-gather-29t8w"] Jul 21 15:20:34.213251 ip-10-0-131-241 kubenswrapper[2559]: W0721 15:20:34.213227 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod00dd5e17_24ed_4c75_88a6_3cc5383717ca.slice/crio-1a3917a798fa86dd2a59e79061760f6cb606f2dfdbcf450deb7e5a5139e7e00a WatchSource:0}: Error finding container 1a3917a798fa86dd2a59e79061760f6cb606f2dfdbcf450deb7e5a5139e7e00a: Status 404 returned error can't find the container with id 1a3917a798fa86dd2a59e79061760f6cb606f2dfdbcf450deb7e5a5139e7e00a Jul 21 15:20:35.004498 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:35.004461 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-scg49/must-gather-29t8w" event={"ID":"00dd5e17-24ed-4c75-88a6-3cc5383717ca","Type":"ContainerStarted","Data":"1a3917a798fa86dd2a59e79061760f6cb606f2dfdbcf450deb7e5a5139e7e00a"} Jul 21 15:20:37.019671 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:37.019632 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-scg49/must-gather-29t8w" event={"ID":"00dd5e17-24ed-4c75-88a6-3cc5383717ca","Type":"ContainerStarted","Data":"ee080d39601cace6eec35153c7cd8dcd7b056dcf295eea9303dad75cb0dae968"} Jul 21 15:20:37.019671 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:37.019679 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-scg49/must-gather-29t8w" event={"ID":"00dd5e17-24ed-4c75-88a6-3cc5383717ca","Type":"ContainerStarted","Data":"f663db3d8845dd71718d765269916870cf592cc9001f8c659fb6f969de8ab7c7"} Jul 21 15:20:37.037015 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:37.036956 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-scg49/must-gather-29t8w" podStartSLOduration=1.797873097 podStartE2EDuration="4.036935411s" totalImagesPullingTime="2.239062314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 15:20:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:20:37.035134884 +0000 UTC m=+2907.434280064" watchObservedRunningTime="2026-07-21 15:20:37.036935411 +0000 UTC m=+2907.436080591" Jul 21 15:20:37.987693 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:37.987663 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-4zv85_47d4c102-9f81-49f9-901a-99fd62fd7315/global-pull-secret-syncer/0.log" Jul 21 15:20:38.292050 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:38.291974 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vzb6w_d051a06b-b3a7-450f-bb8a-bf17d427873b/konnectivity-agent/0.log" Jul 21 15:20:38.367686 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:38.367653 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-241.ec2.internal_0318e1bb0d0d8f4faaa7f8d44a8b0298/haproxy/0.log" Jul 21 15:20:42.697775 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:42.697694 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95_f8490783-5a85-402f-811e-113358f568b7/extract/0.log" Jul 21 15:20:42.726969 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:42.726936 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95_f8490783-5a85-402f-811e-113358f568b7/util/0.log" Jul 21 15:20:42.755057 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:42.755022 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759cdn95_f8490783-5a85-402f-811e-113358f568b7/pull/0.log" Jul 21 15:20:42.792766 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:42.792731 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6_5923e0a3-8d11-4cc6-99de-d72974f07495/extract/0.log" Jul 21 15:20:42.818908 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:42.818877 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6_5923e0a3-8d11-4cc6-99de-d72974f07495/util/0.log" Jul 21 15:20:42.848049 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:42.848012 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0vjgs6_5923e0a3-8d11-4cc6-99de-d72974f07495/pull/0.log" Jul 21 15:20:42.881276 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:42.881250 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw_cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7/extract/0.log" Jul 21 15:20:42.907380 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:42.907337 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw_cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7/util/0.log" Jul 21 15:20:42.932546 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:42.932512 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed737d7tw_cc1055ea-fbdd-46e2-95de-c5bbb78c7ac7/pull/0.log" Jul 21 15:20:42.960380 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:42.960353 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq_4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93/extract/0.log" Jul 21 15:20:42.985385 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:42.985351 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq_4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93/util/0.log" Jul 21 15:20:43.015840 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:43.015809 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qzzfq_4fc1f6c1-dae5-45e6-afeb-69dc7ccddd93/pull/0.log" Jul 21 15:20:43.647819 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:43.647625 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5486f9cb8-g8q9n_1b407ae5-83a1-4c91-a9aa-e03cb3aa0bdd/authorino/0.log" Jul 21 15:20:43.767813 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:43.766407 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-shzzq_38c8b955-07c1-4aff-8a83-5a502e59110e/kuadrant-console-plugin/0.log" Jul 21 15:20:44.162825 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:44.162736 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fhd7m_32861055-e4d6-4dac-9d9d-2c1b9fd2711d/manager/0.log" Jul 21 15:20:44.193543 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:44.193512 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-8h5zq_d5f187bb-a49d-4ca6-8e1e-c8534f841eaf/limitador/0.log" Jul 21 15:20:46.185379 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:46.185342 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-ll6gz_4c0543a5-61bd-497a-848f-6bb12c29f60d/cluster-monitoring-operator/0.log" Jul 21 15:20:46.488130 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:46.488099 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v6z8j_4dec691f-72c1-4519-a016-edd8cbc0bbc4/node-exporter/0.log" Jul 21 15:20:46.516814 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:46.516760 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v6z8j_4dec691f-72c1-4519-a016-edd8cbc0bbc4/kube-rbac-proxy/0.log" Jul 21 15:20:46.537841 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:46.537714 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v6z8j_4dec691f-72c1-4519-a016-edd8cbc0bbc4/init-textfile/0.log" Jul 21 15:20:48.006590 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.006551 2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg"] Jul 21 15:20:48.018035 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.018001 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg"] Jul 21 15:20:48.018219 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.018121 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" Jul 21 15:20:48.132184 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.132146 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9b4aea9c-5a7e-4868-ac9a-c4e3e535c199-proc\") pod \"perf-node-gather-daemonset-kwvpg\" (UID: \"9b4aea9c-5a7e-4868-ac9a-c4e3e535c199\") " pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" Jul 21 15:20:48.132680 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.132655 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9b4aea9c-5a7e-4868-ac9a-c4e3e535c199-podres\") pod \"perf-node-gather-daemonset-kwvpg\" (UID: \"9b4aea9c-5a7e-4868-ac9a-c4e3e535c199\") " pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" Jul 21 15:20:48.132907 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.132890 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b4aea9c-5a7e-4868-ac9a-c4e3e535c199-lib-modules\") pod \"perf-node-gather-daemonset-kwvpg\" (UID: \"9b4aea9c-5a7e-4868-ac9a-c4e3e535c199\") " pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" Jul 21 15:20:48.133024 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.133011 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b4aea9c-5a7e-4868-ac9a-c4e3e535c199-sys\") pod \"perf-node-gather-daemonset-kwvpg\" (UID: \"9b4aea9c-5a7e-4868-ac9a-c4e3e535c199\") " pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" Jul 21 15:20:48.133136 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.133123 2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvwcb\" (UniqueName: \"kubernetes.io/projected/9b4aea9c-5a7e-4868-ac9a-c4e3e535c199-kube-api-access-kvwcb\") pod \"perf-node-gather-daemonset-kwvpg\" (UID: \"9b4aea9c-5a7e-4868-ac9a-c4e3e535c199\") " pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" Jul 21 15:20:48.234278 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.234242 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b4aea9c-5a7e-4868-ac9a-c4e3e535c199-lib-modules\") pod \"perf-node-gather-daemonset-kwvpg\" (UID: \"9b4aea9c-5a7e-4868-ac9a-c4e3e535c199\") " pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" Jul 21 15:20:48.234278 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.234285 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b4aea9c-5a7e-4868-ac9a-c4e3e535c199-sys\") pod \"perf-node-gather-daemonset-kwvpg\" (UID: \"9b4aea9c-5a7e-4868-ac9a-c4e3e535c199\") " pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" Jul 21 15:20:48.234498 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.234334 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvwcb\" (UniqueName: \"kubernetes.io/projected/9b4aea9c-5a7e-4868-ac9a-c4e3e535c199-kube-api-access-kvwcb\") pod \"perf-node-gather-daemonset-kwvpg\" (UID: \"9b4aea9c-5a7e-4868-ac9a-c4e3e535c199\") " pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" Jul 21 15:20:48.234498 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.234376 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9b4aea9c-5a7e-4868-ac9a-c4e3e535c199-sys\") pod \"perf-node-gather-daemonset-kwvpg\" (UID: \"9b4aea9c-5a7e-4868-ac9a-c4e3e535c199\") " pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" Jul 21 15:20:48.234498 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.234388 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9b4aea9c-5a7e-4868-ac9a-c4e3e535c199-proc\") pod \"perf-node-gather-daemonset-kwvpg\" (UID: \"9b4aea9c-5a7e-4868-ac9a-c4e3e535c199\") " pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" Jul 21 15:20:48.234498 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.234428 2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9b4aea9c-5a7e-4868-ac9a-c4e3e535c199-podres\") pod \"perf-node-gather-daemonset-kwvpg\" (UID: \"9b4aea9c-5a7e-4868-ac9a-c4e3e535c199\") " pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" Jul 21 15:20:48.234498 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.234439 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9b4aea9c-5a7e-4868-ac9a-c4e3e535c199-proc\") pod \"perf-node-gather-daemonset-kwvpg\" (UID: \"9b4aea9c-5a7e-4868-ac9a-c4e3e535c199\") " pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" Jul 21 15:20:48.234775 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.234531 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9b4aea9c-5a7e-4868-ac9a-c4e3e535c199-podres\") pod \"perf-node-gather-daemonset-kwvpg\" (UID: \"9b4aea9c-5a7e-4868-ac9a-c4e3e535c199\") " pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" Jul 21 15:20:48.234775 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.234605 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9b4aea9c-5a7e-4868-ac9a-c4e3e535c199-lib-modules\") pod \"perf-node-gather-daemonset-kwvpg\" (UID: \"9b4aea9c-5a7e-4868-ac9a-c4e3e535c199\") " pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" Jul 21 15:20:48.243573 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.243542 2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvwcb\" (UniqueName: \"kubernetes.io/projected/9b4aea9c-5a7e-4868-ac9a-c4e3e535c199-kube-api-access-kvwcb\") pod \"perf-node-gather-daemonset-kwvpg\" (UID: \"9b4aea9c-5a7e-4868-ac9a-c4e3e535c199\") " pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" Jul 21 15:20:48.301720 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.301644 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-qpqqq_34992709-e4d4-4cae-8d06-0989d2a64a0c/networking-console-plugin/0.log" Jul 21 15:20:48.331691 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.331645 2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" Jul 21 15:20:48.525065 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.524954 2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg"] Jul 21 15:20:48.528648 ip-10-0-131-241 kubenswrapper[2559]: W0721 15:20:48.528560 2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9b4aea9c_5a7e_4868_ac9a_c4e3e535c199.slice/crio-37a1a234b23469a884523cee2b7970c17c20466a5f22afa04c121719964cbe3f WatchSource:0}: Error finding container 37a1a234b23469a884523cee2b7970c17c20466a5f22afa04c121719964cbe3f: Status 404 returned error can't find the container with id 37a1a234b23469a884523cee2b7970c17c20466a5f22afa04c121719964cbe3f Jul 21 15:20:48.943269 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.943180 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/1.log" Jul 21 15:20:48.953691 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:48.953645 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-spzgj_7acd8006-41bc-43da-a1b0-7f03cda70beb/console-operator/2.log" Jul 21 15:20:49.127632 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:49.127598 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" event={"ID":"9b4aea9c-5a7e-4868-ac9a-c4e3e535c199","Type":"ContainerStarted","Data":"7948d1f513fbd90780dee0ddc1d09624a0d9a7eca6f5558ed8576b55ba583c68"} Jul 21 15:20:49.128131 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:49.127663 2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" event={"ID":"9b4aea9c-5a7e-4868-ac9a-c4e3e535c199","Type":"ContainerStarted","Data":"37a1a234b23469a884523cee2b7970c17c20466a5f22afa04c121719964cbe3f"} Jul 21 15:20:49.128131 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:49.127688 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" Jul 21 15:20:49.146131 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:49.146073 2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" podStartSLOduration=2.146052905 podStartE2EDuration="2.146052905s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 15:20:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 15:20:49.142556416 +0000 UTC m=+2919.541701596" watchObservedRunningTime="2026-07-21 15:20:49.146052905 +0000 UTC m=+2919.545198086" Jul 21 15:20:49.500812 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:49.500767 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-slxw2_bcd8f8bf-96d7-401a-8af8-3df4a8f6a72f/download-server/0.log" Jul 21 15:20:50.058628 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:50.058602 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-wvnfr_4a55c7ed-23d4-44d5-9e9a-982469a93dd2/volume-data-source-validator/0.log" Jul 21 15:20:51.075170 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:51.075137 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f7lm7_a04bb16e-8ec8-442b-b0f2-1a8448f6e490/dns/0.log" Jul 21 15:20:51.099684 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:51.099649 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-f7lm7_a04bb16e-8ec8-442b-b0f2-1a8448f6e490/kube-rbac-proxy/0.log" Jul 21 15:20:51.215965 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:51.215931 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4wjk4_60210dbf-9a04-4c44-a654-d6fd2cf80403/dns-node-resolver/0.log" Jul 21 15:20:51.887811 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:51.887765 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l5lf7_f443a0aa-6687-44b0-9581-4e8953060962/node-ca/0.log" Jul 21 15:20:52.821119 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:52.821085 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4gglhd_d2b5d575-a413-41af-8d3b-a81b778b6048/istio-proxy/0.log" Jul 21 15:20:53.128860 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:53.128760 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-4l6jn_f113d286-fe9b-4fd2-80e2-1184eea72d4e/istio-proxy/0.log" Jul 21 15:20:53.185271 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:53.185242 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-4l6jn_f113d286-fe9b-4fd2-80e2-1184eea72d4e/istio-proxy/1.log" Jul 21 15:20:53.291617 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:53.291574 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56b4b5f45d-9tkdk_ebc3dc3f-3b6d-4745-bad2-b20b2c84f417/router/0.log" Jul 21 15:20:53.983332 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:53.983299 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d8gqr_a5ff6a0d-5a95-42e2-883a-0b73c40eb285/serve-healthcheck-canary/0.log" Jul 21 15:20:54.463515 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:54.463480 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-vw9pf_d8634880-5487-4cab-a0e5-99c821dfa8f9/insights-operator/0.log" Jul 21 15:20:54.465097 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:54.465072 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-vw9pf_d8634880-5487-4cab-a0e5-99c821dfa8f9/insights-operator/1.log" Jul 21 15:20:54.487202 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:54.487175 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kmthf_72e5392d-2e8f-4991-89c7-5944c96ba071/kube-rbac-proxy/0.log" Jul 21 15:20:54.508190 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:54.508162 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kmthf_72e5392d-2e8f-4991-89c7-5944c96ba071/exporter/0.log" Jul 21 15:20:54.529441 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:54.529394 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kmthf_72e5392d-2e8f-4991-89c7-5944c96ba071/extractor/0.log" Jul 21 15:20:55.147559 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:55.147523 2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-scg49/perf-node-gather-daemonset-kwvpg" Jul 21 15:20:57.355079 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:57.355037 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-7vvkl_a77170e4-3129-44d3-8f60-a594b3e89a6f/server/0.log" Jul 21 15:20:57.703126 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:57.703097 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b978d8c-vds4t_2f2dd5e8-d872-4c26-bdb2-6d879f1da786/manager/0.log" Jul 21 15:20:57.729296 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:57.729260 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-b978d8c-vds4t_2f2dd5e8-d872-4c26-bdb2-6d879f1da786/copy-manifests/0.log" Jul 21 15:20:58.493551 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:58.493505 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4gglhd_d2b5d575-a413-41af-8d3b-a81b778b6048/istio-proxy/0.log" Jul 21 15:20:58.772311 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:58.772267 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-4l6jn_f113d286-fe9b-4fd2-80e2-1184eea72d4e/istio-proxy/0.log" Jul 21 15:20:58.830676 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:58.830638 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-4l6jn_f113d286-fe9b-4fd2-80e2-1184eea72d4e/istio-proxy/1.log" Jul 21 15:20:58.905663 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:58.905624 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56b4b5f45d-9tkdk_ebc3dc3f-3b6d-4745-bad2-b20b2c84f417/router/0.log" Jul 21 15:20:59.017571 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:59.017539 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-77cc7cb7fc-f4s24_166f1d6a-23f2-4f94-9a7a-1cb3d931ddae/manager/0.log" Jul 21 15:20:59.069254 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:20:59.069161 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-q7btw_4b64bb3a-b75e-4ca8-a8fa-bc26e6515f68/openshift-lws-operator/0.log" Jul 21 15:21:00.151474 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:21:00.151440 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4gglhd_d2b5d575-a413-41af-8d3b-a81b778b6048/istio-proxy/0.log" Jul 21 15:21:00.424413 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:21:00.424345 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-4l6jn_f113d286-fe9b-4fd2-80e2-1184eea72d4e/istio-proxy/0.log" Jul 21 15:21:00.478245 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:21:00.478212 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-4l6jn_f113d286-fe9b-4fd2-80e2-1184eea72d4e/istio-proxy/1.log" Jul 21 15:21:00.556238 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:21:00.556209 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-56b4b5f45d-9tkdk_ebc3dc3f-3b6d-4745-bad2-b20b2c84f417/router/0.log" Jul 21 15:21:03.856808 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:21:03.856763 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-wb7sd_fefe4553-2a78-4118-96cc-c1b16d020e76/migrator/0.log" Jul 21 15:21:03.878252 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:21:03.878208 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-wb7sd_fefe4553-2a78-4118-96cc-c1b16d020e76/graceful-termination/0.log" Jul 21 15:21:04.239491 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:21:04.239461 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-h7ntq_fbc0f993-9ad3-4e74-9efd-f4697e056f73/kube-storage-version-migrator-operator/1.log" Jul 21 15:21:04.241206 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:21:04.241178 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-h7ntq_fbc0f993-9ad3-4e74-9efd-f4697e056f73/kube-storage-version-migrator-operator/0.log" Jul 21 15:21:05.209361 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:21:05.209333 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6dkcz_50a6cbf2-12aa-4865-bb4a-7da8da663354/kube-multus/0.log" Jul 21 15:21:05.232337 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:21:05.232314 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5lwvs_8dcb8d95-8dc6-44a6-96b7-40f6453a7a79/kube-multus-additional-cni-plugins/0.log" Jul 21 15:21:05.254010 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:21:05.253979 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5lwvs_8dcb8d95-8dc6-44a6-96b7-40f6453a7a79/egress-router-binary-copy/0.log" Jul 21 15:21:05.274977 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:21:05.274948 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5lwvs_8dcb8d95-8dc6-44a6-96b7-40f6453a7a79/cni-plugins/0.log" Jul 21 15:21:05.297023 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:21:05.296993 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5lwvs_8dcb8d95-8dc6-44a6-96b7-40f6453a7a79/bond-cni-plugin/0.log" Jul 21 15:21:05.318603 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:21:05.318571 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5lwvs_8dcb8d95-8dc6-44a6-96b7-40f6453a7a79/routeoverride-cni/0.log" Jul 21 15:21:05.339826 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:21:05.339776 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5lwvs_8dcb8d95-8dc6-44a6-96b7-40f6453a7a79/whereabouts-cni-bincopy/0.log" Jul 21 15:21:05.364260 ip-10-0-131-241 kubenswrapper[2559]: I0721 15:21:05.364209 2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5lwvs_8dcb8d95-8dc6-44a6-96b7-40f6453a7a79/whereabouts-cni/0.log"