Jul 22 18:14:03.976732 ip-10-0-132-65 systemd[1]: Starting Kubernetes Kubelet... Jul 22 18:14:04.299388 ip-10-0-132-65 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 18:14:04.299388 ip-10-0-132-65 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 22 18:14:04.299388 ip-10-0-132-65 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 18:14:04.299388 ip-10-0-132-65 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 22 18:14:04.299388 ip-10-0-132-65 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 22 18:14:04.300973 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.300853 2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 22 18:14:04.305464 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305442 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 18:14:04.305464 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305460 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 18:14:04.305464 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305465 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 18:14:04.305464 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305470 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 18:14:04.305702 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305475 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 18:14:04.305702 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305479 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 18:14:04.305702 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305483 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 18:14:04.305702 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305487 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 18:14:04.305702 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305491 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 18:14:04.305702 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305495 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 18:14:04.305702 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305499 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 18:14:04.305702 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305502 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 18:14:04.305702 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305507 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 18:14:04.305702 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305511 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 18:14:04.305702 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305517 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 18:14:04.305702 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305520 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 18:14:04.305702 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305524 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 18:14:04.305702 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305528 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 18:14:04.305702 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305532 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 18:14:04.305702 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305540 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 18:14:04.305702 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305545 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 18:14:04.305702 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305549 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 18:14:04.305702 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305553 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 18:14:04.306501 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305556 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 18:14:04.306501 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305560 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 18:14:04.306501 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305564 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 18:14:04.306501 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305568 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 18:14:04.306501 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305572 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 18:14:04.306501 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305576 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 18:14:04.306501 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305579 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 18:14:04.306501 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305583 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 18:14:04.306501 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305587 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 18:14:04.306501 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305591 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 18:14:04.306501 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305595 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 18:14:04.306501 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305600 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 18:14:04.306501 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305605 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 18:14:04.306501 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305609 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 18:14:04.306501 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305614 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 18:14:04.306501 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305619 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 18:14:04.306501 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305623 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 18:14:04.306501 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305627 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 18:14:04.306501 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305631 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 18:14:04.306501 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305635 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 18:14:04.307340 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305640 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 18:14:04.307340 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305644 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 18:14:04.307340 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305648 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 18:14:04.307340 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305652 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 18:14:04.307340 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305659 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 18:14:04.307340 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305664 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 18:14:04.307340 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305669 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 18:14:04.307340 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305677 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 18:14:04.307340 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305685 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 18:14:04.307340 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305690 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 18:14:04.307340 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305694 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 18:14:04.307340 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305698 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 18:14:04.307340 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305703 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 18:14:04.307340 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305707 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 18:14:04.307340 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305711 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 18:14:04.307340 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305715 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 18:14:04.307340 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305720 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 18:14:04.307340 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305724 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 18:14:04.307340 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305729 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 18:14:04.308155 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305733 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 18:14:04.308155 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305737 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 18:14:04.308155 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305741 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 18:14:04.308155 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305746 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 18:14:04.308155 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305750 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 18:14:04.308155 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305755 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 18:14:04.308155 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305759 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 18:14:04.308155 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305763 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 18:14:04.308155 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305768 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 18:14:04.308155 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305772 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 18:14:04.308155 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305776 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 18:14:04.308155 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305780 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 18:14:04.308155 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305785 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 18:14:04.308155 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305789 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 18:14:04.308155 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305793 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 18:14:04.308155 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305798 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 18:14:04.308155 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305805 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 18:14:04.308155 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305809 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 18:14:04.308155 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305813 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 18:14:04.308155 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305819 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 18:14:04.309026 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305823 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 18:14:04.309026 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305827 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 18:14:04.309026 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305831 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 18:14:04.309026 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305835 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 18:14:04.309026 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305841 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 18:14:04.309026 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305847 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 18:14:04.309026 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305852 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 18:14:04.309026 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305857 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 18:14:04.309026 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305862 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 18:14:04.309026 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305866 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 22 18:14:04.309026 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305872 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 18:14:04.309026 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305876 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 18:14:04.309026 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305881 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 18:14:04.309026 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305885 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 18:14:04.309026 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305890 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 18:14:04.309026 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305894 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 18:14:04.309026 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.305898 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 18:14:04.309026 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307073 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 18:14:04.309026 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307082 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 18:14:04.309026 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307087 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 18:14:04.309878 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307092 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 18:14:04.309878 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307096 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 18:14:04.309878 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307102 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 18:14:04.309878 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307106 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 18:14:04.309878 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307110 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 18:14:04.309878 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307115 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 18:14:04.309878 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307120 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 18:14:04.309878 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307125 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 18:14:04.309878 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307129 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 18:14:04.309878 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307134 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 18:14:04.309878 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307138 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 18:14:04.309878 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307142 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 18:14:04.309878 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307146 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 18:14:04.309878 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307150 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 18:14:04.309878 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307154 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 18:14:04.309878 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307158 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 18:14:04.309878 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307162 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 18:14:04.309878 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307167 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 18:14:04.309878 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307171 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 18:14:04.310592 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307175 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 18:14:04.310592 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307179 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 18:14:04.310592 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307183 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 18:14:04.310592 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307187 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 18:14:04.310592 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307192 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 18:14:04.310592 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307197 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 18:14:04.310592 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307201 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 18:14:04.310592 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307205 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 22 18:14:04.310592 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307210 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 18:14:04.310592 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307214 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 18:14:04.310592 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307220 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 18:14:04.310592 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307233 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 18:14:04.310592 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307238 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 18:14:04.310592 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307243 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 18:14:04.310592 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307247 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 18:14:04.310592 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307253 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 18:14:04.310592 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307257 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 18:14:04.310592 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307261 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 18:14:04.310592 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307266 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 18:14:04.310592 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307270 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 18:14:04.311254 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307276 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 18:14:04.311254 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307280 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 18:14:04.311254 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307284 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 18:14:04.311254 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307288 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 18:14:04.311254 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307293 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 18:14:04.311254 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307296 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 18:14:04.311254 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307300 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 18:14:04.311254 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307307 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 18:14:04.311254 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307312 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 18:14:04.311254 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307316 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 18:14:04.311254 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307320 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 18:14:04.311254 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307324 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 18:14:04.311254 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307328 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 18:14:04.311254 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307332 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 18:14:04.311254 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307336 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 18:14:04.311254 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307341 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 18:14:04.311254 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307347 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 18:14:04.311254 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307353 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 18:14:04.311254 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307357 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 18:14:04.311254 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307362 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 18:14:04.311854 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307366 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 18:14:04.311854 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307370 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 18:14:04.311854 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307374 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 18:14:04.311854 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307378 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 18:14:04.311854 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307383 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 18:14:04.311854 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307387 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 18:14:04.311854 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307391 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 18:14:04.311854 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307396 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 18:14:04.311854 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307400 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 18:14:04.311854 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307404 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 18:14:04.311854 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307408 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 18:14:04.311854 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307432 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 18:14:04.311854 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307436 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 18:14:04.311854 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307441 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 18:14:04.311854 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307445 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 18:14:04.311854 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307449 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 18:14:04.311854 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307457 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 18:14:04.311854 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307462 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 18:14:04.311854 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307468 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 18:14:04.311854 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307472 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 18:14:04.312357 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307477 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 18:14:04.312357 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307481 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 18:14:04.312357 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307486 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 18:14:04.312357 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307490 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 18:14:04.312357 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307495 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 18:14:04.312357 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307499 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 18:14:04.312357 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307504 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 18:14:04.312357 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307508 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 18:14:04.312357 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307513 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 18:14:04.312357 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307517 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 18:14:04.312357 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307523 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 18:14:04.312357 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307527 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 18:14:04.312357 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307531 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 18:14:04.312357 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307535 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 18:14:04.312357 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307539 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 18:14:04.312357 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307544 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 18:14:04.312357 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.307548 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 18:14:04.312357 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308139 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 18:14:04.312357 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308146 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 18:14:04.312357 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308150 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 18:14:04.313019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308154 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 18:14:04.313019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308159 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 18:14:04.313019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308163 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 18:14:04.313019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308167 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 18:14:04.313019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308170 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 18:14:04.313019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308176 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 18:14:04.313019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308180 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 18:14:04.313019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308184 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 18:14:04.313019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308188 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 18:14:04.313019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308192 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 18:14:04.313019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308196 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 18:14:04.313019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308201 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 18:14:04.313019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308205 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 18:14:04.313019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308209 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 18:14:04.313019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308213 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 18:14:04.313019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308217 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 18:14:04.313019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308221 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 18:14:04.313019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308225 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 18:14:04.313019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308229 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 18:14:04.313019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308233 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 18:14:04.313546 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308237 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 18:14:04.313546 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308242 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 18:14:04.313546 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308246 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 18:14:04.313546 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308250 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 18:14:04.313546 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308254 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 18:14:04.313546 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308259 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 18:14:04.313546 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308263 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 18:14:04.313546 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308267 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 18:14:04.313546 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308271 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 18:14:04.313546 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308275 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 18:14:04.313546 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308279 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 18:14:04.313546 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308283 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 18:14:04.313546 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308287 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 18:14:04.313546 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308291 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 18:14:04.313546 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308295 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 18:14:04.313546 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308299 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 18:14:04.313546 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308303 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 18:14:04.313546 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308307 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 18:14:04.313546 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308311 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 22 18:14:04.313546 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308316 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 18:14:04.314019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308320 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 18:14:04.314019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308324 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 18:14:04.314019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308328 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 18:14:04.314019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308334 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 18:14:04.314019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308339 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 18:14:04.314019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308344 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 18:14:04.314019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308348 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 18:14:04.314019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308352 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 18:14:04.314019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308356 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 18:14:04.314019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308360 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 18:14:04.314019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308364 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 18:14:04.314019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308369 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 18:14:04.314019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308373 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 18:14:04.314019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308378 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 18:14:04.314019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308382 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 18:14:04.314019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308386 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 18:14:04.314019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308393 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 18:14:04.314019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308397 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 18:14:04.314019 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308401 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 18:14:04.314494 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308405 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 18:14:04.314494 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308409 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 18:14:04.314494 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308432 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 18:14:04.314494 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308437 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 18:14:04.314494 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308441 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 18:14:04.314494 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308445 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 18:14:04.314494 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308449 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 18:14:04.314494 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308452 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 18:14:04.314494 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308456 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 18:14:04.314494 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308460 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 18:14:04.314494 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308464 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 18:14:04.314494 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308468 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 18:14:04.314494 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308473 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 18:14:04.314494 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308478 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 18:14:04.314494 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308482 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 18:14:04.314494 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308486 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 18:14:04.314494 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308490 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 18:14:04.314494 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308494 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 18:14:04.314494 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308498 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 18:14:04.314494 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308502 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 18:14:04.314494 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308507 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 18:14:04.314991 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308511 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 18:14:04.314991 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308515 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 18:14:04.314991 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308523 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 18:14:04.314991 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308529 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 18:14:04.314991 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308534 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 18:14:04.314991 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308539 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 18:14:04.314991 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308543 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 18:14:04.314991 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308547 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 18:14:04.314991 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308553 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 18:14:04.314991 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308558 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 18:14:04.314991 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308564 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 18:14:04.314991 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308570 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 18:14:04.314991 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308575 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 18:14:04.314991 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308580 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 18:14:04.314991 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308584 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 18:14:04.314991 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.308589 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 18:14:04.314991 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308696 2554 flags.go:64] FLAG: --address="0.0.0.0" Jul 22 18:14:04.314991 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308707 2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 22 18:14:04.314991 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308718 2554 flags.go:64] FLAG: --anonymous-auth="true" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308725 2554 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308731 2554 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308737 2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308743 2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308749 2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308756 2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308761 2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308766 2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308772 2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308776 2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308781 2554 flags.go:64] FLAG: --cgroup-root="" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308785 2554 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308790 2554 flags.go:64] FLAG: --client-ca-file="" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308794 2554 flags.go:64] FLAG: --cloud-provider="external" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308799 2554 flags.go:64] FLAG: --cluster-dns="[]" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308805 2554 flags.go:64] FLAG: --cluster-domain="" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308810 2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308815 2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308820 2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308825 2554 flags.go:64] FLAG: --container-log-max-files="5" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308831 2554 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308839 2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 22 18:14:04.315504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308844 2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308849 2554 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308854 2554 flags.go:64] FLAG: --contention-profiling="false" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308859 2554 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308863 2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308868 2554 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308872 2554 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308879 2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308885 2554 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308890 2554 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308894 2554 flags.go:64] FLAG: --enable-load-reader="false" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308899 2554 flags.go:64] FLAG: --enable-server="true" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308904 2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308912 2554 flags.go:64] FLAG: --event-burst="100" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308916 2554 flags.go:64] FLAG: --event-qps="50" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308921 2554 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308927 2554 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308931 2554 flags.go:64] FLAG: --eviction-hard="" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308937 2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308942 2554 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308946 2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308951 2554 flags.go:64] FLAG: --eviction-soft="" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308956 2554 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308960 2554 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308965 2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 22 18:14:04.316139 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308969 2554 flags.go:64] FLAG: --experimental-mounter-path="" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308974 2554 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308978 2554 flags.go:64] FLAG: --fail-swap-on="true" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308983 2554 flags.go:64] FLAG: --feature-gates="" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308989 2554 flags.go:64] FLAG: --file-check-frequency="20s" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.308994 2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309001 2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309006 2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309011 2554 flags.go:64] FLAG: --healthz-port="10248" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309016 2554 flags.go:64] FLAG: --help="false" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309020 2554 flags.go:64] FLAG: --hostname-override="ip-10-0-132-65.ec2.internal" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309024 2554 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309029 2554 flags.go:64] FLAG: --http-check-frequency="20s" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309033 2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309038 2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309043 2554 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309047 2554 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309052 2554 flags.go:64] FLAG: --image-service-endpoint="" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309057 2554 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309062 2554 flags.go:64] FLAG: --kube-api-burst="100" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309066 2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309071 2554 flags.go:64] FLAG: --kube-api-qps="50" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309076 2554 flags.go:64] FLAG: --kube-reserved="" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309080 2554 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 22 18:14:04.316766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309085 2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309090 2554 flags.go:64] FLAG: --kubelet-cgroups="" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309095 2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309099 2554 flags.go:64] FLAG: --lock-file="" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309103 2554 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309108 2554 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309115 2554 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309124 2554 flags.go:64] FLAG: --log-json-split-stream="false" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309129 2554 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309133 2554 flags.go:64] FLAG: --log-text-split-stream="false" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309138 2554 flags.go:64] FLAG: --logging-format="text" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309142 2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309148 2554 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309152 2554 flags.go:64] FLAG: --manifest-url="" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309157 2554 flags.go:64] FLAG: --manifest-url-header="" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309164 2554 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309168 2554 flags.go:64] FLAG: --max-open-files="1000000" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309175 2554 flags.go:64] FLAG: --max-pods="110" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309180 2554 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309185 2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309190 2554 flags.go:64] FLAG: --memory-manager-policy="None" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309194 2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309199 2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309204 2554 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309208 2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 22 18:14:04.317354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309228 2554 flags.go:64] FLAG: --node-status-max-images="50" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309233 2554 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309238 2554 flags.go:64] FLAG: --oom-score-adj="-999" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309242 2554 flags.go:64] FLAG: --pod-cidr="" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309247 2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309256 2554 flags.go:64] FLAG: --pod-manifest-path="" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309261 2554 flags.go:64] FLAG: --pod-max-pids="-1" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309266 2554 flags.go:64] FLAG: --pods-per-core="0" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309271 2554 flags.go:64] FLAG: --port="10250" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309276 2554 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309281 2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a8e6c4a09e82715a" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309286 2554 flags.go:64] FLAG: --qos-reserved="" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309290 2554 flags.go:64] FLAG: --read-only-port="10255" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309295 2554 flags.go:64] FLAG: --register-node="true" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309301 2554 flags.go:64] FLAG: --register-with-taints="" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309308 2554 flags.go:64] FLAG: --registry-burst="10" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309312 2554 flags.go:64] FLAG: --registry-qps="5" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309316 2554 flags.go:64] FLAG: --reserved-cpus="" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309321 2554 flags.go:64] FLAG: --reserved-memory="" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309326 2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309331 2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309336 2554 flags.go:64] FLAG: --rotate-certificates="false" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309341 2554 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309345 2554 flags.go:64] FLAG: --runonce="false" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309350 2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 22 18:14:04.317982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309355 2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309360 2554 flags.go:64] FLAG: --seccomp-default="false" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309364 2554 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309369 2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309373 2554 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309378 2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309383 2554 flags.go:64] FLAG: --storage-driver-password="root" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309388 2554 flags.go:64] FLAG: --storage-driver-secure="false" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309393 2554 flags.go:64] FLAG: --storage-driver-table="stats" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309397 2554 flags.go:64] FLAG: --storage-driver-user="root" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309402 2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309407 2554 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309431 2554 flags.go:64] FLAG: --system-cgroups="" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309437 2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309446 2554 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309451 2554 flags.go:64] FLAG: --tls-cert-file="" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309456 2554 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309462 2554 flags.go:64] FLAG: --tls-min-version="" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309467 2554 flags.go:64] FLAG: --tls-private-key-file="" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309471 2554 flags.go:64] FLAG: --topology-manager-policy="none" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309475 2554 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309482 2554 flags.go:64] FLAG: --topology-manager-scope="container" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309487 2554 flags.go:64] FLAG: --v="2" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309493 2554 flags.go:64] FLAG: --version="false" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309499 2554 flags.go:64] FLAG: --vmodule="" Jul 22 18:14:04.318621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309505 2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 22 18:14:04.319233 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.309511 2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 22 18:14:04.319233 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309695 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 18:14:04.319233 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309702 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 18:14:04.319233 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309707 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 18:14:04.319233 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309711 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 18:14:04.319233 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309717 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 18:14:04.319233 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309722 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 18:14:04.319233 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309726 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 18:14:04.319233 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309731 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 18:14:04.319233 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309735 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 18:14:04.319233 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309740 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 18:14:04.319233 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309744 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 18:14:04.319233 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309748 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 18:14:04.319233 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309753 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 18:14:04.319233 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309759 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 18:14:04.319233 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309765 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 18:14:04.319233 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309769 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 18:14:04.319233 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309774 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 18:14:04.319233 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309778 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 18:14:04.319233 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309782 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 18:14:04.319775 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309787 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 18:14:04.319775 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309791 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 18:14:04.319775 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309795 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 18:14:04.319775 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309800 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 18:14:04.319775 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309804 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 18:14:04.319775 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309809 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 18:14:04.319775 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309813 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 22 18:14:04.319775 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309818 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 18:14:04.319775 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309822 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 18:14:04.319775 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309827 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 18:14:04.319775 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309831 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 18:14:04.319775 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309835 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 18:14:04.319775 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309838 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 18:14:04.319775 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309842 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 18:14:04.319775 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309847 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 18:14:04.319775 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309851 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 18:14:04.319775 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309855 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 18:14:04.319775 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309859 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 18:14:04.319775 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309863 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 18:14:04.319775 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309868 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 18:14:04.320247 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309872 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 18:14:04.320247 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309876 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 18:14:04.320247 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309880 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 18:14:04.320247 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309884 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 18:14:04.320247 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309888 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 18:14:04.320247 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309892 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 18:14:04.320247 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309896 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 18:14:04.320247 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309900 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 18:14:04.320247 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309904 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 18:14:04.320247 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309907 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 18:14:04.320247 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309912 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 18:14:04.320247 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309916 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 18:14:04.320247 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309920 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 18:14:04.320247 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309925 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 18:14:04.320247 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309929 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 18:14:04.320247 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309933 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 18:14:04.320247 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309937 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 18:14:04.320247 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309942 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 18:14:04.320247 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309946 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 18:14:04.320784 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309951 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 18:14:04.320784 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309955 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 18:14:04.320784 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309960 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 18:14:04.320784 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309964 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 18:14:04.320784 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309968 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 18:14:04.320784 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309972 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 18:14:04.320784 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309976 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 18:14:04.320784 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309981 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 18:14:04.320784 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309987 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 18:14:04.320784 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309992 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 18:14:04.320784 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.309996 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 18:14:04.320784 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310001 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 18:14:04.320784 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310005 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 18:14:04.320784 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310009 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 18:14:04.320784 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310013 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 18:14:04.320784 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310017 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 18:14:04.320784 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310023 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 18:14:04.320784 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310028 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 18:14:04.320784 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310032 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 18:14:04.321318 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310037 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 18:14:04.321318 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310041 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 18:14:04.321318 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310045 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 18:14:04.321318 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310049 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 18:14:04.321318 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310053 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 18:14:04.321318 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310057 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 18:14:04.321318 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310061 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 18:14:04.321318 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310065 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 18:14:04.321318 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310069 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 18:14:04.321318 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310073 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 18:14:04.321318 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310078 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 18:14:04.321318 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310083 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 18:14:04.321318 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310087 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 18:14:04.321318 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310094 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 18:14:04.321318 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310098 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 18:14:04.321318 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310102 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 18:14:04.321318 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310106 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 18:14:04.321318 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310110 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 18:14:04.321318 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310113 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 18:14:04.321318 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310117 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 18:14:04.322166 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310123 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 18:14:04.322166 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.310128 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 18:14:04.322166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.310140 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 18:14:04.322166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.317098 2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 22 18:14:04.322166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.317112 2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 22 18:14:04.322166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.317878 2554 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 22 18:14:04.322166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.317885 2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 22 18:14:04.322166 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.317942 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 18:14:04.322166 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.317947 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 18:14:04.322166 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.317951 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 18:14:04.322166 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.317954 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 18:14:04.322166 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.317956 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 18:14:04.322166 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.317959 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 18:14:04.322166 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.317962 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 18:14:04.322166 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.317966 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 18:14:04.322651 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.317968 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 18:14:04.322651 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.317971 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 18:14:04.322651 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.317973 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 18:14:04.322651 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.317976 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 18:14:04.322651 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.317978 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 18:14:04.322651 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.317981 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 18:14:04.322651 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.317983 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 18:14:04.322651 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.317986 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 18:14:04.322651 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.317989 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 18:14:04.322651 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.317991 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 18:14:04.322651 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.317994 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 18:14:04.322651 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.317996 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 18:14:04.322651 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.317999 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 18:14:04.322651 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318002 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 22 18:14:04.322651 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318004 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 18:14:04.322651 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318007 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 18:14:04.322651 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318009 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 18:14:04.322651 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318012 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 18:14:04.322651 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318014 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 18:14:04.322651 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318017 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 18:14:04.323179 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318020 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 18:14:04.323179 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318023 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 18:14:04.323179 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318026 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 18:14:04.323179 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318029 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 18:14:04.323179 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318033 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 18:14:04.323179 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318036 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 18:14:04.323179 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318039 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 18:14:04.323179 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318042 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 18:14:04.323179 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318045 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 18:14:04.323179 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318048 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 18:14:04.323179 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318050 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 18:14:04.323179 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318053 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 18:14:04.323179 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318055 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 18:14:04.323179 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318058 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 18:14:04.323179 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318061 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 18:14:04.323179 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318063 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 18:14:04.323179 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318066 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 18:14:04.323179 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318068 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 18:14:04.323179 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318071 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 18:14:04.323739 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318073 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 18:14:04.323739 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318076 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 18:14:04.323739 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318078 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 18:14:04.323739 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318080 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 18:14:04.323739 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318083 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 18:14:04.323739 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318085 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 18:14:04.323739 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318088 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 18:14:04.323739 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318090 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 18:14:04.323739 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318092 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 18:14:04.323739 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318095 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 18:14:04.323739 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318097 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 18:14:04.323739 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318099 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 18:14:04.323739 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318103 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 18:14:04.323739 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318106 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 18:14:04.323739 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318109 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 18:14:04.323739 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318113 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 18:14:04.323739 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318115 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 18:14:04.323739 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318118 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 18:14:04.323739 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318120 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 18:14:04.324214 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318123 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 18:14:04.324214 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318125 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 18:14:04.324214 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318128 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 18:14:04.324214 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318130 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 18:14:04.324214 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318132 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 18:14:04.324214 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318135 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 18:14:04.324214 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318137 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 18:14:04.324214 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318140 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 18:14:04.324214 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318142 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 18:14:04.324214 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318144 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 18:14:04.324214 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318147 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 18:14:04.324214 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318149 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 18:14:04.324214 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318151 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 18:14:04.324214 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318154 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 18:14:04.324214 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318158 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 18:14:04.324214 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318161 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 18:14:04.324214 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318163 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 18:14:04.324214 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318166 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 18:14:04.324214 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318168 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 18:14:04.324214 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318171 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 18:14:04.324857 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318173 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 18:14:04.324857 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318175 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 18:14:04.324857 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318177 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 18:14:04.324857 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318180 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 18:14:04.324857 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318182 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 18:14:04.324857 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318185 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 18:14:04.324857 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318187 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 18:14:04.324857 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318190 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 18:14:04.324857 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318193 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 18:14:04.324857 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318196 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 18:14:04.324857 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318198 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 18:14:04.324857 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318200 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 18:14:04.324857 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318203 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 18:14:04.324857 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.318207 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 18:14:04.324857 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318322 2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 22 18:14:04.325491 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318328 2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 22 18:14:04.325491 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318332 2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 22 18:14:04.325491 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318335 2554 feature_gate.go:328] unrecognized feature gate: Example Jul 22 18:14:04.325491 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318337 2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 22 18:14:04.325491 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318340 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 22 18:14:04.325491 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318342 2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 22 18:14:04.325491 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318345 2554 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 22 18:14:04.325491 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318348 2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 22 18:14:04.325491 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318352 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 22 18:14:04.325491 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318354 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 22 18:14:04.325491 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318357 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 22 18:14:04.325491 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318359 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 22 18:14:04.325491 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318361 2554 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 22 18:14:04.325491 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318364 2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 22 18:14:04.325491 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318367 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 22 18:14:04.325491 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318369 2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 22 18:14:04.325491 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318372 2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 22 18:14:04.325491 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318374 2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 22 18:14:04.325491 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318377 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 22 18:14:04.326153 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318379 2554 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 22 18:14:04.326153 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318382 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 22 18:14:04.326153 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318384 2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 22 18:14:04.326153 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318386 2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 22 18:14:04.326153 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318388 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 22 18:14:04.326153 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318392 2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 22 18:14:04.326153 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318394 2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 22 18:14:04.326153 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318397 2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 22 18:14:04.326153 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318400 2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 22 18:14:04.326153 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318402 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 22 18:14:04.326153 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318405 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 22 18:14:04.326153 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318407 2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 22 18:14:04.326153 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318409 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 22 18:14:04.326153 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318423 2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 22 18:14:04.326153 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318426 2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 22 18:14:04.326153 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318429 2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 22 18:14:04.326153 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318431 2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 22 18:14:04.326153 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318434 2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 22 18:14:04.326153 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318436 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 22 18:14:04.326153 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318439 2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 22 18:14:04.326748 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318441 2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 22 18:14:04.326748 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318443 2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 22 18:14:04.326748 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318447 2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 22 18:14:04.326748 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318450 2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 22 18:14:04.326748 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318453 2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 22 18:14:04.326748 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318456 2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 22 18:14:04.326748 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318459 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 22 18:14:04.326748 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318461 2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 22 18:14:04.326748 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318464 2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 22 18:14:04.326748 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318467 2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 22 18:14:04.326748 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318470 2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 22 18:14:04.326748 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318472 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 22 18:14:04.326748 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318475 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 22 18:14:04.326748 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318478 2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 22 18:14:04.326748 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318480 2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 22 18:14:04.326748 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318482 2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 22 18:14:04.326748 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318485 2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 22 18:14:04.326748 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318487 2554 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 22 18:14:04.326748 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318490 2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 22 18:14:04.327435 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318492 2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 22 18:14:04.327435 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318495 2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 22 18:14:04.327435 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318498 2554 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 22 18:14:04.327435 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318501 2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 22 18:14:04.327435 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318503 2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 22 18:14:04.327435 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318506 2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 22 18:14:04.327435 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318508 2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 22 18:14:04.327435 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318511 2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 22 18:14:04.327435 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318513 2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 22 18:14:04.327435 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318515 2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 22 18:14:04.327435 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318518 2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 22 18:14:04.327435 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318520 2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 22 18:14:04.327435 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318523 2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 22 18:14:04.327435 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318525 2554 feature_gate.go:328] unrecognized feature gate: Example2 Jul 22 18:14:04.327435 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318528 2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 22 18:14:04.327435 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318530 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 22 18:14:04.327435 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318532 2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 22 18:14:04.327435 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318535 2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 22 18:14:04.327435 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318537 2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 22 18:14:04.327921 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318539 2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 22 18:14:04.327921 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318542 2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 22 18:14:04.327921 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318545 2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 22 18:14:04.327921 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318547 2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 22 18:14:04.327921 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318549 2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 22 18:14:04.327921 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318552 2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 22 18:14:04.327921 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318554 2554 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 22 18:14:04.327921 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318556 2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 22 18:14:04.327921 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318559 2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 22 18:14:04.327921 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318561 2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 22 18:14:04.327921 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318564 2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 22 18:14:04.327921 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318567 2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 22 18:14:04.327921 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318569 2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 22 18:14:04.327921 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318571 2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 22 18:14:04.327921 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318574 2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 22 18:14:04.327921 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318577 2554 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 22 18:14:04.327921 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318579 2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 22 18:14:04.327921 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318582 2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 22 18:14:04.327921 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318585 2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 22 18:14:04.327921 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318587 2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 22 18:14:04.328408 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:04.318590 2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 22 18:14:04.328408 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.318595 2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 22 18:14:04.328408 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.318705 2554 server.go:962] "Client rotation is on, will bootstrap in background" Jul 22 18:14:04.328408 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.320833 2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 22 18:14:04.328408 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.323039 2554 server.go:1019] "Starting client certificate rotation" Jul 22 18:14:04.328408 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.323158 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 18:14:04.328408 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.323213 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 22 18:14:04.328408 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.325657 2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 18:14:04.328408 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.326817 2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 22 18:14:04.334991 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.334974 2554 log.go:25] "Validated CRI v1 runtime API" Jul 22 18:14:04.337045 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.337032 2554 log.go:25] "Validated CRI v1 image API" Jul 22 18:14:04.337928 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.337912 2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 22 18:14:04.341273 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.341244 2554 fs.go:135] Filesystem UUIDs: map[4bb32370-2d4e-4840-86ab-dcc986c8d407:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 ecd946ec-ea73-4403-97b9-5b73b063dcfd:/dev/nvme0n1p3] Jul 22 18:14:04.341356 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.341271 2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 22 18:14:04.347180 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.347049 2554 manager.go:216] Machine: {Timestamp:2026-07-22 18:14:04.345900356 +0000 UTC m=+0.270795366 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099591 MemoryCapacity:32812183552 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec280a6c4c7139354f8cb607dd18e5ce SystemUUID:ec280a6c-4c71-3935-4f8c-b607dd18e5ce BootID:697ce203-6c95-4cb7-ab9d-8fdfb6b78f1f Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406093824 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:69:ae:de:cb:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:69:ae:de:cb:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:c6:d1:b0:e0:2f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812183552 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 22 18:14:04.347180 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.347172 2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 22 18:14:04.347312 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.347260 2554 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 22 18:14:04.349794 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.349767 2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 22 18:14:04.349905 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.349889 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 18:14:04.349961 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.349796 2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-65.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 22 18:14:04.350458 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.350446 2554 topology_manager.go:138] "Creating topology manager with none policy" Jul 22 18:14:04.350502 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.350461 2554 container_manager_linux.go:309] "Creating device plugin manager" Jul 22 18:14:04.350502 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.350468 2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 18:14:04.350502 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.350482 2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 22 18:14:04.351715 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.351702 2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 22 18:14:04.355559 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.355549 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 22 18:14:04.355675 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.355666 2554 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 22 18:14:04.355713 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.355697 2554 kubelet.go:486] "Attempting to sync node with API server" Jul 22 18:14:04.355713 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.355708 2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 22 18:14:04.355768 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.355719 2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 22 18:14:04.355768 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.355728 2554 kubelet.go:398] "Adding apiserver pod source" Jul 22 18:14:04.355768 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.355737 2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 22 18:14:04.356099 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.356087 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 18:14:04.356149 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.356107 2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 22 18:14:04.357994 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.357978 2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 22 18:14:04.360104 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.360071 2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 22 18:14:04.360200 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.360122 2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 22 18:14:04.361438 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.361402 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 22 18:14:04.361516 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.361455 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 22 18:14:04.361516 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.361466 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 22 18:14:04.361516 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.361475 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 22 18:14:04.361516 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.361490 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 22 18:14:04.361516 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.361499 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 22 18:14:04.361516 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.361518 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 22 18:14:04.361723 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.361526 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 22 18:14:04.361723 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.361537 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 22 18:14:04.361723 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.361546 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 22 18:14:04.361723 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.361559 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 22 18:14:04.361723 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.361568 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 22 18:14:04.362216 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.362202 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 22 18:14:04.362267 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.362219 2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 22 18:14:04.365637 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.365621 2554 server.go:1268] "Started kubelet" Jul 22 18:14:04.366052 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.365722 2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 22 18:14:04.366052 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.365742 2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 22 18:14:04.366052 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.365804 2554 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 22 18:14:04.366578 ip-10-0-132-65 systemd[1]: Started Kubernetes Kubelet. Jul 22 18:14:04.366735 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.366624 2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-65.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 22 18:14:04.366735 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:04.366669 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 22 18:14:04.366847 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:04.366791 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-65.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 22 18:14:04.367429 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.367398 2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 22 18:14:04.368025 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.368013 2554 server.go:310] "Adding debug handlers to kubelet server" Jul 22 18:14:04.370753 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:04.370728 2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 22 18:14:04.371455 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:04.370546 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-65.ec2.internal.18c4af409b67b07e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-65.ec2.internal,UID:ip-10-0-132-65.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-65.ec2.internal,},FirstTimestamp:2026-07-22 18:14:04.365590654 +0000 UTC m=+0.290485663,LastTimestamp:2026-07-22 18:14:04.365590654 +0000 UTC m=+0.290485663,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-65.ec2.internal,}" Jul 22 18:14:04.373322 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.373309 2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 22 18:14:04.373385 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.373322 2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 22 18:14:04.373484 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:04.373459 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-65.ec2.internal\" not found" Jul 22 18:14:04.374031 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.374016 2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 22 18:14:04.374122 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.373871 2554 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 22 18:14:04.374122 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.374085 2554 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 22 18:14:04.374333 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.374168 2554 reconstruct.go:97] "Volume reconstruction finished" Jul 22 18:14:04.374333 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.374175 2554 reconciler.go:29] "Reconciler: start to sync state" Jul 22 18:14:04.374333 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.374329 2554 factory.go:55] Registering systemd factory Jul 22 18:14:04.374333 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.374347 2554 factory.go:223] Registration of the systemd container factory successfully Jul 22 18:14:04.374599 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.374584 2554 factory.go:153] Registering CRI-O factory Jul 22 18:14:04.374599 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.374599 2554 factory.go:223] Registration of the crio container factory successfully Jul 22 18:14:04.374709 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.374641 2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 22 18:14:04.374709 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.374665 2554 factory.go:103] Registering Raw factory Jul 22 18:14:04.374709 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.374678 2554 manager.go:1196] Started watching for new ooms in manager Jul 22 18:14:04.375246 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.375183 2554 manager.go:349] Starting recovery of all containers Jul 22 18:14:04.377654 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.377632 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2lrjf" Jul 22 18:14:04.380561 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:04.380537 2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 22 18:14:04.380829 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:04.380790 2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-65.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 22 18:14:04.383896 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.383743 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2lrjf" Jul 22 18:14:04.383990 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.383946 2554 manager.go:354] Recovery completed Jul 22 18:14:04.386460 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:04.386434 2554 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 22 18:14:04.390041 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.390028 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:14:04.391887 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.391868 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:14:04.391945 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.391901 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:14:04.391945 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.391915 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:14:04.392471 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.392458 2554 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 22 18:14:04.392510 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.392472 2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 22 18:14:04.392510 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.392475 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:14:04.392510 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.392487 2554 state_mem.go:36] "Initialized new in-memory state store" Jul 22 18:14:04.393108 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.393096 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:14:04.393152 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.393118 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:14:04.393152 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.393127 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:14:04.393699 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:04.393629 2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-65.ec2.internal.18c4af409cf8ee43 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-65.ec2.internal,UID:ip-10-0-132-65.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-65.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-65.ec2.internal,},FirstTimestamp:2026-07-22 18:14:04.391886403 +0000 UTC m=+0.316781412,LastTimestamp:2026-07-22 18:14:04.391886403 +0000 UTC m=+0.316781412,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-65.ec2.internal,}" Jul 22 18:14:04.394586 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.394574 2554 policy_none.go:49] "None policy: Start" Jul 22 18:14:04.394639 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.394591 2554 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 22 18:14:04.394639 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.394602 2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 22 18:14:04.396574 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.396563 2554 policy_none.go:47] "Start" Jul 22 18:14:04.437751 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.437732 2554 manager.go:337] "Starting Device Plugin manager" Jul 22 18:14:04.437868 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:04.437774 2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 22 18:14:04.437868 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.437787 2554 server.go:87] "Starting device plugin registration server" Jul 22 18:14:04.438067 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.438053 2554 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 22 18:14:04.438128 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.438068 2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 22 18:14:04.438217 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.438198 2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 22 18:14:04.438289 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.438278 2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 22 18:14:04.438289 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.438290 2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 22 18:14:04.438832 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:04.438810 2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 22 18:14:04.438930 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:04.438869 2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-65.ec2.internal\" not found" Jul 22 18:14:04.538577 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.538553 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:14:04.540837 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.539126 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 22 18:14:04.540837 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.539754 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:14:04.540837 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.539786 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:14:04.540837 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.539799 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:14:04.540837 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.539830 2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-65.ec2.internal" Jul 22 18:14:04.540837 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.540486 2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 22 18:14:04.540837 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.540524 2554 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 22 18:14:04.540837 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.540550 2554 kubelet.go:2448] "Starting kubelet main sync loop" Jul 22 18:14:04.540837 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:04.540588 2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 22 18:14:04.542619 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.542601 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 18:14:04.547679 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.547664 2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-65.ec2.internal" Jul 22 18:14:04.547773 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:04.547689 2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-65.ec2.internal\": node \"ip-10-0-132-65.ec2.internal\" not found" Jul 22 18:14:04.598634 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:04.598553 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-65.ec2.internal\" not found" Jul 22 18:14:04.640730 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.640689 2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-65.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-65.ec2.internal"] Jul 22 18:14:04.640819 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.640806 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:14:04.642711 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.642691 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:14:04.642803 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.642721 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:14:04.642803 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.642735 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:14:04.645081 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.645068 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:14:04.645193 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.645179 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-65.ec2.internal" Jul 22 18:14:04.645235 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.645212 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:14:04.646209 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.646193 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:14:04.646322 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.646220 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:14:04.646322 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.646230 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:14:04.646322 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.646243 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:14:04.646322 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.646270 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:14:04.646322 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.646283 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:14:04.648572 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.648557 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-65.ec2.internal" Jul 22 18:14:04.648645 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.648583 2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 22 18:14:04.649975 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.649961 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeHasSufficientMemory" Jul 22 18:14:04.650034 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.649987 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeHasNoDiskPressure" Jul 22 18:14:04.650034 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.649997 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeHasSufficientPID" Jul 22 18:14:04.675426 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.675397 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5bb4be778fdc4d1b1c65a09ca6ed53e9-config\") pod \"kube-apiserver-proxy-ip-10-0-132-65.ec2.internal\" (UID: \"5bb4be778fdc4d1b1c65a09ca6ed53e9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-65.ec2.internal" Jul 22 18:14:04.675558 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.675446 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/771a9cee6459867329caacdbd2b313c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-65.ec2.internal\" (UID: \"771a9cee6459867329caacdbd2b313c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-65.ec2.internal" Jul 22 18:14:04.675558 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.675465 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/771a9cee6459867329caacdbd2b313c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-65.ec2.internal\" (UID: \"771a9cee6459867329caacdbd2b313c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-65.ec2.internal" Jul 22 18:14:04.682275 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:04.682255 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-65.ec2.internal\" not found" node="ip-10-0-132-65.ec2.internal" Jul 22 18:14:04.686821 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:04.686803 2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-65.ec2.internal\" not found" node="ip-10-0-132-65.ec2.internal" Jul 22 18:14:04.699216 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:04.699182 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-65.ec2.internal\" not found" Jul 22 18:14:04.775922 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.775892 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/771a9cee6459867329caacdbd2b313c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-65.ec2.internal\" (UID: \"771a9cee6459867329caacdbd2b313c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-65.ec2.internal" Jul 22 18:14:04.776014 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.775927 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/771a9cee6459867329caacdbd2b313c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-65.ec2.internal\" (UID: \"771a9cee6459867329caacdbd2b313c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-65.ec2.internal" Jul 22 18:14:04.776014 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.775944 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5bb4be778fdc4d1b1c65a09ca6ed53e9-config\") pod \"kube-apiserver-proxy-ip-10-0-132-65.ec2.internal\" (UID: \"5bb4be778fdc4d1b1c65a09ca6ed53e9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-65.ec2.internal" Jul 22 18:14:04.776014 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.775979 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/771a9cee6459867329caacdbd2b313c6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-65.ec2.internal\" (UID: \"771a9cee6459867329caacdbd2b313c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-65.ec2.internal" Jul 22 18:14:04.776014 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.775990 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/771a9cee6459867329caacdbd2b313c6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-65.ec2.internal\" (UID: \"771a9cee6459867329caacdbd2b313c6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-65.ec2.internal" Jul 22 18:14:04.776133 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.776023 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5bb4be778fdc4d1b1c65a09ca6ed53e9-config\") pod \"kube-apiserver-proxy-ip-10-0-132-65.ec2.internal\" (UID: \"5bb4be778fdc4d1b1c65a09ca6ed53e9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-65.ec2.internal" Jul 22 18:14:04.800047 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:04.800014 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-65.ec2.internal\" not found" Jul 22 18:14:04.900868 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:04.900796 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-65.ec2.internal\" not found" Jul 22 18:14:04.985446 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.985400 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-65.ec2.internal" Jul 22 18:14:04.989899 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:04.989879 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-65.ec2.internal" Jul 22 18:14:05.001731 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:05.001710 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-65.ec2.internal\" not found" Jul 22 18:14:05.102334 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:05.102288 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-65.ec2.internal\" not found" Jul 22 18:14:05.202833 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:05.202746 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-65.ec2.internal\" not found" Jul 22 18:14:05.303352 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:05.303321 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-65.ec2.internal\" not found" Jul 22 18:14:05.319984 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:05.319963 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 18:14:05.321939 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:05.321922 2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 22 18:14:05.322046 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:05.322029 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 18:14:05.322081 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:05.322039 2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 22 18:14:05.389736 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:05.389698 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-21 18:09:04 +0000 UTC" deadline="2028-04-22 06:58:21.202558244 +0000 UTC" Jul 22 18:14:05.389736 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:05.389726 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15348h44m15.812836213s" Jul 22 18:14:05.403903 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:05.403879 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-65.ec2.internal\" not found" Jul 22 18:14:05.504534 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:05.504473 2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-65.ec2.internal\" not found" Jul 22 18:14:05.559757 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:05.559725 2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 18:14:05.575114 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:05.575080 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-65.ec2.internal" Jul 22 18:14:05.589180 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:05.589156 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 18:14:05.590879 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:05.590864 2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-65.ec2.internal" Jul 22 18:14:05.599766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:05.599750 2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 22 18:14:05.603375 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:05.603357 2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 18:14:05.646785 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:05.646747 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod771a9cee6459867329caacdbd2b313c6.slice/crio-e092649f6a7fc932aca4d8a9908611ceff0d1a26d35716c350d1a1b92e8d7f97 WatchSource:0}: Error finding container e092649f6a7fc932aca4d8a9908611ceff0d1a26d35716c350d1a1b92e8d7f97: Status 404 returned error can't find the container with id e092649f6a7fc932aca4d8a9908611ceff0d1a26d35716c350d1a1b92e8d7f97 Jul 22 18:14:05.652911 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:05.652893 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 18:14:05.658992 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:05.658972 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bb4be778fdc4d1b1c65a09ca6ed53e9.slice/crio-152ef3c8033e9d31930d0f07aea653b1e6595318a883149c4fe43efc5dde7baa WatchSource:0}: Error finding container 152ef3c8033e9d31930d0f07aea653b1e6595318a883149c4fe43efc5dde7baa: Status 404 returned error can't find the container with id 152ef3c8033e9d31930d0f07aea653b1e6595318a883149c4fe43efc5dde7baa Jul 22 18:14:06.350436 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.350389 2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 18:14:06.356766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.356742 2554 apiserver.go:52] "Watching apiserver" Jul 22 18:14:06.366785 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.366756 2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 22 18:14:06.368008 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.367976 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-5t9vd","kube-system/kube-apiserver-proxy-ip-10-0-132-65.ec2.internal","openshift-cluster-node-tuning-operator/tuned-j6dm4","openshift-dns/node-resolver-8tx85","openshift-multus/multus-additional-cni-plugins-j6jrf","openshift-multus/multus-xhvg7","openshift-multus/network-metrics-daemon-tbzjc","openshift-network-diagnostics/network-check-target-gqbsh","kube-system/konnectivity-agent-jq95d","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp","openshift-image-registry/node-ca-d7fbm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-65.ec2.internal","openshift-network-operator/iptables-alerter-pps6b","openshift-ovn-kubernetes/ovnkube-node-qmw4c"] Jul 22 18:14:06.370877 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.370853 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:06.371011 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:06.370940 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbzjc" podUID="6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57" Jul 22 18:14:06.373695 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.373661 2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 22 18:14:06.373812 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.373790 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pps6b" Jul 22 18:14:06.376228 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.376203 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.376542 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.376521 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 22 18:14:06.377026 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.376999 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 22 18:14:06.377126 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.377002 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 22 18:14:06.377126 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.377103 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zkw2v\"" Jul 22 18:14:06.378658 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.378636 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8tx85" Jul 22 18:14:06.378753 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.378671 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 22 18:14:06.379006 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.378984 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 22 18:14:06.379114 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.379056 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p2r2k\"" Jul 22 18:14:06.381265 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.381244 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.381835 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.381814 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 22 18:14:06.382046 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.382029 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rbclh\"" Jul 22 18:14:06.382521 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.382304 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 22 18:14:06.383618 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.383593 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.384352 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.384332 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 22 18:14:06.385264 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.385243 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 22 18:14:06.385536 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.385516 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 22 18:14:06.385646 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.385557 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 22 18:14:06.385956 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.385751 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-var-lib-kubelet\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.385956 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.385783 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76e8c9c3-4027-4837-b1e1-1c0ebce07851-tmp\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.385956 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.385816 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twv7c\" (UniqueName: \"kubernetes.io/projected/a2950bce-3845-49aa-9500-c1e130d5cff4-kube-api-access-twv7c\") pod \"iptables-alerter-pps6b\" (UID: \"a2950bce-3845-49aa-9500-c1e130d5cff4\") " pod="openshift-network-operator/iptables-alerter-pps6b" Jul 22 18:14:06.385956 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.385843 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-etc-sysconfig\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.385956 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.385868 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kl2g5\"" Jul 22 18:14:06.385956 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.385871 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-etc-sysctl-d\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.385956 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.385946 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-run\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.386334 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.385967 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkpxz\" (UniqueName: \"kubernetes.io/projected/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-kube-api-access-rkpxz\") pod \"network-metrics-daemon-tbzjc\" (UID: \"6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57\") " pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:06.386334 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.385969 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 22 18:14:06.386334 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.385998 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-etc-modprobe-d\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.386334 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.386033 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-etc-sysctl-conf\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.386334 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.386070 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-sys\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.386334 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.386092 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jq95d" Jul 22 18:14:06.386334 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.386101 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-lib-modules\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.386334 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.386126 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/76e8c9c3-4027-4837-b1e1-1c0ebce07851-etc-tuned\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.386334 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.386152 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxf5q\" (UniqueName: \"kubernetes.io/projected/76e8c9c3-4027-4837-b1e1-1c0ebce07851-kube-api-access-pxf5q\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.386334 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.386181 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs\") pod \"network-metrics-daemon-tbzjc\" (UID: \"6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57\") " pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:06.386334 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.386210 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a2950bce-3845-49aa-9500-c1e130d5cff4-iptables-alerter-script\") pod \"iptables-alerter-pps6b\" (UID: \"a2950bce-3845-49aa-9500-c1e130d5cff4\") " pod="openshift-network-operator/iptables-alerter-pps6b" Jul 22 18:14:06.386334 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.386247 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-host\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.386334 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.386279 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2950bce-3845-49aa-9500-c1e130d5cff4-host-slash\") pod \"iptables-alerter-pps6b\" (UID: \"a2950bce-3845-49aa-9500-c1e130d5cff4\") " pod="openshift-network-operator/iptables-alerter-pps6b" Jul 22 18:14:06.386334 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.386324 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-etc-kubernetes\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.387157 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.386370 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-etc-systemd\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.387157 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.386696 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sp49p\"" Jul 22 18:14:06.387157 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.386734 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 22 18:14:06.387874 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.387851 2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 22 18:14:06.388461 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.388442 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 22 18:14:06.388907 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.388892 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:06.389031 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:06.388970 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t9vd" podUID="26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96" Jul 22 18:14:06.389205 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.389184 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8wb8c\"" Jul 22 18:14:06.389403 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.389387 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 22 18:14:06.391794 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.391770 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.394180 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.394157 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 22 18:14:06.394276 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.394250 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hwr9n\"" Jul 22 18:14:06.394342 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.394298 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 22 18:14:06.394583 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.394566 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.394672 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.394590 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 22 18:14:06.395285 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.395268 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 22 18:14:06.395352 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.395271 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 22 18:14:06.396345 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.396326 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 22 18:14:06.397513 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.397490 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 22 18:14:06.397687 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.397668 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 22 18:14:06.397959 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.397943 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 22 18:14:06.398026 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.397990 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2h4mf\"" Jul 22 18:14:06.398392 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.398372 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d7fbm" Jul 22 18:14:06.400922 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.400902 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 22 18:14:06.401213 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.401193 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-25p2h\"" Jul 22 18:14:06.401289 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.401262 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 22 18:14:06.401507 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.401486 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:06.401680 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:06.401657 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqbsh" podUID="ec8b8800-ec53-4bc9-9984-2ebcce27c8af" Jul 22 18:14:06.401827 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.401496 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 22 18:14:06.475437 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.475390 2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 22 18:14:06.487500 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.487466 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-var-lib-kubelet\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.487657 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.487508 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md555\" (UniqueName: \"kubernetes.io/projected/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-kube-api-access-md555\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.487657 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.487534 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-etc-sysctl-d\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.487657 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.487552 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-host-var-lib-cni-multus\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.487657 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.487579 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpw92\" (UniqueName: \"kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92\") pod \"network-check-target-gqbsh\" (UID: \"ec8b8800-ec53-4bc9-9984-2ebcce27c8af\") " pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:06.487657 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.487593 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-var-lib-kubelet\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.487657 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.487604 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c2a0461-3c56-47ee-af78-3355695a39be-system-cni-dir\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.487969 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.487665 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d3cf4800-3b6b-47c5-b9a1-4e14d716f323-konnectivity-ca\") pod \"konnectivity-agent-jq95d\" (UID: \"d3cf4800-3b6b-47c5-b9a1-4e14d716f323\") " pod="kube-system/konnectivity-agent-jq95d" Jul 22 18:14:06.487969 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.487693 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-kubelet-config\") pod \"global-pull-secret-syncer-5t9vd\" (UID: \"26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96\") " pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:06.487969 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.487709 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-etc-sysctl-d\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.487969 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.487726 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkpxz\" (UniqueName: \"kubernetes.io/projected/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-kube-api-access-rkpxz\") pod \"network-metrics-daemon-tbzjc\" (UID: \"6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57\") " pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:06.487969 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.487757 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-etc-sysctl-conf\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.487969 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.487923 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-lib-modules\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.487969 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.487955 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-run-openvswitch\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.488297 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.487981 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-ovnkube-script-lib\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.488297 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488016 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03a472de-a374-457c-9959-409546b51390-host\") pod \"node-ca-d7fbm\" (UID: \"03a472de-a374-457c-9959-409546b51390\") " pod="openshift-image-registry/node-ca-d7fbm" Jul 22 18:14:06.488297 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488042 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-etc-kubernetes\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.488297 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488012 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-etc-sysctl-conf\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.488297 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488091 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-host-cni-bin\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.488297 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488141 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-system-cni-dir\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.488297 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488160 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-lib-modules\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.488297 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488171 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c2a0461-3c56-47ee-af78-3355695a39be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.488297 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488201 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-etc-systemd\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.488297 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488226 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-var-lib-openvswitch\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.488297 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488255 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-etc-openvswitch\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.488297 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488292 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-host-run-ovn-kubernetes\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.488861 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488332 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-etc-systemd\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.488861 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488388 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/03a472de-a374-457c-9959-409546b51390-serviceca\") pod \"node-ca-d7fbm\" (UID: \"03a472de-a374-457c-9959-409546b51390\") " pod="openshift-image-registry/node-ca-d7fbm" Jul 22 18:14:06.488861 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488405 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-host-run-multus-certs\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.488861 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488442 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c2a0461-3c56-47ee-af78-3355695a39be-cnibin\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.488861 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488473 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-etc-sysconfig\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.488861 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488494 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-log-socket\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.488861 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488529 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-host-cni-netd\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.488861 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488554 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-etc-sysconfig\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.488861 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488561 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c2a0461-3c56-47ee-af78-3355695a39be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.488861 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488599 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d3cf4800-3b6b-47c5-b9a1-4e14d716f323-agent-certs\") pod \"konnectivity-agent-jq95d\" (UID: \"d3cf4800-3b6b-47c5-b9a1-4e14d716f323\") " pod="kube-system/konnectivity-agent-jq95d" Jul 22 18:14:06.488861 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488645 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/76e8c9c3-4027-4837-b1e1-1c0ebce07851-etc-tuned\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.488861 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488677 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxf5q\" (UniqueName: \"kubernetes.io/projected/76e8c9c3-4027-4837-b1e1-1c0ebce07851-kube-api-access-pxf5q\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.489300 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488901 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.489300 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488926 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-multus-cni-dir\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.489300 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488950 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-cnibin\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.489300 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488973 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-host-run-k8s-cni-cncf-io\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.489300 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488992 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c2a0461-3c56-47ee-af78-3355695a39be-os-release\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.489300 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.488994 2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 22 18:14:06.489300 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489028 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6012a5b1-5dff-4b0b-adb3-e8136f9b6737-registration-dir\") pod \"aws-ebs-csi-driver-node-kl2wp\" (UID: \"6012a5b1-5dff-4b0b-adb3-e8136f9b6737\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.489300 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489047 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlpt9\" (UniqueName: \"kubernetes.io/projected/6012a5b1-5dff-4b0b-adb3-e8136f9b6737-kube-api-access-nlpt9\") pod \"aws-ebs-csi-driver-node-kl2wp\" (UID: \"6012a5b1-5dff-4b0b-adb3-e8136f9b6737\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.489300 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489067 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07da8a07-dcb9-4331-99de-82a25374214b-tmp-dir\") pod \"node-resolver-8tx85\" (UID: \"07da8a07-dcb9-4331-99de-82a25374214b\") " pod="openshift-dns/node-resolver-8tx85" Jul 22 18:14:06.489300 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489082 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c2a0461-3c56-47ee-af78-3355695a39be-cni-binary-copy\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.489300 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489097 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c2a0461-3c56-47ee-af78-3355695a39be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.489300 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489112 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret\") pod \"global-pull-secret-syncer-5t9vd\" (UID: \"26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96\") " pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:06.489300 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489130 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76e8c9c3-4027-4837-b1e1-1c0ebce07851-tmp\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.489300 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489171 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-host-slash\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.489300 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489187 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6012a5b1-5dff-4b0b-adb3-e8136f9b6737-socket-dir\") pod \"aws-ebs-csi-driver-node-kl2wp\" (UID: \"6012a5b1-5dff-4b0b-adb3-e8136f9b6737\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.489300 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489203 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6012a5b1-5dff-4b0b-adb3-e8136f9b6737-sys-fs\") pod \"aws-ebs-csi-driver-node-kl2wp\" (UID: \"6012a5b1-5dff-4b0b-adb3-e8136f9b6737\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.490166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489230 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9fsc\" (UniqueName: \"kubernetes.io/projected/03a472de-a374-457c-9959-409546b51390-kube-api-access-v9fsc\") pod \"node-ca-d7fbm\" (UID: \"03a472de-a374-457c-9959-409546b51390\") " pod="openshift-image-registry/node-ca-d7fbm" Jul 22 18:14:06.490166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489256 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-host-kubelet\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.490166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489280 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-host-run-netns\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.490166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489304 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-env-overrides\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.490166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489386 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-ovn-node-metrics-cert\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.490166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489412 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6012a5b1-5dff-4b0b-adb3-e8136f9b6737-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kl2wp\" (UID: \"6012a5b1-5dff-4b0b-adb3-e8136f9b6737\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.490166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489439 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6012a5b1-5dff-4b0b-adb3-e8136f9b6737-device-dir\") pod \"aws-ebs-csi-driver-node-kl2wp\" (UID: \"6012a5b1-5dff-4b0b-adb3-e8136f9b6737\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.490166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489466 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/07da8a07-dcb9-4331-99de-82a25374214b-hosts-file\") pod \"node-resolver-8tx85\" (UID: \"07da8a07-dcb9-4331-99de-82a25374214b\") " pod="openshift-dns/node-resolver-8tx85" Jul 22 18:14:06.490166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489521 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-host-var-lib-cni-bin\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.490166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489556 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-run-systemd\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.490166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489598 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-host-var-lib-kubelet\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.490166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489638 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac8b7f98-7337-456e-b08e-bf25703dd8ec-multus-daemon-config\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.490166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489666 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-dbus\") pod \"global-pull-secret-syncer-5t9vd\" (UID: \"26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96\") " pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:06.490166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489688 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-host\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.490166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489705 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-ovnkube-config\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.490166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489745 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6012a5b1-5dff-4b0b-adb3-e8136f9b6737-etc-selinux\") pod \"aws-ebs-csi-driver-node-kl2wp\" (UID: \"6012a5b1-5dff-4b0b-adb3-e8136f9b6737\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.490166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489787 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac8b7f98-7337-456e-b08e-bf25703dd8ec-cni-binary-copy\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.490881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489805 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-host\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.490881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489817 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2950bce-3845-49aa-9500-c1e130d5cff4-host-slash\") pod \"iptables-alerter-pps6b\" (UID: \"a2950bce-3845-49aa-9500-c1e130d5cff4\") " pod="openshift-network-operator/iptables-alerter-pps6b" Jul 22 18:14:06.490881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489848 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-etc-kubernetes\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.490881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489882 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-run-ovn\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.490881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489923 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twv7c\" (UniqueName: \"kubernetes.io/projected/a2950bce-3845-49aa-9500-c1e130d5cff4-kube-api-access-twv7c\") pod \"iptables-alerter-pps6b\" (UID: \"a2950bce-3845-49aa-9500-c1e130d5cff4\") " pod="openshift-network-operator/iptables-alerter-pps6b" Jul 22 18:14:06.490881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489945 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-run\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.490881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489953 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-etc-kubernetes\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.490881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.489980 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a2950bce-3845-49aa-9500-c1e130d5cff4-host-slash\") pod \"iptables-alerter-pps6b\" (UID: \"a2950bce-3845-49aa-9500-c1e130d5cff4\") " pod="openshift-network-operator/iptables-alerter-pps6b" Jul 22 18:14:06.490881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.490002 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-node-log\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.490881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.490029 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-run\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.490881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.490064 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-multus-socket-dir-parent\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.490881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.490091 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-etc-modprobe-d\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.490881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.490116 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-sys\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.490881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.490151 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-systemd-units\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.490881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.490190 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp2x8\" (UniqueName: \"kubernetes.io/projected/07da8a07-dcb9-4331-99de-82a25374214b-kube-api-access-lp2x8\") pod \"node-resolver-8tx85\" (UID: \"07da8a07-dcb9-4331-99de-82a25374214b\") " pod="openshift-dns/node-resolver-8tx85" Jul 22 18:14:06.490881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.490232 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-os-release\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.490881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.490256 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-host-run-netns\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.491677 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.490272 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-etc-modprobe-d\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.491677 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.490248 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76e8c9c3-4027-4837-b1e1-1c0ebce07851-sys\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.491677 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.490285 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-hostroot\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.491677 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.490341 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbtnq\" (UniqueName: \"kubernetes.io/projected/ac8b7f98-7337-456e-b08e-bf25703dd8ec-kube-api-access-sbtnq\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.491677 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.490429 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs\") pod \"network-metrics-daemon-tbzjc\" (UID: \"6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57\") " pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:06.491677 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.490466 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a2950bce-3845-49aa-9500-c1e130d5cff4-iptables-alerter-script\") pod \"iptables-alerter-pps6b\" (UID: \"a2950bce-3845-49aa-9500-c1e130d5cff4\") " pod="openshift-network-operator/iptables-alerter-pps6b" Jul 22 18:14:06.491677 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.490510 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-multus-conf-dir\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.491677 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.490555 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqfqh\" (UniqueName: \"kubernetes.io/projected/5c2a0461-3c56-47ee-af78-3355695a39be-kube-api-access-mqfqh\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.491677 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:06.490711 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:14:06.491677 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:06.490799 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs podName:6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:06.990765645 +0000 UTC m=+2.915660664 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs") pod "network-metrics-daemon-tbzjc" (UID: "6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:14:06.491677 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.490961 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a2950bce-3845-49aa-9500-c1e130d5cff4-iptables-alerter-script\") pod \"iptables-alerter-pps6b\" (UID: \"a2950bce-3845-49aa-9500-c1e130d5cff4\") " pod="openshift-network-operator/iptables-alerter-pps6b" Jul 22 18:14:06.493108 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.493082 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/76e8c9c3-4027-4837-b1e1-1c0ebce07851-etc-tuned\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.493416 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.493397 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/76e8c9c3-4027-4837-b1e1-1c0ebce07851-tmp\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.503221 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.503189 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twv7c\" (UniqueName: \"kubernetes.io/projected/a2950bce-3845-49aa-9500-c1e130d5cff4-kube-api-access-twv7c\") pod \"iptables-alerter-pps6b\" (UID: \"a2950bce-3845-49aa-9500-c1e130d5cff4\") " pod="openshift-network-operator/iptables-alerter-pps6b" Jul 22 18:14:06.503221 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.503204 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxf5q\" (UniqueName: \"kubernetes.io/projected/76e8c9c3-4027-4837-b1e1-1c0ebce07851-kube-api-access-pxf5q\") pod \"tuned-j6dm4\" (UID: \"76e8c9c3-4027-4837-b1e1-1c0ebce07851\") " pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.505717 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.505679 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkpxz\" (UniqueName: \"kubernetes.io/projected/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-kube-api-access-rkpxz\") pod \"network-metrics-daemon-tbzjc\" (UID: \"6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57\") " pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:06.525374 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.525346 2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-njwbb" Jul 22 18:14:06.533923 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.533451 2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-njwbb" Jul 22 18:14:06.548106 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.548044 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-65.ec2.internal" event={"ID":"5bb4be778fdc4d1b1c65a09ca6ed53e9","Type":"ContainerStarted","Data":"152ef3c8033e9d31930d0f07aea653b1e6595318a883149c4fe43efc5dde7baa"} Jul 22 18:14:06.550853 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.550802 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-65.ec2.internal" event={"ID":"771a9cee6459867329caacdbd2b313c6","Type":"ContainerStarted","Data":"e092649f6a7fc932aca4d8a9908611ceff0d1a26d35716c350d1a1b92e8d7f97"} Jul 22 18:14:06.591091 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591048 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-run-ovn\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.591273 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591100 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-node-log\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.591273 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591127 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-multus-socket-dir-parent\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.591273 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591151 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-systemd-units\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.591273 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591173 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp2x8\" (UniqueName: \"kubernetes.io/projected/07da8a07-dcb9-4331-99de-82a25374214b-kube-api-access-lp2x8\") pod \"node-resolver-8tx85\" (UID: \"07da8a07-dcb9-4331-99de-82a25374214b\") " pod="openshift-dns/node-resolver-8tx85" Jul 22 18:14:06.591273 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591195 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-os-release\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.591273 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591216 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-host-run-netns\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.591273 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591237 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-hostroot\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.591273 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591260 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbtnq\" (UniqueName: \"kubernetes.io/projected/ac8b7f98-7337-456e-b08e-bf25703dd8ec-kube-api-access-sbtnq\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.591744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591298 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-multus-conf-dir\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.591744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591329 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqfqh\" (UniqueName: \"kubernetes.io/projected/5c2a0461-3c56-47ee-af78-3355695a39be-kube-api-access-mqfqh\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.591744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591354 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md555\" (UniqueName: \"kubernetes.io/projected/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-kube-api-access-md555\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.591744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591382 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-host-var-lib-cni-multus\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.591744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591409 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpw92\" (UniqueName: \"kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92\") pod \"network-check-target-gqbsh\" (UID: \"ec8b8800-ec53-4bc9-9984-2ebcce27c8af\") " pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:06.591744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591446 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c2a0461-3c56-47ee-af78-3355695a39be-system-cni-dir\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.591744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591495 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d3cf4800-3b6b-47c5-b9a1-4e14d716f323-konnectivity-ca\") pod \"konnectivity-agent-jq95d\" (UID: \"d3cf4800-3b6b-47c5-b9a1-4e14d716f323\") " pod="kube-system/konnectivity-agent-jq95d" Jul 22 18:14:06.591744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591523 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-kubelet-config\") pod \"global-pull-secret-syncer-5t9vd\" (UID: \"26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96\") " pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:06.591744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591576 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-run-openvswitch\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.591744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591607 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-ovnkube-script-lib\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.591744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591601 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-hostroot\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.591744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591645 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03a472de-a374-457c-9959-409546b51390-host\") pod \"node-ca-d7fbm\" (UID: \"03a472de-a374-457c-9959-409546b51390\") " pod="openshift-image-registry/node-ca-d7fbm" Jul 22 18:14:06.591744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591671 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-etc-kubernetes\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.591744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591675 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-run-ovn\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.591744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591696 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-host-cni-bin\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.591744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591718 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-node-log\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.591744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591721 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-system-cni-dir\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.592644 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591765 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c2a0461-3c56-47ee-af78-3355695a39be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.592644 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591787 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-system-cni-dir\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.592644 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591794 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-var-lib-openvswitch\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.592644 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591829 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-etc-openvswitch\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.592644 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591861 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-host-run-ovn-kubernetes\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.592644 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591896 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/03a472de-a374-457c-9959-409546b51390-serviceca\") pod \"node-ca-d7fbm\" (UID: \"03a472de-a374-457c-9959-409546b51390\") " pod="openshift-image-registry/node-ca-d7fbm" Jul 22 18:14:06.592644 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591881 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-multus-socket-dir-parent\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.592644 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591924 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-host-run-multus-certs\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.592644 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591947 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-systemd-units\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.592644 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591953 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c2a0461-3c56-47ee-af78-3355695a39be-cnibin\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.592644 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591982 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-log-socket\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.592644 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.592020 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-os-release\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.592644 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.592059 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-host-cni-netd\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.592644 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.592065 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-host-run-netns\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.592644 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.592090 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c2a0461-3c56-47ee-af78-3355695a39be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.592644 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.592129 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d3cf4800-3b6b-47c5-b9a1-4e14d716f323-agent-certs\") pod \"konnectivity-agent-jq95d\" (UID: \"d3cf4800-3b6b-47c5-b9a1-4e14d716f323\") " pod="kube-system/konnectivity-agent-jq95d" Jul 22 18:14:06.592644 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.592188 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.593459 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.592217 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-multus-cni-dir\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.593459 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.592243 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-cnibin\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.593459 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.592269 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-host-run-k8s-cni-cncf-io\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.593459 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.592313 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c2a0461-3c56-47ee-af78-3355695a39be-os-release\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.593459 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.592697 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6012a5b1-5dff-4b0b-adb3-e8136f9b6737-registration-dir\") pod \"aws-ebs-csi-driver-node-kl2wp\" (UID: \"6012a5b1-5dff-4b0b-adb3-e8136f9b6737\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.593459 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.592744 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlpt9\" (UniqueName: \"kubernetes.io/projected/6012a5b1-5dff-4b0b-adb3-e8136f9b6737-kube-api-access-nlpt9\") pod \"aws-ebs-csi-driver-node-kl2wp\" (UID: \"6012a5b1-5dff-4b0b-adb3-e8136f9b6737\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.593459 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.592944 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07da8a07-dcb9-4331-99de-82a25374214b-tmp-dir\") pod \"node-resolver-8tx85\" (UID: \"07da8a07-dcb9-4331-99de-82a25374214b\") " pod="openshift-dns/node-resolver-8tx85" Jul 22 18:14:06.593459 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.592981 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c2a0461-3c56-47ee-af78-3355695a39be-cni-binary-copy\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.593459 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.593187 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c2a0461-3c56-47ee-af78-3355695a39be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.593459 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.593227 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret\") pod \"global-pull-secret-syncer-5t9vd\" (UID: \"26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96\") " pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:06.593970 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.593286 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-host-slash\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.593970 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.593566 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6012a5b1-5dff-4b0b-adb3-e8136f9b6737-socket-dir\") pod \"aws-ebs-csi-driver-node-kl2wp\" (UID: \"6012a5b1-5dff-4b0b-adb3-e8136f9b6737\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.593970 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.593604 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6012a5b1-5dff-4b0b-adb3-e8136f9b6737-sys-fs\") pod \"aws-ebs-csi-driver-node-kl2wp\" (UID: \"6012a5b1-5dff-4b0b-adb3-e8136f9b6737\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.593970 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.593657 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9fsc\" (UniqueName: \"kubernetes.io/projected/03a472de-a374-457c-9959-409546b51390-kube-api-access-v9fsc\") pod \"node-ca-d7fbm\" (UID: \"03a472de-a374-457c-9959-409546b51390\") " pod="openshift-image-registry/node-ca-d7fbm" Jul 22 18:14:06.593970 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.593886 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-host-kubelet\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.593970 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.593918 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-host-run-netns\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.594320 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.593953 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-env-overrides\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.594320 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.594113 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-ovn-node-metrics-cert\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.594320 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.594146 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6012a5b1-5dff-4b0b-adb3-e8136f9b6737-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kl2wp\" (UID: \"6012a5b1-5dff-4b0b-adb3-e8136f9b6737\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.594320 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.594181 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6012a5b1-5dff-4b0b-adb3-e8136f9b6737-device-dir\") pod \"aws-ebs-csi-driver-node-kl2wp\" (UID: \"6012a5b1-5dff-4b0b-adb3-e8136f9b6737\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.594320 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.594268 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/07da8a07-dcb9-4331-99de-82a25374214b-hosts-file\") pod \"node-resolver-8tx85\" (UID: \"07da8a07-dcb9-4331-99de-82a25374214b\") " pod="openshift-dns/node-resolver-8tx85" Jul 22 18:14:06.594320 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.594302 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-host-var-lib-cni-bin\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.594637 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.594335 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-run-systemd\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.594637 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.594528 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-host-var-lib-kubelet\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.594637 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.594565 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac8b7f98-7337-456e-b08e-bf25703dd8ec-multus-daemon-config\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.594637 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.594599 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-dbus\") pod \"global-pull-secret-syncer-5t9vd\" (UID: \"26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96\") " pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:06.594834 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.594814 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-ovnkube-config\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.594895 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.594863 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6012a5b1-5dff-4b0b-adb3-e8136f9b6737-etc-selinux\") pod \"aws-ebs-csi-driver-node-kl2wp\" (UID: \"6012a5b1-5dff-4b0b-adb3-e8136f9b6737\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.594951 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.594898 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac8b7f98-7337-456e-b08e-bf25703dd8ec-cni-binary-copy\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.605551 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.592342 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-multus-conf-dir\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.605719 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.605635 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5c2a0461-3c56-47ee-af78-3355695a39be-os-release\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.605719 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.605702 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-host-var-lib-cni-multus\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.612496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.605904 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5c2a0461-3c56-47ee-af78-3355695a39be-system-cni-dir\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.612496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.606082 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-kubelet-config\") pod \"global-pull-secret-syncer-5t9vd\" (UID: \"26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96\") " pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:06.612496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.606150 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-run-openvswitch\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.612496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.606241 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03a472de-a374-457c-9959-409546b51390-host\") pod \"node-ca-d7fbm\" (UID: \"03a472de-a374-457c-9959-409546b51390\") " pod="openshift-image-registry/node-ca-d7fbm" Jul 22 18:14:06.612496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.606292 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-etc-kubernetes\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.612496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.606327 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-host-cni-bin\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.612496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.591831 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-var-lib-openvswitch\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.612496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.606406 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-host-run-ovn-kubernetes\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.612496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.606934 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/03a472de-a374-457c-9959-409546b51390-serviceca\") pod \"node-ca-d7fbm\" (UID: \"03a472de-a374-457c-9959-409546b51390\") " pod="openshift-image-registry/node-ca-d7fbm" Jul 22 18:14:06.612496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.607015 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-host-run-multus-certs\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.612496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.607072 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5c2a0461-3c56-47ee-af78-3355695a39be-cnibin\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.612496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.607161 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d3cf4800-3b6b-47c5-b9a1-4e14d716f323-konnectivity-ca\") pod \"konnectivity-agent-jq95d\" (UID: \"d3cf4800-3b6b-47c5-b9a1-4e14d716f323\") " pod="kube-system/konnectivity-agent-jq95d" Jul 22 18:14:06.612496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.607400 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-log-socket\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.612496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.607469 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-host-cni-netd\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.612496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.606361 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-etc-openvswitch\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.612496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.607807 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-ovnkube-script-lib\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.612496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.607985 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-multus-cni-dir\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.612496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.608080 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5c2a0461-3c56-47ee-af78-3355695a39be-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.613540 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.608117 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5c2a0461-3c56-47ee-af78-3355695a39be-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.613540 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.608164 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-cnibin\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.613540 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.608208 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-host-kubelet\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.613540 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.608217 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-host-run-k8s-cni-cncf-io\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.613540 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.608272 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-host-var-lib-cni-bin\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.613540 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.608341 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-host-run-netns\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.613540 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.608807 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-env-overrides\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.613540 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.609275 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6012a5b1-5dff-4b0b-adb3-e8136f9b6737-registration-dir\") pod \"aws-ebs-csi-driver-node-kl2wp\" (UID: \"6012a5b1-5dff-4b0b-adb3-e8136f9b6737\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.613540 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.609824 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ac8b7f98-7337-456e-b08e-bf25703dd8ec-multus-daemon-config\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.613540 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.609918 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-run-systemd\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.613540 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.609988 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac8b7f98-7337-456e-b08e-bf25703dd8ec-host-var-lib-kubelet\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.613540 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.610225 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/07da8a07-dcb9-4331-99de-82a25374214b-tmp-dir\") pod \"node-resolver-8tx85\" (UID: \"07da8a07-dcb9-4331-99de-82a25374214b\") " pod="openshift-dns/node-resolver-8tx85" Jul 22 18:14:06.613540 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:06.610612 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 18:14:06.613540 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.610747 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-host-slash\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.613540 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.611012 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5c2a0461-3c56-47ee-af78-3355695a39be-cni-binary-copy\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.613540 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.611229 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5c2a0461-3c56-47ee-af78-3355695a39be-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.613540 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.611279 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6012a5b1-5dff-4b0b-adb3-e8136f9b6737-socket-dir\") pod \"aws-ebs-csi-driver-node-kl2wp\" (UID: \"6012a5b1-5dff-4b0b-adb3-e8136f9b6737\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.614349 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:06.611514 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret podName:26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:07.111092936 +0000 UTC m=+3.035987951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret") pod "global-pull-secret-syncer-5t9vd" (UID: "26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96") : object "kube-system"/"original-pull-secret" not registered Jul 22 18:14:06.614349 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.611513 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6012a5b1-5dff-4b0b-adb3-e8136f9b6737-sys-fs\") pod \"aws-ebs-csi-driver-node-kl2wp\" (UID: \"6012a5b1-5dff-4b0b-adb3-e8136f9b6737\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.614349 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.612014 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6012a5b1-5dff-4b0b-adb3-e8136f9b6737-etc-selinux\") pod \"aws-ebs-csi-driver-node-kl2wp\" (UID: \"6012a5b1-5dff-4b0b-adb3-e8136f9b6737\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.614349 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.612055 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-dbus\") pod \"global-pull-secret-syncer-5t9vd\" (UID: \"26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96\") " pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:06.614349 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.612115 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.614349 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.612204 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6012a5b1-5dff-4b0b-adb3-e8136f9b6737-device-dir\") pod \"aws-ebs-csi-driver-node-kl2wp\" (UID: \"6012a5b1-5dff-4b0b-adb3-e8136f9b6737\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.614349 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.612279 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6012a5b1-5dff-4b0b-adb3-e8136f9b6737-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kl2wp\" (UID: \"6012a5b1-5dff-4b0b-adb3-e8136f9b6737\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.614658 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.614619 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-ovnkube-config\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.614743 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.614719 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/07da8a07-dcb9-4331-99de-82a25374214b-hosts-file\") pod \"node-resolver-8tx85\" (UID: \"07da8a07-dcb9-4331-99de-82a25374214b\") " pod="openshift-dns/node-resolver-8tx85" Jul 22 18:14:06.615497 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.615460 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ac8b7f98-7337-456e-b08e-bf25703dd8ec-cni-binary-copy\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.617193 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.617168 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbtnq\" (UniqueName: \"kubernetes.io/projected/ac8b7f98-7337-456e-b08e-bf25703dd8ec-kube-api-access-sbtnq\") pod \"multus-xhvg7\" (UID: \"ac8b7f98-7337-456e-b08e-bf25703dd8ec\") " pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.618888 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.618863 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-md555\" (UniqueName: \"kubernetes.io/projected/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-kube-api-access-md555\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.619485 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.619219 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ab829dfc-b3d2-4f76-be11-cf9f0beabcf1-ovn-node-metrics-cert\") pod \"ovnkube-node-qmw4c\" (UID: \"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1\") " pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.619485 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:06.619340 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 18:14:06.619485 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:06.619368 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 18:14:06.619485 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:06.619380 2554 projected.go:196] Error preparing data for projected volume kube-api-access-kpw92 for pod openshift-network-diagnostics/network-check-target-gqbsh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:14:06.619485 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:06.619454 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92 podName:ec8b8800-ec53-4bc9-9984-2ebcce27c8af nodeName:}" failed. No retries permitted until 2026-07-22 18:14:07.119420301 +0000 UTC m=+3.044315302 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kpw92" (UniqueName: "kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92") pod "network-check-target-gqbsh" (UID: "ec8b8800-ec53-4bc9-9984-2ebcce27c8af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:14:06.628049 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.627820 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqfqh\" (UniqueName: \"kubernetes.io/projected/5c2a0461-3c56-47ee-af78-3355695a39be-kube-api-access-mqfqh\") pod \"multus-additional-cni-plugins-j6jrf\" (UID: \"5c2a0461-3c56-47ee-af78-3355695a39be\") " pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.628750 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.628723 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d3cf4800-3b6b-47c5-b9a1-4e14d716f323-agent-certs\") pod \"konnectivity-agent-jq95d\" (UID: \"d3cf4800-3b6b-47c5-b9a1-4e14d716f323\") " pod="kube-system/konnectivity-agent-jq95d" Jul 22 18:14:06.630411 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.630361 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlpt9\" (UniqueName: \"kubernetes.io/projected/6012a5b1-5dff-4b0b-adb3-e8136f9b6737-kube-api-access-nlpt9\") pod \"aws-ebs-csi-driver-node-kl2wp\" (UID: \"6012a5b1-5dff-4b0b-adb3-e8136f9b6737\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.630799 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.630778 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp2x8\" (UniqueName: \"kubernetes.io/projected/07da8a07-dcb9-4331-99de-82a25374214b-kube-api-access-lp2x8\") pod \"node-resolver-8tx85\" (UID: \"07da8a07-dcb9-4331-99de-82a25374214b\") " pod="openshift-dns/node-resolver-8tx85" Jul 22 18:14:06.632854 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.632828 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9fsc\" (UniqueName: \"kubernetes.io/projected/03a472de-a374-457c-9959-409546b51390-kube-api-access-v9fsc\") pod \"node-ca-d7fbm\" (UID: \"03a472de-a374-457c-9959-409546b51390\") " pod="openshift-image-registry/node-ca-d7fbm" Jul 22 18:14:06.687893 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.687606 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pps6b" Jul 22 18:14:06.697793 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.696455 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8tx85" Jul 22 18:14:06.699971 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:06.699945 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2950bce_3845_49aa_9500_c1e130d5cff4.slice/crio-e637e3a62a269d26ee1b070f2d5e1d315e5cd196f25cd8d54d6bf428aad4f9b9 WatchSource:0}: Error finding container e637e3a62a269d26ee1b070f2d5e1d315e5cd196f25cd8d54d6bf428aad4f9b9: Status 404 returned error can't find the container with id e637e3a62a269d26ee1b070f2d5e1d315e5cd196f25cd8d54d6bf428aad4f9b9 Jul 22 18:14:06.708376 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.708352 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" Jul 22 18:14:06.708946 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:06.708919 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07da8a07_dcb9_4331_99de_82a25374214b.slice/crio-80fb9065feb639c065d01abaab30df2eebbf1ca41067d8caec7c60127ec87d09 WatchSource:0}: Error finding container 80fb9065feb639c065d01abaab30df2eebbf1ca41067d8caec7c60127ec87d09: Status 404 returned error can't find the container with id 80fb9065feb639c065d01abaab30df2eebbf1ca41067d8caec7c60127ec87d09 Jul 22 18:14:06.714258 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.714243 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j6jrf" Jul 22 18:14:06.723288 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.723254 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xhvg7" Jul 22 18:14:06.725370 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:06.725342 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e8c9c3_4027_4837_b1e1_1c0ebce07851.slice/crio-8bd3ceb9d8616b8620b3f2717b6bf47458f56f0a562c44b6ea3b8471dad23e73 WatchSource:0}: Error finding container 8bd3ceb9d8616b8620b3f2717b6bf47458f56f0a562c44b6ea3b8471dad23e73: Status 404 returned error can't find the container with id 8bd3ceb9d8616b8620b3f2717b6bf47458f56f0a562c44b6ea3b8471dad23e73 Jul 22 18:14:06.726195 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:06.726169 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c2a0461_3c56_47ee_af78_3355695a39be.slice/crio-f7f579e50394d8d87e17205c8b50facd5e75392b7a609a48a6df73e43e59281b WatchSource:0}: Error finding container f7f579e50394d8d87e17205c8b50facd5e75392b7a609a48a6df73e43e59281b: Status 404 returned error can't find the container with id f7f579e50394d8d87e17205c8b50facd5e75392b7a609a48a6df73e43e59281b Jul 22 18:14:06.731306 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.731274 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jq95d" Jul 22 18:14:06.738250 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.738197 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:06.742607 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:06.742457 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac8b7f98_7337_456e_b08e_bf25703dd8ec.slice/crio-53101518d6926831f8dbcb8eff1e3ef3ddd934842a376bcecbbb35d308898ce0 WatchSource:0}: Error finding container 53101518d6926831f8dbcb8eff1e3ef3ddd934842a376bcecbbb35d308898ce0: Status 404 returned error can't find the container with id 53101518d6926831f8dbcb8eff1e3ef3ddd934842a376bcecbbb35d308898ce0 Jul 22 18:14:06.745408 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.745378 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" Jul 22 18:14:06.747059 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.747007 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d7fbm" Jul 22 18:14:06.759049 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:06.758991 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3cf4800_3b6b_47c5_b9a1_4e14d716f323.slice/crio-00488e79b552e31c216bfd5ffa7f4408253e7e4010a03d400792b451b73bb612 WatchSource:0}: Error finding container 00488e79b552e31c216bfd5ffa7f4408253e7e4010a03d400792b451b73bb612: Status 404 returned error can't find the container with id 00488e79b552e31c216bfd5ffa7f4408253e7e4010a03d400792b451b73bb612 Jul 22 18:14:06.761618 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:06.761589 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab829dfc_b3d2_4f76_be11_cf9f0beabcf1.slice/crio-5fd101516cc5d5f301562cc279810972e582c31136f70b981e1398e0a6a8d7dd WatchSource:0}: Error finding container 5fd101516cc5d5f301562cc279810972e582c31136f70b981e1398e0a6a8d7dd: Status 404 returned error can't find the container with id 5fd101516cc5d5f301562cc279810972e582c31136f70b981e1398e0a6a8d7dd Jul 22 18:14:06.768246 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:06.768219 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a472de_a374_457c_9959_409546b51390.slice/crio-d233e3d3fedf991c0928e1b5b3d5a9050bfe350c16bebdd1cfcac812b9aa6cb3 WatchSource:0}: Error finding container d233e3d3fedf991c0928e1b5b3d5a9050bfe350c16bebdd1cfcac812b9aa6cb3: Status 404 returned error can't find the container with id d233e3d3fedf991c0928e1b5b3d5a9050bfe350c16bebdd1cfcac812b9aa6cb3 Jul 22 18:14:06.997681 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:06.997580 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs\") pod \"network-metrics-daemon-tbzjc\" (UID: \"6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57\") " pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:06.997862 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:06.997760 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:14:06.997862 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:06.997849 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs podName:6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:07.997829837 +0000 UTC m=+3.922724839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs") pod "network-metrics-daemon-tbzjc" (UID: "6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:14:07.199563 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:07.199511 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpw92\" (UniqueName: \"kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92\") pod \"network-check-target-gqbsh\" (UID: \"ec8b8800-ec53-4bc9-9984-2ebcce27c8af\") " pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:07.199756 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:07.199587 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret\") pod \"global-pull-secret-syncer-5t9vd\" (UID: \"26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96\") " pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:07.199756 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:07.199677 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 18:14:07.199756 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:07.199705 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 18:14:07.199756 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:07.199708 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 18:14:07.199756 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:07.199731 2554 projected.go:196] Error preparing data for projected volume kube-api-access-kpw92 for pod openshift-network-diagnostics/network-check-target-gqbsh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:14:07.199965 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:07.199774 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret podName:26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:08.199754872 +0000 UTC m=+4.124649870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret") pod "global-pull-secret-syncer-5t9vd" (UID: "26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96") : object "kube-system"/"original-pull-secret" not registered Jul 22 18:14:07.199965 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:07.199804 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92 podName:ec8b8800-ec53-4bc9-9984-2ebcce27c8af nodeName:}" failed. No retries permitted until 2026-07-22 18:14:08.199790057 +0000 UTC m=+4.124685055 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpw92" (UniqueName: "kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92") pod "network-check-target-gqbsh" (UID: "ec8b8800-ec53-4bc9-9984-2ebcce27c8af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:14:07.532761 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:07.532732 2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 22 18:14:07.537972 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:07.537931 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 18:09:06 +0000 UTC" deadline="2028-03-07 16:45:52.647937933 +0000 UTC" Jul 22 18:14:07.537972 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:07.537970 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14254h31m45.109972919s" Jul 22 18:14:07.541516 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:07.541479 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:07.541654 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:07.541520 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:07.541706 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:07.541652 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbzjc" podUID="6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57" Jul 22 18:14:07.542155 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:07.542097 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqbsh" podUID="ec8b8800-ec53-4bc9-9984-2ebcce27c8af" Jul 22 18:14:07.555097 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:07.555040 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d7fbm" event={"ID":"03a472de-a374-457c-9959-409546b51390","Type":"ContainerStarted","Data":"d233e3d3fedf991c0928e1b5b3d5a9050bfe350c16bebdd1cfcac812b9aa6cb3"} Jul 22 18:14:07.556466 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:07.556414 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" event={"ID":"6012a5b1-5dff-4b0b-adb3-e8136f9b6737","Type":"ContainerStarted","Data":"cc51cc87af876c8876e5e59f25a5ee9ad1a749c6c9da34a308da9177ad7da28d"} Jul 22 18:14:07.558476 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:07.558424 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" event={"ID":"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1","Type":"ContainerStarted","Data":"5fd101516cc5d5f301562cc279810972e582c31136f70b981e1398e0a6a8d7dd"} Jul 22 18:14:07.560003 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:07.559971 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xhvg7" event={"ID":"ac8b7f98-7337-456e-b08e-bf25703dd8ec","Type":"ContainerStarted","Data":"53101518d6926831f8dbcb8eff1e3ef3ddd934842a376bcecbbb35d308898ce0"} Jul 22 18:14:07.561470 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:07.561443 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" event={"ID":"76e8c9c3-4027-4837-b1e1-1c0ebce07851","Type":"ContainerStarted","Data":"8bd3ceb9d8616b8620b3f2717b6bf47458f56f0a562c44b6ea3b8471dad23e73"} Jul 22 18:14:07.562941 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:07.562916 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8tx85" event={"ID":"07da8a07-dcb9-4331-99de-82a25374214b","Type":"ContainerStarted","Data":"80fb9065feb639c065d01abaab30df2eebbf1ca41067d8caec7c60127ec87d09"} Jul 22 18:14:07.564805 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:07.564780 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jq95d" event={"ID":"d3cf4800-3b6b-47c5-b9a1-4e14d716f323","Type":"ContainerStarted","Data":"00488e79b552e31c216bfd5ffa7f4408253e7e4010a03d400792b451b73bb612"} Jul 22 18:14:07.567149 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:07.567110 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6jrf" event={"ID":"5c2a0461-3c56-47ee-af78-3355695a39be","Type":"ContainerStarted","Data":"f7f579e50394d8d87e17205c8b50facd5e75392b7a609a48a6df73e43e59281b"} Jul 22 18:14:07.569768 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:07.569744 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pps6b" event={"ID":"a2950bce-3845-49aa-9500-c1e130d5cff4","Type":"ContainerStarted","Data":"e637e3a62a269d26ee1b070f2d5e1d315e5cd196f25cd8d54d6bf428aad4f9b9"} Jul 22 18:14:08.006342 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:08.006297 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs\") pod \"network-metrics-daemon-tbzjc\" (UID: \"6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57\") " pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:08.006592 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:08.006570 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:14:08.006694 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:08.006649 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs podName:6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:10.006625347 +0000 UTC m=+5.931520368 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs") pod "network-metrics-daemon-tbzjc" (UID: "6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:14:08.208200 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:08.208084 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpw92\" (UniqueName: \"kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92\") pod \"network-check-target-gqbsh\" (UID: \"ec8b8800-ec53-4bc9-9984-2ebcce27c8af\") " pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:08.208200 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:08.208175 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret\") pod \"global-pull-secret-syncer-5t9vd\" (UID: \"26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96\") " pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:08.208461 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:08.208407 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 18:14:08.208819 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:08.208599 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 18:14:08.208819 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:08.208620 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 18:14:08.208819 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:08.208635 2554 projected.go:196] Error preparing data for projected volume kube-api-access-kpw92 for pod openshift-network-diagnostics/network-check-target-gqbsh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:14:08.209627 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:08.209160 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret podName:26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:10.209125527 +0000 UTC m=+6.134020525 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret") pod "global-pull-secret-syncer-5t9vd" (UID: "26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96") : object "kube-system"/"original-pull-secret" not registered Jul 22 18:14:08.209627 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:08.209205 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92 podName:ec8b8800-ec53-4bc9-9984-2ebcce27c8af nodeName:}" failed. No retries permitted until 2026-07-22 18:14:10.209192714 +0000 UTC m=+6.134087716 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpw92" (UniqueName: "kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92") pod "network-check-target-gqbsh" (UID: "ec8b8800-ec53-4bc9-9984-2ebcce27c8af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:14:08.538836 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:08.538732 2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-21 18:09:06 +0000 UTC" deadline="2027-12-23 06:17:51.22181278 +0000 UTC" Jul 22 18:14:08.538836 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:08.538783 2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12444h3m42.683039995s" Jul 22 18:14:08.543707 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:08.543673 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:08.543844 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:08.543821 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t9vd" podUID="26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96" Jul 22 18:14:09.541901 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:09.541637 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:09.542314 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:09.542033 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbzjc" podUID="6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57" Jul 22 18:14:09.542314 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:09.542189 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:09.542314 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:09.542282 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqbsh" podUID="ec8b8800-ec53-4bc9-9984-2ebcce27c8af" Jul 22 18:14:09.604592 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:09.604323 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-65.ec2.internal" event={"ID":"5bb4be778fdc4d1b1c65a09ca6ed53e9","Type":"ContainerStarted","Data":"e89f524b150157edf149e1c0e4e9670ab48cdc7b826385f6d6f5b2bfabe0adae"} Jul 22 18:14:09.618733 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:09.618509 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-65.ec2.internal" podStartSLOduration=3.618487111 podStartE2EDuration="3.618487111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:09.618250382 +0000 UTC m=+5.543145404" watchObservedRunningTime="2026-07-22 18:14:09.618487111 +0000 UTC m=+5.543382133" Jul 22 18:14:10.023652 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:10.023483 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs\") pod \"network-metrics-daemon-tbzjc\" (UID: \"6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57\") " pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:10.023907 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:10.023863 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:14:10.024056 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:10.024038 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs podName:6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:14.023999573 +0000 UTC m=+9.948894587 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs") pod "network-metrics-daemon-tbzjc" (UID: "6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:14:10.226708 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:10.225756 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret\") pod \"global-pull-secret-syncer-5t9vd\" (UID: \"26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96\") " pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:10.226708 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:10.225855 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpw92\" (UniqueName: \"kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92\") pod \"network-check-target-gqbsh\" (UID: \"ec8b8800-ec53-4bc9-9984-2ebcce27c8af\") " pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:10.226708 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:10.226023 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 18:14:10.226708 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:10.226047 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 18:14:10.226708 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:10.226062 2554 projected.go:196] Error preparing data for projected volume kube-api-access-kpw92 for pod openshift-network-diagnostics/network-check-target-gqbsh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:14:10.226708 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:10.226128 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92 podName:ec8b8800-ec53-4bc9-9984-2ebcce27c8af nodeName:}" failed. No retries permitted until 2026-07-22 18:14:14.226106353 +0000 UTC m=+10.151001376 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpw92" (UniqueName: "kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92") pod "network-check-target-gqbsh" (UID: "ec8b8800-ec53-4bc9-9984-2ebcce27c8af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:14:10.226708 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:10.226588 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 18:14:10.226708 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:10.226648 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret podName:26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:14.226631009 +0000 UTC m=+10.151526027 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret") pod "global-pull-secret-syncer-5t9vd" (UID: "26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96") : object "kube-system"/"original-pull-secret" not registered Jul 22 18:14:10.543859 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:10.543827 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:10.544326 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:10.543965 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t9vd" podUID="26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96" Jul 22 18:14:10.613055 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:10.613009 2554 generic.go:356] "Generic (PLEG): container finished" podID="771a9cee6459867329caacdbd2b313c6" containerID="22d096cd9ea284bfd5f24f5f8822e8628003bf6ce611f2f62f5b61e23698b942" exitCode=0 Jul 22 18:14:10.614076 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:10.614045 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-65.ec2.internal" event={"ID":"771a9cee6459867329caacdbd2b313c6","Type":"ContainerDied","Data":"22d096cd9ea284bfd5f24f5f8822e8628003bf6ce611f2f62f5b61e23698b942"} Jul 22 18:14:11.542254 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:11.541679 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:11.542254 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:11.541791 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbzjc" podUID="6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57" Jul 22 18:14:11.542254 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:11.542129 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:11.542254 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:11.542209 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqbsh" podUID="ec8b8800-ec53-4bc9-9984-2ebcce27c8af" Jul 22 18:14:12.541446 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:12.541199 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:12.541446 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:12.541335 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t9vd" podUID="26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96" Jul 22 18:14:13.541008 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:13.540976 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:13.541170 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:13.541105 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbzjc" podUID="6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57" Jul 22 18:14:13.541170 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:13.541159 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:13.541257 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:13.541216 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqbsh" podUID="ec8b8800-ec53-4bc9-9984-2ebcce27c8af" Jul 22 18:14:14.060544 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:14.060506 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs\") pod \"network-metrics-daemon-tbzjc\" (UID: \"6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57\") " pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:14.060922 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:14.060672 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:14:14.060922 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:14.060740 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs podName:6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:22.060720778 +0000 UTC m=+17.985615781 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs") pod "network-metrics-daemon-tbzjc" (UID: "6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:14:14.262785 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:14.262745 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpw92\" (UniqueName: \"kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92\") pod \"network-check-target-gqbsh\" (UID: \"ec8b8800-ec53-4bc9-9984-2ebcce27c8af\") " pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:14.262955 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:14.262833 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret\") pod \"global-pull-secret-syncer-5t9vd\" (UID: \"26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96\") " pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:14.266730 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:14.266629 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 18:14:14.266730 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:14.266642 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 18:14:14.266730 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:14.266658 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 18:14:14.266730 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:14.266673 2554 projected.go:196] Error preparing data for projected volume kube-api-access-kpw92 for pod openshift-network-diagnostics/network-check-target-gqbsh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:14:14.266730 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:14.266712 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret podName:26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:22.266696014 +0000 UTC m=+18.191591010 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret") pod "global-pull-secret-syncer-5t9vd" (UID: "26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96") : object "kube-system"/"original-pull-secret" not registered Jul 22 18:14:14.266730 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:14.266727 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92 podName:ec8b8800-ec53-4bc9-9984-2ebcce27c8af nodeName:}" failed. No retries permitted until 2026-07-22 18:14:22.266720596 +0000 UTC m=+18.191615592 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpw92" (UniqueName: "kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92") pod "network-check-target-gqbsh" (UID: "ec8b8800-ec53-4bc9-9984-2ebcce27c8af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:14:14.542306 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:14.542229 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:14.542490 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:14.542321 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t9vd" podUID="26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96" Jul 22 18:14:15.541508 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:15.541476 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:15.541971 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:15.541603 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbzjc" podUID="6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57" Jul 22 18:14:15.541971 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:15.541483 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:15.542115 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:15.542000 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqbsh" podUID="ec8b8800-ec53-4bc9-9984-2ebcce27c8af" Jul 22 18:14:16.541541 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:16.541504 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:16.542013 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:16.541631 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t9vd" podUID="26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96" Jul 22 18:14:17.541013 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:17.540974 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:17.541170 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:17.541091 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbzjc" podUID="6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57" Jul 22 18:14:17.541445 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:17.541410 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:17.541533 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:17.541515 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqbsh" podUID="ec8b8800-ec53-4bc9-9984-2ebcce27c8af" Jul 22 18:14:18.541387 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:18.541343 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:18.541902 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:18.541481 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t9vd" podUID="26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96" Jul 22 18:14:19.541593 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:19.541555 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:19.542012 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:19.541555 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:19.542012 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:19.541672 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbzjc" podUID="6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57" Jul 22 18:14:19.542012 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:19.541728 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqbsh" podUID="ec8b8800-ec53-4bc9-9984-2ebcce27c8af" Jul 22 18:14:20.541539 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:20.541504 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:20.541722 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:20.541648 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t9vd" podUID="26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96" Jul 22 18:14:21.540946 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:21.540905 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:21.541153 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:21.541031 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbzjc" podUID="6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57" Jul 22 18:14:21.541153 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:21.541061 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:21.541153 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:21.541138 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqbsh" podUID="ec8b8800-ec53-4bc9-9984-2ebcce27c8af" Jul 22 18:14:22.122970 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:22.122927 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs\") pod \"network-metrics-daemon-tbzjc\" (UID: \"6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57\") " pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:22.123336 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:22.123062 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:14:22.123336 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:22.123123 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs podName:6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:38.12310829 +0000 UTC m=+34.048003286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs") pod "network-metrics-daemon-tbzjc" (UID: "6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:14:22.324869 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:22.324775 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret\") pod \"global-pull-secret-syncer-5t9vd\" (UID: \"26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96\") " pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:22.324869 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:22.324834 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpw92\" (UniqueName: \"kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92\") pod \"network-check-target-gqbsh\" (UID: \"ec8b8800-ec53-4bc9-9984-2ebcce27c8af\") " pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:22.325147 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:22.324962 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 18:14:22.325147 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:22.324975 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 18:14:22.325147 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:22.324994 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 18:14:22.325147 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:22.325008 2554 projected.go:196] Error preparing data for projected volume kube-api-access-kpw92 for pod openshift-network-diagnostics/network-check-target-gqbsh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:14:22.325147 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:22.325062 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret podName:26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:38.325045632 +0000 UTC m=+34.249940633 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret") pod "global-pull-secret-syncer-5t9vd" (UID: "26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96") : object "kube-system"/"original-pull-secret" not registered Jul 22 18:14:22.325147 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:22.325083 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92 podName:ec8b8800-ec53-4bc9-9984-2ebcce27c8af nodeName:}" failed. No retries permitted until 2026-07-22 18:14:38.325073603 +0000 UTC m=+34.249968601 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpw92" (UniqueName: "kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92") pod "network-check-target-gqbsh" (UID: "ec8b8800-ec53-4bc9-9984-2ebcce27c8af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:14:22.543367 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:22.543328 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:22.543557 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:22.543473 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t9vd" podUID="26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96" Jul 22 18:14:23.541015 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:23.540975 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:23.541015 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:23.540996 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:23.541525 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:23.541094 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqbsh" podUID="ec8b8800-ec53-4bc9-9984-2ebcce27c8af" Jul 22 18:14:23.541525 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:23.541233 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbzjc" podUID="6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57" Jul 22 18:14:24.541568 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:24.541537 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:24.542037 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:24.541637 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t9vd" podUID="26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96" Jul 22 18:14:25.541467 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:25.541431 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:25.541467 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:25.541455 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:25.541884 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:25.541554 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbzjc" podUID="6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57" Jul 22 18:14:25.541884 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:25.541686 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqbsh" podUID="ec8b8800-ec53-4bc9-9984-2ebcce27c8af" Jul 22 18:14:26.541080 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:26.541038 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:26.541367 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:26.541152 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t9vd" podUID="26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96" Jul 22 18:14:27.541432 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.541251 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:27.541897 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.541293 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:27.541897 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:27.541524 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbzjc" podUID="6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57" Jul 22 18:14:27.541897 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:27.541590 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqbsh" podUID="ec8b8800-ec53-4bc9-9984-2ebcce27c8af" Jul 22 18:14:27.649915 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.649755 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xhvg7" event={"ID":"ac8b7f98-7337-456e-b08e-bf25703dd8ec","Type":"ContainerStarted","Data":"ec8b9ad5e8f52f39e605fb9bf98181c5c5631822211a9ce54e38d6778d745910"} Jul 22 18:14:27.651070 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.651043 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" event={"ID":"76e8c9c3-4027-4837-b1e1-1c0ebce07851","Type":"ContainerStarted","Data":"50290e89f9ef0fe918416e0ee51c479024ee5c09da51772a8efd2bc4bb04f5da"} Jul 22 18:14:27.652561 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.652533 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8tx85" event={"ID":"07da8a07-dcb9-4331-99de-82a25374214b","Type":"ContainerStarted","Data":"6d03852c06ac8708544c0bb539219b6e7f7c8c00dae0ab74e004202103777b80"} Jul 22 18:14:27.654140 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.654119 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-65.ec2.internal" event={"ID":"771a9cee6459867329caacdbd2b313c6","Type":"ContainerStarted","Data":"4f69d752f5eed2f2bc739e27dceb1c9811e6d57b664b76c0ee31d0e9f7aa0073"} Jul 22 18:14:27.655290 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.655270 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jq95d" event={"ID":"d3cf4800-3b6b-47c5-b9a1-4e14d716f323","Type":"ContainerStarted","Data":"8690bd225230c3414549338f0e50af6375cc873e2d857dcf36667862d5da4360"} Jul 22 18:14:27.656396 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.656376 2554 generic.go:356] "Generic (PLEG): container finished" podID="5c2a0461-3c56-47ee-af78-3355695a39be" containerID="3cc18657428f4958e46fe324df69c82995357e280d6c9f1f376f9af8ab19d293" exitCode=0 Jul 22 18:14:27.656495 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.656444 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6jrf" event={"ID":"5c2a0461-3c56-47ee-af78-3355695a39be","Type":"ContainerDied","Data":"3cc18657428f4958e46fe324df69c82995357e280d6c9f1f376f9af8ab19d293"} Jul 22 18:14:27.657717 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.657681 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d7fbm" event={"ID":"03a472de-a374-457c-9959-409546b51390","Type":"ContainerStarted","Data":"9375e999d09718cd92d0c6e3752d7a8f54f76439b20a754997a63715631e5c99"} Jul 22 18:14:27.659072 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.659002 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" event={"ID":"6012a5b1-5dff-4b0b-adb3-e8136f9b6737","Type":"ContainerStarted","Data":"b9a9c9c41166fda9c47e1d36a226e19cf059b7edd6c1f29c8be7c3e7cc70986c"} Jul 22 18:14:27.660661 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.660645 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:14:27.660945 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.660927 2554 generic.go:356] "Generic (PLEG): container finished" podID="ab829dfc-b3d2-4f76-be11-cf9f0beabcf1" containerID="0cff634340f53a3321edf24c0dfe5ba41fa6dfa6e67de4cdf691799e2751c28c" exitCode=1 Jul 22 18:14:27.661029 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.660953 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" event={"ID":"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1","Type":"ContainerStarted","Data":"7ec39206fbe88550340307b667c76a5334ef84943b2b96e375ed5d492cbc5ee4"} Jul 22 18:14:27.661029 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.660995 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" event={"ID":"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1","Type":"ContainerDied","Data":"0cff634340f53a3321edf24c0dfe5ba41fa6dfa6e67de4cdf691799e2751c28c"} Jul 22 18:14:27.661029 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.661024 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" event={"ID":"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1","Type":"ContainerStarted","Data":"0e65a4a63fd92ed61e595f38b65147e4ec8ceadf22536f51240d89e29a49e49a"} Jul 22 18:14:27.692775 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.692734 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j6dm4" podStartSLOduration=2.472666124 podStartE2EDuration="22.692719324s" totalImagesPullingTime="20.2200532s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:27.692685214 +0000 UTC m=+23.617580234" watchObservedRunningTime="2026-07-22 18:14:27.692719324 +0000 UTC m=+23.617614342" Jul 22 18:14:27.707237 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.707192 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8tx85" podStartSLOduration=2.473089488 podStartE2EDuration="22.707177829s" totalImagesPullingTime="20.234088341s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:27.707009371 +0000 UTC m=+23.631904389" watchObservedRunningTime="2026-07-22 18:14:27.707177829 +0000 UTC m=+23.632072846" Jul 22 18:14:27.721311 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.721273 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jq95d" podStartSLOduration=7.419635605 podStartE2EDuration="22.721261301s" totalImagesPullingTime="15.301625696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:27.7206815 +0000 UTC m=+23.645576519" watchObservedRunningTime="2026-07-22 18:14:27.721261301 +0000 UTC m=+23.646156319" Jul 22 18:14:27.735163 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.735129 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d7fbm" podStartSLOduration=7.442444062 podStartE2EDuration="22.735115721s" totalImagesPullingTime="15.292671659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:27.735013754 +0000 UTC m=+23.659908772" watchObservedRunningTime="2026-07-22 18:14:27.735115721 +0000 UTC m=+23.660010738" Jul 22 18:14:27.749967 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.749928 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-65.ec2.internal" podStartSLOduration=21.749909124 podStartE2EDuration="21.749909124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:27.749452025 +0000 UTC m=+23.674347040" watchObservedRunningTime="2026-07-22 18:14:27.749909124 +0000 UTC m=+23.674804143" Jul 22 18:14:27.769321 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:27.769287 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xhvg7" podStartSLOduration=2.552386007 podStartE2EDuration="22.769273428s" totalImagesPullingTime="20.216887421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:27.768977229 +0000 UTC m=+23.693872248" watchObservedRunningTime="2026-07-22 18:14:27.769273428 +0000 UTC m=+23.694168447" Jul 22 18:14:28.125090 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:28.125037 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:28.218444 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:28.218346 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:28.481053 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:28.480965 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:28.541486 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:28.541460 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:28.542151 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:28.541587 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t9vd" podUID="26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96" Jul 22 18:14:28.551568 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:28.551541 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:28.631959 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:28.631931 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:28.665282 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:28.665243 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pps6b" event={"ID":"a2950bce-3845-49aa-9500-c1e130d5cff4","Type":"ContainerStarted","Data":"63264cf602b27fe0eade3fa936a3321012329f1fd2c4f804a3a765afc5da93e8"} Jul 22 18:14:28.668722 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:28.668695 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:14:28.669141 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:28.669110 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" event={"ID":"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1","Type":"ContainerStarted","Data":"17081f5466def9a542395d6fe502e10488c037de748b718c51a67d1e5293f53d"} Jul 22 18:14:28.669238 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:28.669198 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" event={"ID":"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1","Type":"ContainerStarted","Data":"d4bf81be80d186a93ab579cb6a56f767dd4f8a91b565a3bc064588587821b45c"} Jul 22 18:14:28.669292 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:28.669247 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" event={"ID":"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1","Type":"ContainerStarted","Data":"877c4f95f5d57d688fec3a8ddae132dafff5fd70e44566e2c40a7f1b420d18ef"} Jul 22 18:14:28.682482 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:28.682427 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pps6b" podStartSLOduration=3.440833872 podStartE2EDuration="23.682395357s" totalImagesPullingTime="20.241561485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:28.682009048 +0000 UTC m=+24.606904066" watchObservedRunningTime="2026-07-22 18:14:28.682395357 +0000 UTC m=+24.607290375" Jul 22 18:14:28.732915 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:28.732864 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:28.846234 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:28.846206 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:28.860858 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:28.860833 2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 22 18:14:29.234096 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:29.234060 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:29.293896 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:29.293864 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jq95d" Jul 22 18:14:29.294614 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:29.294581 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jq95d" Jul 22 18:14:29.313829 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:29.313801 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:29.453173 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:29.453058 2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-22T18:14:28.860854926Z","UUID":"a8a7b438-e711-4c28-af4d-8808108b7c35","Handler":null,"Name":"","Endpoint":""} Jul 22 18:14:29.454978 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:29.454953 2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 22 18:14:29.455114 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:29.455001 2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 22 18:14:29.541133 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:29.541061 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:29.541133 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:29.541108 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:29.541357 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:29.541195 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbzjc" podUID="6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57" Jul 22 18:14:29.541357 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:29.541305 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqbsh" podUID="ec8b8800-ec53-4bc9-9984-2ebcce27c8af" Jul 22 18:14:29.674260 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:29.674224 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" event={"ID":"6012a5b1-5dff-4b0b-adb3-e8136f9b6737","Type":"ContainerStarted","Data":"040e806a2ac37d102d81c53ee3485a59812d03275d0daa80c281b6c2f391542d"} Jul 22 18:14:29.675467 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:29.675442 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jq95d" Jul 22 18:14:29.675866 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:29.675851 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jq95d" Jul 22 18:14:29.740140 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:29.740109 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:30.047157 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:30.047125 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:30.434195 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:30.434162 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:30.486698 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:30.486669 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:30.541017 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:30.540949 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:30.541149 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:30.541083 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t9vd" podUID="26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96" Jul 22 18:14:30.683694 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:30.683490 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:14:30.684134 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:30.684100 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" event={"ID":"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1","Type":"ContainerStarted","Data":"fbd4610617ed640df85120811a2d60d330264c9c9bc8cb6844a25f84d678bbd4"} Jul 22 18:14:31.540747 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:31.540717 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:31.540937 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:31.540849 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbzjc" podUID="6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57" Jul 22 18:14:31.540937 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:31.540869 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:31.541024 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:31.540944 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqbsh" podUID="ec8b8800-ec53-4bc9-9984-2ebcce27c8af" Jul 22 18:14:32.542036 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:32.541780 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:32.542036 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:32.541906 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t9vd" podUID="26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96" Jul 22 18:14:32.690901 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:32.690738 2554 generic.go:356] "Generic (PLEG): container finished" podID="5c2a0461-3c56-47ee-af78-3355695a39be" containerID="bfc0e3dd1fbf1b0ea508e0fa1303dd833f4829a763b20104e422ccc9d5487813" exitCode=0 Jul 22 18:14:32.691070 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:32.690834 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6jrf" event={"ID":"5c2a0461-3c56-47ee-af78-3355695a39be","Type":"ContainerDied","Data":"bfc0e3dd1fbf1b0ea508e0fa1303dd833f4829a763b20104e422ccc9d5487813"} Jul 22 18:14:32.693172 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:32.693148 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" event={"ID":"6012a5b1-5dff-4b0b-adb3-e8136f9b6737","Type":"ContainerStarted","Data":"8f96ec184a4b9d89e5ea28e5df47b70ee1591cd7e8a39903a9cc7d7d03190118"} Jul 22 18:14:32.696558 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:32.696535 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:14:32.696877 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:32.696851 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" event={"ID":"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1","Type":"ContainerStarted","Data":"dfcbb5838ef599539f9f2f0f59ac572e33bdeebd4bb03610c07271a3404a7148"} Jul 22 18:14:32.697079 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:32.697060 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:32.697132 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:32.697117 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:32.697229 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:32.697216 2554 scope.go:117] "RemoveContainer" containerID="0cff634340f53a3321edf24c0dfe5ba41fa6dfa6e67de4cdf691799e2751c28c" Jul 22 18:14:32.713224 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:32.713209 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:32.759325 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:32.759287 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kl2wp" podStartSLOduration=2.710809063 podStartE2EDuration="27.75927258s" totalImagesPullingTime="25.048463517s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:14:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:32.759090151 +0000 UTC m=+28.683985160" watchObservedRunningTime="2026-07-22 18:14:32.75927258 +0000 UTC m=+28.684167599" Jul 22 18:14:33.541586 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:33.541512 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:33.541862 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:33.541517 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:33.541862 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:33.541639 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbzjc" podUID="6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57" Jul 22 18:14:33.541862 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:33.541735 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqbsh" podUID="ec8b8800-ec53-4bc9-9984-2ebcce27c8af" Jul 22 18:14:33.704704 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:33.704673 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:14:33.705235 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:33.705103 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" event={"ID":"ab829dfc-b3d2-4f76-be11-cf9f0beabcf1","Type":"ContainerStarted","Data":"a77333f421698a0dfd41768236ddb7239e4427e6b9a5fc02b6454a2ff5ee292a"} Jul 22 18:14:33.705695 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:33.705658 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:33.731444 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:33.729472 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:14:33.736464 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:33.735637 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" podStartSLOduration=8.1929375 podStartE2EDuration="28.735617211s" totalImagesPullingTime="20.542679711s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:33.731941974 +0000 UTC m=+29.656836993" watchObservedRunningTime="2026-07-22 18:14:33.735617211 +0000 UTC m=+29.660512232" Jul 22 18:14:34.446044 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:34.445955 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5t9vd"] Jul 22 18:14:34.446223 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:34.446067 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:34.446223 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:34.446159 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t9vd" podUID="26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96" Jul 22 18:14:34.449310 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:34.449287 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gqbsh"] Jul 22 18:14:34.449468 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:34.449382 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:34.449544 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:34.449490 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqbsh" podUID="ec8b8800-ec53-4bc9-9984-2ebcce27c8af" Jul 22 18:14:34.450177 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:34.450152 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tbzjc"] Jul 22 18:14:34.450267 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:34.450254 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:34.450386 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:34.450366 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbzjc" podUID="6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57" Jul 22 18:14:34.709504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:34.709196 2554 generic.go:356] "Generic (PLEG): container finished" podID="5c2a0461-3c56-47ee-af78-3355695a39be" containerID="55e2b6dc60dfee5a4a42648f48d93b89beb7c903f4097fb113fd3bcfc11d8381" exitCode=0 Jul 22 18:14:34.709849 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:34.709274 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6jrf" event={"ID":"5c2a0461-3c56-47ee-af78-3355695a39be","Type":"ContainerDied","Data":"55e2b6dc60dfee5a4a42648f48d93b89beb7c903f4097fb113fd3bcfc11d8381"} Jul 22 18:14:35.066160 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:35.066118 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:35.127162 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:35.127134 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:36.541854 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:36.541817 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:36.542552 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:36.541816 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:36.542552 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:36.541950 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqbsh" podUID="ec8b8800-ec53-4bc9-9984-2ebcce27c8af" Jul 22 18:14:36.542552 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:36.541966 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:36.542552 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:36.542079 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbzjc" podUID="6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57" Jul 22 18:14:36.542552 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:36.542165 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t9vd" podUID="26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96" Jul 22 18:14:36.715369 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:36.715335 2554 generic.go:356] "Generic (PLEG): container finished" podID="5c2a0461-3c56-47ee-af78-3355695a39be" containerID="15fca9db687c5b2cb8a34cb2be1de03891a59d35687cb706f960761ee7810e73" exitCode=0 Jul 22 18:14:36.715543 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:36.715394 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6jrf" event={"ID":"5c2a0461-3c56-47ee-af78-3355695a39be","Type":"ContainerDied","Data":"15fca9db687c5b2cb8a34cb2be1de03891a59d35687cb706f960761ee7810e73"} Jul 22 18:14:38.139816 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:38.139780 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs\") pod \"network-metrics-daemon-tbzjc\" (UID: \"6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57\") " pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:38.140403 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:38.139984 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:14:38.140403 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:38.140095 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs podName:6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57 nodeName:}" failed. No retries permitted until 2026-07-22 18:15:10.140073338 +0000 UTC m=+66.064968337 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs") pod "network-metrics-daemon-tbzjc" (UID: "6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 22 18:14:38.340969 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:38.340930 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpw92\" (UniqueName: \"kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92\") pod \"network-check-target-gqbsh\" (UID: \"ec8b8800-ec53-4bc9-9984-2ebcce27c8af\") " pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:38.341132 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:38.340999 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret\") pod \"global-pull-secret-syncer-5t9vd\" (UID: \"26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96\") " pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:38.341132 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:38.341116 2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 22 18:14:38.341221 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:38.341127 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 22 18:14:38.341221 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:38.341157 2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 22 18:14:38.341221 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:38.341173 2554 projected.go:196] Error preparing data for projected volume kube-api-access-kpw92 for pod openshift-network-diagnostics/network-check-target-gqbsh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:14:38.341221 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:38.341186 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret podName:26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96 nodeName:}" failed. No retries permitted until 2026-07-22 18:15:10.341167798 +0000 UTC m=+66.266062797 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret") pod "global-pull-secret-syncer-5t9vd" (UID: "26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96") : object "kube-system"/"original-pull-secret" not registered Jul 22 18:14:38.341221 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:38.341214 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92 podName:ec8b8800-ec53-4bc9-9984-2ebcce27c8af nodeName:}" failed. No retries permitted until 2026-07-22 18:15:10.341203548 +0000 UTC m=+66.266098544 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kpw92" (UniqueName: "kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92") pod "network-check-target-gqbsh" (UID: "ec8b8800-ec53-4bc9-9984-2ebcce27c8af") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 22 18:14:38.541090 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:38.541057 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:38.541278 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:38.541057 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:38.541278 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:38.541191 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:38.541278 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:38.541186 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t9vd" podUID="26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96" Jul 22 18:14:38.541278 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:38.541268 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqbsh" podUID="ec8b8800-ec53-4bc9-9984-2ebcce27c8af" Jul 22 18:14:38.541524 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:38.541411 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbzjc" podUID="6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57" Jul 22 18:14:40.541739 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:40.541704 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:40.542218 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:40.541833 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gqbsh" podUID="ec8b8800-ec53-4bc9-9984-2ebcce27c8af" Jul 22 18:14:40.542218 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:40.542042 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:40.542218 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:40.542133 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbzjc" podUID="6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57" Jul 22 18:14:40.542319 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:40.542277 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:40.542375 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:40.542349 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5t9vd" podUID="26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96" Jul 22 18:14:40.986668 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:40.986644 2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-65.ec2.internal" event="NodeReady" Jul 22 18:14:40.986790 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:40.986781 2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 22 18:14:41.016146 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.016115 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:41.029221 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.029196 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dhqrm"] Jul 22 18:14:41.032024 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.032003 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rfdk4"] Jul 22 18:14:41.032146 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.032131 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dhqrm" Jul 22 18:14:41.034800 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.034781 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rfdk4" Jul 22 18:14:41.035209 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.035190 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 22 18:14:41.035299 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.035225 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ttgch\"" Jul 22 18:14:41.035299 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.035227 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 22 18:14:41.037150 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.037133 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7ttjh\"" Jul 22 18:14:41.037471 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.037454 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 22 18:14:41.037550 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.037477 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 22 18:14:41.037784 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.037764 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 22 18:14:41.041791 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.041758 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dhqrm"] Jul 22 18:14:41.045478 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.044703 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rfdk4"] Jul 22 18:14:41.080898 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.080826 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:41.133974 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.133946 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:41.163028 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.162999 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f40c4040-42e8-402a-b893-2055c35bc560-tmp-dir\") pod \"dns-default-dhqrm\" (UID: \"f40c4040-42e8-402a-b893-2055c35bc560\") " pod="openshift-dns/dns-default-dhqrm" Jul 22 18:14:41.163149 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.163034 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2lmq\" (UniqueName: \"kubernetes.io/projected/6998e97e-e9c2-4a74-b215-7261baa166cf-kube-api-access-k2lmq\") pod \"ingress-canary-rfdk4\" (UID: \"6998e97e-e9c2-4a74-b215-7261baa166cf\") " pod="openshift-ingress-canary/ingress-canary-rfdk4" Jul 22 18:14:41.163149 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.163055 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls\") pod \"dns-default-dhqrm\" (UID: \"f40c4040-42e8-402a-b893-2055c35bc560\") " pod="openshift-dns/dns-default-dhqrm" Jul 22 18:14:41.163149 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.163083 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhd2w\" (UniqueName: \"kubernetes.io/projected/f40c4040-42e8-402a-b893-2055c35bc560-kube-api-access-rhd2w\") pod \"dns-default-dhqrm\" (UID: \"f40c4040-42e8-402a-b893-2055c35bc560\") " pod="openshift-dns/dns-default-dhqrm" Jul 22 18:14:41.163149 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.163127 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f40c4040-42e8-402a-b893-2055c35bc560-config-volume\") pod \"dns-default-dhqrm\" (UID: \"f40c4040-42e8-402a-b893-2055c35bc560\") " pod="openshift-dns/dns-default-dhqrm" Jul 22 18:14:41.163267 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.163152 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6998e97e-e9c2-4a74-b215-7261baa166cf-cert\") pod \"ingress-canary-rfdk4\" (UID: \"6998e97e-e9c2-4a74-b215-7261baa166cf\") " pod="openshift-ingress-canary/ingress-canary-rfdk4" Jul 22 18:14:41.264295 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.264263 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhd2w\" (UniqueName: \"kubernetes.io/projected/f40c4040-42e8-402a-b893-2055c35bc560-kube-api-access-rhd2w\") pod \"dns-default-dhqrm\" (UID: \"f40c4040-42e8-402a-b893-2055c35bc560\") " pod="openshift-dns/dns-default-dhqrm" Jul 22 18:14:41.264295 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.264296 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f40c4040-42e8-402a-b893-2055c35bc560-config-volume\") pod \"dns-default-dhqrm\" (UID: \"f40c4040-42e8-402a-b893-2055c35bc560\") " pod="openshift-dns/dns-default-dhqrm" Jul 22 18:14:41.264483 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.264312 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6998e97e-e9c2-4a74-b215-7261baa166cf-cert\") pod \"ingress-canary-rfdk4\" (UID: \"6998e97e-e9c2-4a74-b215-7261baa166cf\") " pod="openshift-ingress-canary/ingress-canary-rfdk4" Jul 22 18:14:41.264483 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.264399 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f40c4040-42e8-402a-b893-2055c35bc560-tmp-dir\") pod \"dns-default-dhqrm\" (UID: \"f40c4040-42e8-402a-b893-2055c35bc560\") " pod="openshift-dns/dns-default-dhqrm" Jul 22 18:14:41.264483 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.264445 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2lmq\" (UniqueName: \"kubernetes.io/projected/6998e97e-e9c2-4a74-b215-7261baa166cf-kube-api-access-k2lmq\") pod \"ingress-canary-rfdk4\" (UID: \"6998e97e-e9c2-4a74-b215-7261baa166cf\") " pod="openshift-ingress-canary/ingress-canary-rfdk4" Jul 22 18:14:41.264483 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.264468 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls\") pod \"dns-default-dhqrm\" (UID: \"f40c4040-42e8-402a-b893-2055c35bc560\") " pod="openshift-dns/dns-default-dhqrm" Jul 22 18:14:41.264690 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:41.264562 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:14:41.264690 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:41.264627 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls podName:f40c4040-42e8-402a-b893-2055c35bc560 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:41.764608346 +0000 UTC m=+37.689503355 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls") pod "dns-default-dhqrm" (UID: "f40c4040-42e8-402a-b893-2055c35bc560") : secret "dns-default-metrics-tls" not found Jul 22 18:14:41.264808 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.264746 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f40c4040-42e8-402a-b893-2055c35bc560-tmp-dir\") pod \"dns-default-dhqrm\" (UID: \"f40c4040-42e8-402a-b893-2055c35bc560\") " pod="openshift-dns/dns-default-dhqrm" Jul 22 18:14:41.264927 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.264910 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f40c4040-42e8-402a-b893-2055c35bc560-config-volume\") pod \"dns-default-dhqrm\" (UID: \"f40c4040-42e8-402a-b893-2055c35bc560\") " pod="openshift-dns/dns-default-dhqrm" Jul 22 18:14:41.268779 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.268662 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6998e97e-e9c2-4a74-b215-7261baa166cf-cert\") pod \"ingress-canary-rfdk4\" (UID: \"6998e97e-e9c2-4a74-b215-7261baa166cf\") " pod="openshift-ingress-canary/ingress-canary-rfdk4" Jul 22 18:14:41.274809 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.274780 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhd2w\" (UniqueName: \"kubernetes.io/projected/f40c4040-42e8-402a-b893-2055c35bc560-kube-api-access-rhd2w\") pod \"dns-default-dhqrm\" (UID: \"f40c4040-42e8-402a-b893-2055c35bc560\") " pod="openshift-dns/dns-default-dhqrm" Jul 22 18:14:41.274964 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.274946 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2lmq\" (UniqueName: \"kubernetes.io/projected/6998e97e-e9c2-4a74-b215-7261baa166cf-kube-api-access-k2lmq\") pod \"ingress-canary-rfdk4\" (UID: \"6998e97e-e9c2-4a74-b215-7261baa166cf\") " pod="openshift-ingress-canary/ingress-canary-rfdk4" Jul 22 18:14:41.347177 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.347082 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rfdk4" Jul 22 18:14:41.478362 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.478329 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rfdk4"] Jul 22 18:14:41.482078 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:41.482053 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6998e97e_e9c2_4a74_b215_7261baa166cf.slice/crio-21f89053d175823cb6281fb2bf4142c8233e53f7a1fd017c96bb9424ae715fc0 WatchSource:0}: Error finding container 21f89053d175823cb6281fb2bf4142c8233e53f7a1fd017c96bb9424ae715fc0: Status 404 returned error can't find the container with id 21f89053d175823cb6281fb2bf4142c8233e53f7a1fd017c96bb9424ae715fc0 Jul 22 18:14:41.728117 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.728037 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rfdk4" event={"ID":"6998e97e-e9c2-4a74-b215-7261baa166cf","Type":"ContainerStarted","Data":"21f89053d175823cb6281fb2bf4142c8233e53f7a1fd017c96bb9424ae715fc0"} Jul 22 18:14:41.730933 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.730904 2554 generic.go:356] "Generic (PLEG): container finished" podID="5c2a0461-3c56-47ee-af78-3355695a39be" containerID="851b84b1d061b9841d9153a7e446478f75248b3547b0fb45ecf5c02d822257bb" exitCode=0 Jul 22 18:14:41.731047 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.730945 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6jrf" event={"ID":"5c2a0461-3c56-47ee-af78-3355695a39be","Type":"ContainerDied","Data":"851b84b1d061b9841d9153a7e446478f75248b3547b0fb45ecf5c02d822257bb"} Jul 22 18:14:41.768905 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:41.768864 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls\") pod \"dns-default-dhqrm\" (UID: \"f40c4040-42e8-402a-b893-2055c35bc560\") " pod="openshift-dns/dns-default-dhqrm" Jul 22 18:14:41.769188 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:41.769138 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:14:41.769274 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:41.769202 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls podName:f40c4040-42e8-402a-b893-2055c35bc560 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:42.76918276 +0000 UTC m=+38.694077756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls") pod "dns-default-dhqrm" (UID: "f40c4040-42e8-402a-b893-2055c35bc560") : secret "dns-default-metrics-tls" not found Jul 22 18:14:42.541079 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:42.541041 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:14:42.541248 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:42.541042 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:14:42.541248 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:42.541042 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:14:42.544206 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:42.544180 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 18:14:42.547577 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:42.545022 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 18:14:42.547577 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:42.545073 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vjc8f\"" Jul 22 18:14:42.547577 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:42.545358 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 18:14:42.547577 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:42.545604 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8sjds\"" Jul 22 18:14:42.547577 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:42.545812 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 18:14:42.736680 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:42.736494 2554 generic.go:356] "Generic (PLEG): container finished" podID="5c2a0461-3c56-47ee-af78-3355695a39be" containerID="e1fa3eb708d4ac899e55be9a428380462a81a3509a26d0e5e41ae098afedfc36" exitCode=0 Jul 22 18:14:42.736680 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:42.736564 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6jrf" event={"ID":"5c2a0461-3c56-47ee-af78-3355695a39be","Type":"ContainerDied","Data":"e1fa3eb708d4ac899e55be9a428380462a81a3509a26d0e5e41ae098afedfc36"} Jul 22 18:14:42.777188 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:42.777159 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls\") pod \"dns-default-dhqrm\" (UID: \"f40c4040-42e8-402a-b893-2055c35bc560\") " pod="openshift-dns/dns-default-dhqrm" Jul 22 18:14:42.777389 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:42.777296 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:14:42.777389 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:42.777373 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls podName:f40c4040-42e8-402a-b893-2055c35bc560 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:44.777355474 +0000 UTC m=+40.702250472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls") pod "dns-default-dhqrm" (UID: "f40c4040-42e8-402a-b893-2055c35bc560") : secret "dns-default-metrics-tls" not found Jul 22 18:14:43.743049 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:43.743017 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j6jrf" event={"ID":"5c2a0461-3c56-47ee-af78-3355695a39be","Type":"ContainerStarted","Data":"08a5d73fccecc269404659ceca2fd5fb42ceb1b5eeaea27188e2084482d894ba"} Jul 22 18:14:43.766363 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:43.766264 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j6jrf" podStartSLOduration=6.9387573289999995 podStartE2EDuration="38.766246204s" totalImagesPullingTime="31.827488875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:14:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:43.764455102 +0000 UTC m=+39.689350120" watchObservedRunningTime="2026-07-22 18:14:43.766246204 +0000 UTC m=+39.691141223" Jul 22 18:14:43.893462 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:43.893405 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:43.946117 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:43.946071 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:44.257991 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:44.257911 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:44.620530 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:44.620492 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:44.676275 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:44.676245 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:44.747645 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:44.747608 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rfdk4" event={"ID":"6998e97e-e9c2-4a74-b215-7261baa166cf","Type":"ContainerStarted","Data":"5601675c666c9829c192c14d0d861c281ee262e4a9f47dc009db5ed6e72f4b33"} Jul 22 18:14:44.763814 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:44.763762 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rfdk4" podStartSLOduration=0.645319598 podStartE2EDuration="3.763742476s" totalImagesPullingTime="3.118422878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:14:44.763452097 +0000 UTC m=+40.688347129" watchObservedRunningTime="2026-07-22 18:14:44.763742476 +0000 UTC m=+40.688637494" Jul 22 18:14:44.793734 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:44.793701 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls\") pod \"dns-default-dhqrm\" (UID: \"f40c4040-42e8-402a-b893-2055c35bc560\") " pod="openshift-dns/dns-default-dhqrm" Jul 22 18:14:44.793900 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:44.793883 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:14:44.793991 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:44.793979 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls podName:f40c4040-42e8-402a-b893-2055c35bc560 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:48.793957121 +0000 UTC m=+44.718852120 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls") pod "dns-default-dhqrm" (UID: "f40c4040-42e8-402a-b893-2055c35bc560") : secret "dns-default-metrics-tls" not found Jul 22 18:14:44.936976 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:44.936877 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:45.115922 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:45.115887 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:48.506033 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:48.506001 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:48.605747 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:48.605716 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:14:48.823449 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:48.823348 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls\") pod \"dns-default-dhqrm\" (UID: \"f40c4040-42e8-402a-b893-2055c35bc560\") " pod="openshift-dns/dns-default-dhqrm" Jul 22 18:14:48.823587 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:48.823509 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:14:48.823587 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:48.823570 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls podName:f40c4040-42e8-402a-b893-2055c35bc560 nodeName:}" failed. No retries permitted until 2026-07-22 18:14:56.823551918 +0000 UTC m=+52.748446915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls") pod "dns-default-dhqrm" (UID: "f40c4040-42e8-402a-b893-2055c35bc560") : secret "dns-default-metrics-tls" not found Jul 22 18:14:56.871693 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:56.871655 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls\") pod \"dns-default-dhqrm\" (UID: \"f40c4040-42e8-402a-b893-2055c35bc560\") " pod="openshift-dns/dns-default-dhqrm" Jul 22 18:14:56.872214 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:56.871766 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:14:56.872214 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:14:56.871815 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls podName:f40c4040-42e8-402a-b893-2055c35bc560 nodeName:}" failed. No retries permitted until 2026-07-22 18:15:12.871801795 +0000 UTC m=+68.796696792 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls") pod "dns-default-dhqrm" (UID: "f40c4040-42e8-402a-b893-2055c35bc560") : secret "dns-default-metrics-tls" not found Jul 22 18:14:58.022100 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:58.022066 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t"] Jul 22 18:14:58.048145 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:58.048115 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t"] Jul 22 18:14:58.048288 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:58.048211 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t" Jul 22 18:14:58.051219 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:58.051193 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 22 18:14:58.052270 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:58.052250 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 22 18:14:58.052461 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:58.052404 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 22 18:14:58.052552 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:58.052488 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 22 18:14:58.181047 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:58.181010 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59be4c47-5966-4e97-9476-f8c975d1b4e8-tmp\") pod \"klusterlet-addon-workmgr-5dbb7d446d-cvw2t\" (UID: \"59be4c47-5966-4e97-9476-f8c975d1b4e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t" Jul 22 18:14:58.181226 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:58.181099 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/59be4c47-5966-4e97-9476-f8c975d1b4e8-klusterlet-config\") pod \"klusterlet-addon-workmgr-5dbb7d446d-cvw2t\" (UID: \"59be4c47-5966-4e97-9476-f8c975d1b4e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t" Jul 22 18:14:58.181226 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:58.181158 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbjk5\" (UniqueName: \"kubernetes.io/projected/59be4c47-5966-4e97-9476-f8c975d1b4e8-kube-api-access-zbjk5\") pod \"klusterlet-addon-workmgr-5dbb7d446d-cvw2t\" (UID: \"59be4c47-5966-4e97-9476-f8c975d1b4e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t" Jul 22 18:14:58.282389 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:58.282313 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59be4c47-5966-4e97-9476-f8c975d1b4e8-tmp\") pod \"klusterlet-addon-workmgr-5dbb7d446d-cvw2t\" (UID: \"59be4c47-5966-4e97-9476-f8c975d1b4e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t" Jul 22 18:14:58.282389 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:58.282373 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/59be4c47-5966-4e97-9476-f8c975d1b4e8-klusterlet-config\") pod \"klusterlet-addon-workmgr-5dbb7d446d-cvw2t\" (UID: \"59be4c47-5966-4e97-9476-f8c975d1b4e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t" Jul 22 18:14:58.282569 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:58.282439 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbjk5\" (UniqueName: \"kubernetes.io/projected/59be4c47-5966-4e97-9476-f8c975d1b4e8-kube-api-access-zbjk5\") pod \"klusterlet-addon-workmgr-5dbb7d446d-cvw2t\" (UID: \"59be4c47-5966-4e97-9476-f8c975d1b4e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t" Jul 22 18:14:58.282806 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:58.282786 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/59be4c47-5966-4e97-9476-f8c975d1b4e8-tmp\") pod \"klusterlet-addon-workmgr-5dbb7d446d-cvw2t\" (UID: \"59be4c47-5966-4e97-9476-f8c975d1b4e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t" Jul 22 18:14:58.286464 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:58.286431 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/59be4c47-5966-4e97-9476-f8c975d1b4e8-klusterlet-config\") pod \"klusterlet-addon-workmgr-5dbb7d446d-cvw2t\" (UID: \"59be4c47-5966-4e97-9476-f8c975d1b4e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t" Jul 22 18:14:58.290282 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:58.290261 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbjk5\" (UniqueName: \"kubernetes.io/projected/59be4c47-5966-4e97-9476-f8c975d1b4e8-kube-api-access-zbjk5\") pod \"klusterlet-addon-workmgr-5dbb7d446d-cvw2t\" (UID: \"59be4c47-5966-4e97-9476-f8c975d1b4e8\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t" Jul 22 18:14:58.357328 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:58.357288 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t" Jul 22 18:14:58.515137 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:58.515106 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t"] Jul 22 18:14:58.518250 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:14:58.518223 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59be4c47_5966_4e97_9476_f8c975d1b4e8.slice/crio-a43f09572a0ea953a6e326a771ee6d329720c60342360249c788d63cc73bd68c WatchSource:0}: Error finding container a43f09572a0ea953a6e326a771ee6d329720c60342360249c788d63cc73bd68c: Status 404 returned error can't find the container with id a43f09572a0ea953a6e326a771ee6d329720c60342360249c788d63cc73bd68c Jul 22 18:14:58.779537 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:14:58.779506 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t" event={"ID":"59be4c47-5966-4e97-9476-f8c975d1b4e8","Type":"ContainerStarted","Data":"a43f09572a0ea953a6e326a771ee6d329720c60342360249c788d63cc73bd68c"} Jul 22 18:15:05.607012 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:05.606970 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:15:05.660457 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:05.660409 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:15:05.729493 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:05.729463 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qmw4c" Jul 22 18:15:05.799783 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:05.799748 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t" event={"ID":"59be4c47-5966-4e97-9476-f8c975d1b4e8","Type":"ContainerStarted","Data":"e00ee165c085611d70a773e21a13bdbb1c70fc2d95ebccff03b4a9e202275be4"} Jul 22 18:15:05.799984 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:05.799967 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t" Jul 22 18:15:05.802126 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:05.801806 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t" Jul 22 18:15:05.820986 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:05.820938 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t" podStartSLOduration=1.169678239 podStartE2EDuration="7.82092271s" totalImagesPullingTime="6.651244471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:14:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:15:05.820205686 +0000 UTC m=+61.745100704" watchObservedRunningTime="2026-07-22 18:15:05.82092271 +0000 UTC m=+61.745817734" Jul 22 18:15:05.849067 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:05.849027 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:15:05.912533 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:05.912445 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:15:10.169519 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:10.169481 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs\") pod \"network-metrics-daemon-tbzjc\" (UID: \"6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57\") " pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:15:10.171994 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:10.171974 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 22 18:15:10.180238 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:15:10.180222 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 22 18:15:10.180317 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:15:10.180273 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs podName:6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57 nodeName:}" failed. No retries permitted until 2026-07-22 18:16:14.180257603 +0000 UTC m=+130.105152599 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs") pod "network-metrics-daemon-tbzjc" (UID: "6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57") : secret "metrics-daemon-secret" not found Jul 22 18:15:10.370626 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:10.370592 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret\") pod \"global-pull-secret-syncer-5t9vd\" (UID: \"26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96\") " pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:15:10.370802 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:10.370658 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpw92\" (UniqueName: \"kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92\") pod \"network-check-target-gqbsh\" (UID: \"ec8b8800-ec53-4bc9-9984-2ebcce27c8af\") " pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:15:10.373725 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:10.373704 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 22 18:15:10.373826 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:10.373713 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 22 18:15:10.384086 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:10.384062 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96-original-pull-secret\") pod \"global-pull-secret-syncer-5t9vd\" (UID: \"26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96\") " pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:15:10.384194 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:10.384130 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 22 18:15:10.394493 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:10.394467 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpw92\" (UniqueName: \"kubernetes.io/projected/ec8b8800-ec53-4bc9-9984-2ebcce27c8af-kube-api-access-kpw92\") pod \"network-check-target-gqbsh\" (UID: \"ec8b8800-ec53-4bc9-9984-2ebcce27c8af\") " pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:15:10.457208 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:10.457122 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8sjds\"" Jul 22 18:15:10.465457 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:10.465433 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:15:10.467558 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:10.467539 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5t9vd" Jul 22 18:15:10.598103 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:10.598070 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5t9vd"] Jul 22 18:15:10.600791 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:15:10.600765 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26e1aabe_1b0e_43fe_ab3e_4dad9cb58a96.slice/crio-473dc62ca2f35240b2aac8200dc57edafee3996dde74a450736ebbddb4185a56 WatchSource:0}: Error finding container 473dc62ca2f35240b2aac8200dc57edafee3996dde74a450736ebbddb4185a56: Status 404 returned error can't find the container with id 473dc62ca2f35240b2aac8200dc57edafee3996dde74a450736ebbddb4185a56 Jul 22 18:15:10.614069 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:10.614046 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gqbsh"] Jul 22 18:15:10.618111 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:15:10.618076 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec8b8800_ec53_4bc9_9984_2ebcce27c8af.slice/crio-4e03f976fe0674cc418cd5c8b539cb6a421949aae87c3ee7ebeb6f4cc5d8a7f9 WatchSource:0}: Error finding container 4e03f976fe0674cc418cd5c8b539cb6a421949aae87c3ee7ebeb6f4cc5d8a7f9: Status 404 returned error can't find the container with id 4e03f976fe0674cc418cd5c8b539cb6a421949aae87c3ee7ebeb6f4cc5d8a7f9 Jul 22 18:15:10.812741 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:10.812706 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gqbsh" event={"ID":"ec8b8800-ec53-4bc9-9984-2ebcce27c8af","Type":"ContainerStarted","Data":"4e03f976fe0674cc418cd5c8b539cb6a421949aae87c3ee7ebeb6f4cc5d8a7f9"} Jul 22 18:15:10.813794 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:10.813771 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5t9vd" event={"ID":"26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96","Type":"ContainerStarted","Data":"473dc62ca2f35240b2aac8200dc57edafee3996dde74a450736ebbddb4185a56"} Jul 22 18:15:12.889365 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:12.888762 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls\") pod \"dns-default-dhqrm\" (UID: \"f40c4040-42e8-402a-b893-2055c35bc560\") " pod="openshift-dns/dns-default-dhqrm" Jul 22 18:15:12.889365 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:15:12.888927 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:15:12.889365 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:15:12.888987 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls podName:f40c4040-42e8-402a-b893-2055c35bc560 nodeName:}" failed. No retries permitted until 2026-07-22 18:15:44.888968003 +0000 UTC m=+100.813862999 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls") pod "dns-default-dhqrm" (UID: "f40c4040-42e8-402a-b893-2055c35bc560") : secret "dns-default-metrics-tls" not found Jul 22 18:15:15.830160 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:15.830067 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gqbsh" event={"ID":"ec8b8800-ec53-4bc9-9984-2ebcce27c8af","Type":"ContainerStarted","Data":"99cc46a12c13e60a07ce372fef3f746921d9d1d4f65ab4c7f250313d6e4835a0"} Jul 22 18:15:15.830653 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:15.830180 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:15:15.831607 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:15.831585 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5t9vd" event={"ID":"26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96","Type":"ContainerStarted","Data":"e146e7d54d4b42a53fc6dbe691ae7b295615697a6ee8c438a106cba938fc3875"} Jul 22 18:15:15.845515 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:15.845467 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gqbsh" podStartSLOduration=65.902028216 podStartE2EDuration="1m10.845452323s" totalImagesPullingTime="4.943424107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:15:15.844603036 +0000 UTC m=+71.769498054" watchObservedRunningTime="2026-07-22 18:15:15.845452323 +0000 UTC m=+71.770347343" Jul 22 18:15:15.858834 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:15.858781 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5t9vd" podStartSLOduration=65.784668081 podStartE2EDuration="1m10.858764714s" totalImagesPullingTime="5.074096633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:15:15.858001875 +0000 UTC m=+71.782896892" watchObservedRunningTime="2026-07-22 18:15:15.858764714 +0000 UTC m=+71.783659731" Jul 22 18:15:44.902010 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:44.901961 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls\") pod \"dns-default-dhqrm\" (UID: \"f40c4040-42e8-402a-b893-2055c35bc560\") " pod="openshift-dns/dns-default-dhqrm" Jul 22 18:15:44.902544 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:15:44.902081 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:15:44.902544 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:15:44.902139 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls podName:f40c4040-42e8-402a-b893-2055c35bc560 nodeName:}" failed. No retries permitted until 2026-07-22 18:16:48.902125973 +0000 UTC m=+164.827020968 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls") pod "dns-default-dhqrm" (UID: "f40c4040-42e8-402a-b893-2055c35bc560") : secret "dns-default-metrics-tls" not found Jul 22 18:15:46.836649 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:15:46.836616 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gqbsh" Jul 22 18:16:14.204259 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:16:14.204198 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs\") pod \"network-metrics-daemon-tbzjc\" (UID: \"6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57\") " pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:16:14.204778 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:16:14.204354 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 22 18:16:14.204778 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:16:14.204458 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs podName:6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:16.204440592 +0000 UTC m=+252.129335592 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs") pod "network-metrics-daemon-tbzjc" (UID: "6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57") : secret "metrics-daemon-secret" not found Jul 22 18:16:44.042360 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:16:44.042300 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dhqrm" podUID="f40c4040-42e8-402a-b893-2055c35bc560" Jul 22 18:16:44.050189 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:16:44.050165 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dhqrm" Jul 22 18:16:45.561244 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:16:45.561196 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-tbzjc" podUID="6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57" Jul 22 18:16:48.951491 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:16:48.951452 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls\") pod \"dns-default-dhqrm\" (UID: \"f40c4040-42e8-402a-b893-2055c35bc560\") " pod="openshift-dns/dns-default-dhqrm" Jul 22 18:16:48.951861 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:16:48.951600 2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 22 18:16:48.951861 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:16:48.951660 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls podName:f40c4040-42e8-402a-b893-2055c35bc560 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:50.951643248 +0000 UTC m=+286.876538244 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls") pod "dns-default-dhqrm" (UID: "f40c4040-42e8-402a-b893-2055c35bc560") : secret "dns-default-metrics-tls" not found Jul 22 18:16:58.541317 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:16:58.541235 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:17:05.801045 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:17:05.800994 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t" podUID="59be4c47-5966-4e97-9476-f8c975d1b4e8" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused" Jul 22 18:17:06.104710 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:17:06.104629 2554 generic.go:356] "Generic (PLEG): container finished" podID="59be4c47-5966-4e97-9476-f8c975d1b4e8" containerID="e00ee165c085611d70a773e21a13bdbb1c70fc2d95ebccff03b4a9e202275be4" exitCode=1 Jul 22 18:17:06.104846 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:17:06.104707 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t" event={"ID":"59be4c47-5966-4e97-9476-f8c975d1b4e8","Type":"ContainerDied","Data":"e00ee165c085611d70a773e21a13bdbb1c70fc2d95ebccff03b4a9e202275be4"} Jul 22 18:17:06.105095 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:17:06.105078 2554 scope.go:117] "RemoveContainer" containerID="e00ee165c085611d70a773e21a13bdbb1c70fc2d95ebccff03b4a9e202275be4" Jul 22 18:17:07.109458 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:17:07.109403 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t" event={"ID":"59be4c47-5966-4e97-9476-f8c975d1b4e8","Type":"ContainerStarted","Data":"d90e2da26aa320a8765376f4d7de2bc207d6037df00edbc956b3f17008509618"} Jul 22 18:17:07.109852 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:17:07.109707 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t" Jul 22 18:17:07.110301 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:17:07.110277 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dbb7d446d-cvw2t" Jul 22 18:17:28.632632 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:17:28.632589 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:02.492795 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.492761 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qxkn8"] Jul 22 18:18:02.495580 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.495562 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qxkn8" Jul 22 18:18:02.499071 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.499046 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 22 18:18:02.499071 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.499067 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 22 18:18:02.499255 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.499055 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-qpvr8\"" Jul 22 18:18:02.499255 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.499055 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 22 18:18:02.499732 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.499720 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 22 18:18:02.506402 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.506381 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qxkn8"] Jul 22 18:18:02.552658 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.552626 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qlwr\" (UniqueName: \"kubernetes.io/projected/a3e31864-a150-4faf-9f4d-28d655bd4795-kube-api-access-9qlwr\") pod \"kube-storage-version-migrator-operator-7658d9b749-qxkn8\" (UID: \"a3e31864-a150-4faf-9f4d-28d655bd4795\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qxkn8" Jul 22 18:18:02.552794 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.552665 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a3e31864-a150-4faf-9f4d-28d655bd4795-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-qxkn8\" (UID: \"a3e31864-a150-4faf-9f4d-28d655bd4795\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qxkn8" Jul 22 18:18:02.552794 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.552691 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a3e31864-a150-4faf-9f4d-28d655bd4795-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-qxkn8\" (UID: \"a3e31864-a150-4faf-9f4d-28d655bd4795\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qxkn8" Jul 22 18:18:02.588828 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.588795 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-h4j7n"] Jul 22 18:18:02.591697 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.591674 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc"] Jul 22 18:18:02.591832 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.591806 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-h4j7n" Jul 22 18:18:02.594255 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.594237 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc" Jul 22 18:18:02.595109 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.595090 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xgcf9\"" Jul 22 18:18:02.595797 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.595782 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74f54455f9-gc992"] Jul 22 18:18:02.600200 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.600181 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rlmks"] Jul 22 18:18:02.600303 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.600290 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.600803 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.600774 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 22 18:18:02.600803 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.600801 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 22 18:18:02.600968 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.600820 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 22 18:18:02.600968 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.600863 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 22 18:18:02.600968 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.600808 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4pnr4\"" Jul 22 18:18:02.603114 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.603097 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rlmks" Jul 22 18:18:02.603860 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.603843 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 22 18:18:02.604599 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.604581 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-h4j7n"] Jul 22 18:18:02.605010 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.604990 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 22 18:18:02.605672 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.605654 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pfg7p\"" Jul 22 18:18:02.605951 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.605909 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 22 18:18:02.607680 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.607658 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc"] Jul 22 18:18:02.608357 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.608335 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 22 18:18:02.608881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.608864 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-zzd2l\"" Jul 22 18:18:02.609029 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.608989 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 22 18:18:02.610946 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.610924 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 22 18:18:02.613929 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.613742 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rlmks"] Jul 22 18:18:02.614836 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.614815 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74f54455f9-gc992"] Jul 22 18:18:02.653764 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.653732 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e7d448f-575c-4335-8274-d2b9541738eb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7lkxc\" (UID: \"5e7d448f-575c-4335-8274-d2b9541738eb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc" Jul 22 18:18:02.653764 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.653765 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw88z\" (UniqueName: \"kubernetes.io/projected/5137e6e9-85ea-4f45-a815-78a1f5721719-kube-api-access-hw88z\") pod \"network-check-source-7bc5b6bf85-h4j7n\" (UID: \"5137e6e9-85ea-4f45-a815-78a1f5721719\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-h4j7n" Jul 22 18:18:02.653942 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.653825 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5drt\" (UniqueName: \"kubernetes.io/projected/5e7d448f-575c-4335-8274-d2b9541738eb-kube-api-access-z5drt\") pod \"cluster-monitoring-operator-76cf8966f8-7lkxc\" (UID: \"5e7d448f-575c-4335-8274-d2b9541738eb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc" Jul 22 18:18:02.653942 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.653862 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5e7d448f-575c-4335-8274-d2b9541738eb-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-7lkxc\" (UID: \"5e7d448f-575c-4335-8274-d2b9541738eb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc" Jul 22 18:18:02.654008 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.653938 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qlwr\" (UniqueName: \"kubernetes.io/projected/a3e31864-a150-4faf-9f4d-28d655bd4795-kube-api-access-9qlwr\") pod \"kube-storage-version-migrator-operator-7658d9b749-qxkn8\" (UID: \"a3e31864-a150-4faf-9f4d-28d655bd4795\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qxkn8" Jul 22 18:18:02.654008 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.653975 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a3e31864-a150-4faf-9f4d-28d655bd4795-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-qxkn8\" (UID: \"a3e31864-a150-4faf-9f4d-28d655bd4795\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qxkn8" Jul 22 18:18:02.654008 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.653991 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a3e31864-a150-4faf-9f4d-28d655bd4795-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-qxkn8\" (UID: \"a3e31864-a150-4faf-9f4d-28d655bd4795\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qxkn8" Jul 22 18:18:02.654488 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.654473 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a3e31864-a150-4faf-9f4d-28d655bd4795-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-qxkn8\" (UID: \"a3e31864-a150-4faf-9f4d-28d655bd4795\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qxkn8" Jul 22 18:18:02.656305 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.656284 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a3e31864-a150-4faf-9f4d-28d655bd4795-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-qxkn8\" (UID: \"a3e31864-a150-4faf-9f4d-28d655bd4795\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qxkn8" Jul 22 18:18:02.691031 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.690994 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qlwr\" (UniqueName: \"kubernetes.io/projected/a3e31864-a150-4faf-9f4d-28d655bd4795-kube-api-access-9qlwr\") pod \"kube-storage-version-migrator-operator-7658d9b749-qxkn8\" (UID: \"a3e31864-a150-4faf-9f4d-28d655bd4795\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qxkn8" Jul 22 18:18:02.754773 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.754684 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7c6a22e-b4f7-4017-897d-e479a3b258c1-image-registry-private-configuration\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.754773 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.754720 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7c6a22e-b4f7-4017-897d-e479a3b258c1-ca-trust-extracted\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.754773 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.754736 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hn89\" (UniqueName: \"kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-kube-api-access-2hn89\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.754993 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.754788 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e7d448f-575c-4335-8274-d2b9541738eb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7lkxc\" (UID: \"5e7d448f-575c-4335-8274-d2b9541738eb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc" Jul 22 18:18:02.754993 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.754820 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw88z\" (UniqueName: \"kubernetes.io/projected/5137e6e9-85ea-4f45-a815-78a1f5721719-kube-api-access-hw88z\") pod \"network-check-source-7bc5b6bf85-h4j7n\" (UID: \"5137e6e9-85ea-4f45-a815-78a1f5721719\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-h4j7n" Jul 22 18:18:02.754993 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.754852 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5drt\" (UniqueName: \"kubernetes.io/projected/5e7d448f-575c-4335-8274-d2b9541738eb-kube-api-access-z5drt\") pod \"cluster-monitoring-operator-76cf8966f8-7lkxc\" (UID: \"5e7d448f-575c-4335-8274-d2b9541738eb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc" Jul 22 18:18:02.754993 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.754869 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-tls\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.754993 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.754887 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7c6a22e-b4f7-4017-897d-e479a3b258c1-installation-pull-secrets\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.754993 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:02.754895 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 18:18:02.754993 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.754904 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h45qr\" (UniqueName: \"kubernetes.io/projected/05b5f170-0012-4e33-9518-c901407c9cde-kube-api-access-h45qr\") pod \"volume-data-source-validator-78cf4c6f6-rlmks\" (UID: \"05b5f170-0012-4e33-9518-c901407c9cde\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rlmks" Jul 22 18:18:02.754993 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:02.754963 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7d448f-575c-4335-8274-d2b9541738eb-cluster-monitoring-operator-tls podName:5e7d448f-575c-4335-8274-d2b9541738eb nodeName:}" failed. No retries permitted until 2026-07-22 18:18:03.25494323 +0000 UTC m=+239.179838227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5e7d448f-575c-4335-8274-d2b9541738eb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-7lkxc" (UID: "5e7d448f-575c-4335-8274-d2b9541738eb") : secret "cluster-monitoring-operator-tls" not found Jul 22 18:18:02.755275 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.755069 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-certificates\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.755275 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.755094 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-bound-sa-token\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.755275 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.755117 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5e7d448f-575c-4335-8274-d2b9541738eb-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-7lkxc\" (UID: \"5e7d448f-575c-4335-8274-d2b9541738eb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc" Jul 22 18:18:02.755275 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.755143 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7c6a22e-b4f7-4017-897d-e479a3b258c1-trusted-ca\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.755756 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.755738 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5e7d448f-575c-4335-8274-d2b9541738eb-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-7lkxc\" (UID: \"5e7d448f-575c-4335-8274-d2b9541738eb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc" Jul 22 18:18:02.769939 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.769911 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5drt\" (UniqueName: \"kubernetes.io/projected/5e7d448f-575c-4335-8274-d2b9541738eb-kube-api-access-z5drt\") pod \"cluster-monitoring-operator-76cf8966f8-7lkxc\" (UID: \"5e7d448f-575c-4335-8274-d2b9541738eb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc" Jul 22 18:18:02.770052 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.769980 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw88z\" (UniqueName: \"kubernetes.io/projected/5137e6e9-85ea-4f45-a815-78a1f5721719-kube-api-access-hw88z\") pod \"network-check-source-7bc5b6bf85-h4j7n\" (UID: \"5137e6e9-85ea-4f45-a815-78a1f5721719\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-h4j7n" Jul 22 18:18:02.785874 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.785850 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:02.803926 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.803908 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qxkn8" Jul 22 18:18:02.853166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.853138 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:02.856130 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.856104 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-certificates\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.856130 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.856132 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-bound-sa-token\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.856462 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.856154 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7c6a22e-b4f7-4017-897d-e479a3b258c1-trusted-ca\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.856462 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.856198 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7c6a22e-b4f7-4017-897d-e479a3b258c1-image-registry-private-configuration\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.856462 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.856216 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7c6a22e-b4f7-4017-897d-e479a3b258c1-ca-trust-extracted\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.856462 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.856231 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hn89\" (UniqueName: \"kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-kube-api-access-2hn89\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.856462 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.856264 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-tls\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.856462 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.856281 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7c6a22e-b4f7-4017-897d-e479a3b258c1-installation-pull-secrets\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.856462 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.856297 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h45qr\" (UniqueName: \"kubernetes.io/projected/05b5f170-0012-4e33-9518-c901407c9cde-kube-api-access-h45qr\") pod \"volume-data-source-validator-78cf4c6f6-rlmks\" (UID: \"05b5f170-0012-4e33-9518-c901407c9cde\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rlmks" Jul 22 18:18:02.857200 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:02.857037 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 18:18:02.857200 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:02.857057 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74f54455f9-gc992: secret "image-registry-tls" not found Jul 22 18:18:02.857200 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.857075 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7c6a22e-b4f7-4017-897d-e479a3b258c1-ca-trust-extracted\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.857200 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:02.857113 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-tls podName:a7c6a22e-b4f7-4017-897d-e479a3b258c1 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:03.357092378 +0000 UTC m=+239.281987376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-tls") pod "image-registry-74f54455f9-gc992" (UID: "a7c6a22e-b4f7-4017-897d-e479a3b258c1") : secret "image-registry-tls" not found Jul 22 18:18:02.857200 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.857167 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-certificates\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.858116 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.858085 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7c6a22e-b4f7-4017-897d-e479a3b258c1-trusted-ca\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.859602 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.859574 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7c6a22e-b4f7-4017-897d-e479a3b258c1-image-registry-private-configuration\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.859856 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.859833 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7c6a22e-b4f7-4017-897d-e479a3b258c1-installation-pull-secrets\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.868125 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.868086 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-bound-sa-token\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.868443 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.868378 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h45qr\" (UniqueName: \"kubernetes.io/projected/05b5f170-0012-4e33-9518-c901407c9cde-kube-api-access-h45qr\") pod \"volume-data-source-validator-78cf4c6f6-rlmks\" (UID: \"05b5f170-0012-4e33-9518-c901407c9cde\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rlmks" Jul 22 18:18:02.869048 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.868978 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hn89\" (UniqueName: \"kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-kube-api-access-2hn89\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:02.902829 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.902799 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-h4j7n" Jul 22 18:18:02.922583 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.922551 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rlmks" Jul 22 18:18:02.929242 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:02.929215 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qxkn8"] Jul 22 18:18:02.934957 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:18:02.933522 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3e31864_a150_4faf_9f4d_28d655bd4795.slice/crio-a9059d021ee8d03d313b1f7d0024953f3b17093cd36a8a8755dce8268c2162e7 WatchSource:0}: Error finding container a9059d021ee8d03d313b1f7d0024953f3b17093cd36a8a8755dce8268c2162e7: Status 404 returned error can't find the container with id a9059d021ee8d03d313b1f7d0024953f3b17093cd36a8a8755dce8268c2162e7 Jul 22 18:18:03.033886 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:03.033855 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-h4j7n"] Jul 22 18:18:03.037276 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:18:03.037247 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5137e6e9_85ea_4f45_a815_78a1f5721719.slice/crio-9c66cbac4ecd38b6aee36932ec541e6a05cf6f0a07fe1825daaef7cf5dc05179 WatchSource:0}: Error finding container 9c66cbac4ecd38b6aee36932ec541e6a05cf6f0a07fe1825daaef7cf5dc05179: Status 404 returned error can't find the container with id 9c66cbac4ecd38b6aee36932ec541e6a05cf6f0a07fe1825daaef7cf5dc05179 Jul 22 18:18:03.053385 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:03.053342 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rlmks"] Jul 22 18:18:03.071588 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:18:03.071547 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b5f170_0012_4e33_9518_c901407c9cde.slice/crio-92e0a949699f55297713a077e69939863156e56899f0971cb37296fc984cc0b5 WatchSource:0}: Error finding container 92e0a949699f55297713a077e69939863156e56899f0971cb37296fc984cc0b5: Status 404 returned error can't find the container with id 92e0a949699f55297713a077e69939863156e56899f0971cb37296fc984cc0b5 Jul 22 18:18:03.259854 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:03.259760 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e7d448f-575c-4335-8274-d2b9541738eb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7lkxc\" (UID: \"5e7d448f-575c-4335-8274-d2b9541738eb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc" Jul 22 18:18:03.259984 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:03.259906 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 18:18:03.259984 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:03.259974 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7d448f-575c-4335-8274-d2b9541738eb-cluster-monitoring-operator-tls podName:5e7d448f-575c-4335-8274-d2b9541738eb nodeName:}" failed. No retries permitted until 2026-07-22 18:18:04.259957788 +0000 UTC m=+240.184852784 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5e7d448f-575c-4335-8274-d2b9541738eb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-7lkxc" (UID: "5e7d448f-575c-4335-8274-d2b9541738eb") : secret "cluster-monitoring-operator-tls" not found Jul 22 18:18:03.265695 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:03.265662 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-h4j7n" event={"ID":"5137e6e9-85ea-4f45-a815-78a1f5721719","Type":"ContainerStarted","Data":"4d1c75979753d97cb0558d4ef855a4dff4ca29906191ce33ccef090178394ba0"} Jul 22 18:18:03.265830 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:03.265751 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-h4j7n" event={"ID":"5137e6e9-85ea-4f45-a815-78a1f5721719","Type":"ContainerStarted","Data":"9c66cbac4ecd38b6aee36932ec541e6a05cf6f0a07fe1825daaef7cf5dc05179"} Jul 22 18:18:03.266762 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:03.266741 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qxkn8" event={"ID":"a3e31864-a150-4faf-9f4d-28d655bd4795","Type":"ContainerStarted","Data":"a9059d021ee8d03d313b1f7d0024953f3b17093cd36a8a8755dce8268c2162e7"} Jul 22 18:18:03.267760 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:03.267742 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rlmks" event={"ID":"05b5f170-0012-4e33-9518-c901407c9cde","Type":"ContainerStarted","Data":"92e0a949699f55297713a077e69939863156e56899f0971cb37296fc984cc0b5"} Jul 22 18:18:03.283191 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:03.283119 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-h4j7n" podStartSLOduration=1.283102119 podStartE2EDuration="1.283102119s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:03.281662123 +0000 UTC m=+239.206557145" watchObservedRunningTime="2026-07-22 18:18:03.283102119 +0000 UTC m=+239.207997138" Jul 22 18:18:03.361141 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:03.361101 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-tls\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:03.361288 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:03.361254 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 18:18:03.361288 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:03.361270 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74f54455f9-gc992: secret "image-registry-tls" not found Jul 22 18:18:03.361367 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:03.361335 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-tls podName:a7c6a22e-b4f7-4017-897d-e479a3b258c1 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:04.361315573 +0000 UTC m=+240.286210587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-tls") pod "image-registry-74f54455f9-gc992" (UID: "a7c6a22e-b4f7-4017-897d-e479a3b258c1") : secret "image-registry-tls" not found Jul 22 18:18:04.269175 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:04.269141 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e7d448f-575c-4335-8274-d2b9541738eb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7lkxc\" (UID: \"5e7d448f-575c-4335-8274-d2b9541738eb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc" Jul 22 18:18:04.269658 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:04.269318 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 18:18:04.269658 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:04.269438 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7d448f-575c-4335-8274-d2b9541738eb-cluster-monitoring-operator-tls podName:5e7d448f-575c-4335-8274-d2b9541738eb nodeName:}" failed. No retries permitted until 2026-07-22 18:18:06.26939516 +0000 UTC m=+242.194290160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5e7d448f-575c-4335-8274-d2b9541738eb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-7lkxc" (UID: "5e7d448f-575c-4335-8274-d2b9541738eb") : secret "cluster-monitoring-operator-tls" not found Jul 22 18:18:04.370080 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:04.370047 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-tls\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:04.370216 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:04.370195 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 18:18:04.370216 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:04.370214 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74f54455f9-gc992: secret "image-registry-tls" not found Jul 22 18:18:04.370399 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:04.370265 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-tls podName:a7c6a22e-b4f7-4017-897d-e479a3b258c1 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:06.370247641 +0000 UTC m=+242.295142645 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-tls") pod "image-registry-74f54455f9-gc992" (UID: "a7c6a22e-b4f7-4017-897d-e479a3b258c1") : secret "image-registry-tls" not found Jul 22 18:18:05.275170 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:05.275074 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qxkn8" event={"ID":"a3e31864-a150-4faf-9f4d-28d655bd4795","Type":"ContainerStarted","Data":"2938ea53c1886236a6c9fa53f171a97dc6519d3c0157d42224e10660546315a2"} Jul 22 18:18:05.276681 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:05.276656 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rlmks" event={"ID":"05b5f170-0012-4e33-9518-c901407c9cde","Type":"ContainerStarted","Data":"df90a53025a147eb6f8f6319d7464cec869e3401ae32d3810a37dabb65d11fd9"} Jul 22 18:18:05.291576 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:05.291536 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qxkn8" podStartSLOduration=1.20797059 podStartE2EDuration="3.291522588s" totalImagesPullingTime="2.083551998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:05.290713341 +0000 UTC m=+241.215608359" watchObservedRunningTime="2026-07-22 18:18:05.291522588 +0000 UTC m=+241.216417605" Jul 22 18:18:05.305202 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:05.305164 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-rlmks" podStartSLOduration=2.012047927 podStartE2EDuration="3.305153986s" totalImagesPullingTime="1.293106059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:05.304519663 +0000 UTC m=+241.229414694" watchObservedRunningTime="2026-07-22 18:18:05.305153986 +0000 UTC m=+241.230049004" Jul 22 18:18:05.381786 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:05.381753 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:06.283801 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:06.283779 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e7d448f-575c-4335-8274-d2b9541738eb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7lkxc\" (UID: \"5e7d448f-575c-4335-8274-d2b9541738eb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc" Jul 22 18:18:06.284282 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:06.283923 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 18:18:06.284282 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:06.283995 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7d448f-575c-4335-8274-d2b9541738eb-cluster-monitoring-operator-tls podName:5e7d448f-575c-4335-8274-d2b9541738eb nodeName:}" failed. No retries permitted until 2026-07-22 18:18:10.283976892 +0000 UTC m=+246.208871902 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5e7d448f-575c-4335-8274-d2b9541738eb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-7lkxc" (UID: "5e7d448f-575c-4335-8274-d2b9541738eb") : secret "cluster-monitoring-operator-tls" not found Jul 22 18:18:06.385124 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:06.385089 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-tls\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:06.385322 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:06.385244 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 18:18:06.385322 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:06.385269 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74f54455f9-gc992: secret "image-registry-tls" not found Jul 22 18:18:06.385455 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:06.385332 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-tls podName:a7c6a22e-b4f7-4017-897d-e479a3b258c1 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:10.385310944 +0000 UTC m=+246.310205947 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-tls") pod "image-registry-74f54455f9-gc992" (UID: "a7c6a22e-b4f7-4017-897d-e479a3b258c1") : secret "image-registry-tls" not found Jul 22 18:18:06.924625 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:06.924585 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:07.022597 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.022564 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:07.252707 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.252672 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vh2pz"] Jul 22 18:18:07.255890 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.255875 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:07.258856 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.258828 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 22 18:18:07.258985 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.258928 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 22 18:18:07.258985 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.258957 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 22 18:18:07.259886 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.259868 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 22 18:18:07.260100 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.260087 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d82fz\"" Jul 22 18:18:07.265932 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.265912 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vh2pz"] Jul 22 18:18:07.306611 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.306586 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:07.382799 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.382772 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:07.391778 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.391756 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3a449c1-034d-44c6-a5e4-d01189c070ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:07.391840 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.391803 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3a449c1-034d-44c6-a5e4-d01189c070ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:07.391902 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.391888 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szb4h\" (UniqueName: \"kubernetes.io/projected/d3a449c1-034d-44c6-a5e4-d01189c070ff-kube-api-access-szb4h\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:07.391935 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.391925 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3a449c1-034d-44c6-a5e4-d01189c070ff-data-volume\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:07.391970 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.391953 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d3a449c1-034d-44c6-a5e4-d01189c070ff-crio-socket\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:07.492579 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.492546 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3a449c1-034d-44c6-a5e4-d01189c070ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:07.492714 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.492595 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3a449c1-034d-44c6-a5e4-d01189c070ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:07.492714 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.492631 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szb4h\" (UniqueName: \"kubernetes.io/projected/d3a449c1-034d-44c6-a5e4-d01189c070ff-kube-api-access-szb4h\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:07.492714 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.492663 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3a449c1-034d-44c6-a5e4-d01189c070ff-data-volume\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:07.492714 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:07.492664 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 18:18:07.492714 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.492685 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d3a449c1-034d-44c6-a5e4-d01189c070ff-crio-socket\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:07.492950 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:07.492742 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3a449c1-034d-44c6-a5e4-d01189c070ff-kube-rbac-proxy-cm podName:d3a449c1-034d-44c6-a5e4-d01189c070ff nodeName:}" failed. No retries permitted until 2026-07-22 18:18:07.992721704 +0000 UTC m=+243.917616721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d3a449c1-034d-44c6-a5e4-d01189c070ff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vh2pz" (UID: "d3a449c1-034d-44c6-a5e4-d01189c070ff") : configmap "kube-rbac-proxy" not found Jul 22 18:18:07.492950 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:07.492749 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 18:18:07.492950 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:07.492790 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3a449c1-034d-44c6-a5e4-d01189c070ff-insights-runtime-extractor-tls podName:d3a449c1-034d-44c6-a5e4-d01189c070ff nodeName:}" failed. No retries permitted until 2026-07-22 18:18:07.992777806 +0000 UTC m=+243.917672802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d3a449c1-034d-44c6-a5e4-d01189c070ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vh2pz" (UID: "d3a449c1-034d-44c6-a5e4-d01189c070ff") : secret "insights-runtime-extractor-tls" not found Jul 22 18:18:07.492950 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.492751 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d3a449c1-034d-44c6-a5e4-d01189c070ff-crio-socket\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:07.493134 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.493044 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3a449c1-034d-44c6-a5e4-d01189c070ff-data-volume\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:07.501432 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.501390 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szb4h\" (UniqueName: \"kubernetes.io/projected/d3a449c1-034d-44c6-a5e4-d01189c070ff-kube-api-access-szb4h\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:07.825258 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.825220 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:07.952489 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.952442 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:07.996605 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.996565 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3a449c1-034d-44c6-a5e4-d01189c070ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:07.996752 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:07.996669 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3a449c1-034d-44c6-a5e4-d01189c070ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:07.996752 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:07.996725 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 18:18:07.996752 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:07.996730 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 18:18:07.996864 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:07.996788 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3a449c1-034d-44c6-a5e4-d01189c070ff-insights-runtime-extractor-tls podName:d3a449c1-034d-44c6-a5e4-d01189c070ff nodeName:}" failed. No retries permitted until 2026-07-22 18:18:08.996771672 +0000 UTC m=+244.921666668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d3a449c1-034d-44c6-a5e4-d01189c070ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vh2pz" (UID: "d3a449c1-034d-44c6-a5e4-d01189c070ff") : secret "insights-runtime-extractor-tls" not found Jul 22 18:18:07.996864 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:07.996805 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3a449c1-034d-44c6-a5e4-d01189c070ff-kube-rbac-proxy-cm podName:d3a449c1-034d-44c6-a5e4-d01189c070ff nodeName:}" failed. No retries permitted until 2026-07-22 18:18:08.99679913 +0000 UTC m=+244.921694126 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d3a449c1-034d-44c6-a5e4-d01189c070ff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vh2pz" (UID: "d3a449c1-034d-44c6-a5e4-d01189c070ff") : configmap "kube-rbac-proxy" not found Jul 22 18:18:08.051931 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:08.051886 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:08.277325 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:08.277296 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:08.343160 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:08.343119 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:08.538464 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:08.538339 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:08.633302 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:08.633254 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:09.005070 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:09.005021 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3a449c1-034d-44c6-a5e4-d01189c070ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:09.005229 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:09.005085 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3a449c1-034d-44c6-a5e4-d01189c070ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:09.005229 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:09.005152 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 18:18:09.005229 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:09.005176 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 18:18:09.005344 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:09.005232 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3a449c1-034d-44c6-a5e4-d01189c070ff-insights-runtime-extractor-tls podName:d3a449c1-034d-44c6-a5e4-d01189c070ff nodeName:}" failed. No retries permitted until 2026-07-22 18:18:11.005219286 +0000 UTC m=+246.930114282 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d3a449c1-034d-44c6-a5e4-d01189c070ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vh2pz" (UID: "d3a449c1-034d-44c6-a5e4-d01189c070ff") : secret "insights-runtime-extractor-tls" not found Jul 22 18:18:09.005344 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:09.005245 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3a449c1-034d-44c6-a5e4-d01189c070ff-kube-rbac-proxy-cm podName:d3a449c1-034d-44c6-a5e4-d01189c070ff nodeName:}" failed. No retries permitted until 2026-07-22 18:18:11.0052395 +0000 UTC m=+246.930134497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d3a449c1-034d-44c6-a5e4-d01189c070ff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vh2pz" (UID: "d3a449c1-034d-44c6-a5e4-d01189c070ff") : configmap "kube-rbac-proxy" not found Jul 22 18:18:09.243438 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:09.243395 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8tx85_07da8a07-dcb9-4331-99de-82a25374214b/dns-node-resolver/0.log" Jul 22 18:18:10.114509 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.114481 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:10.159590 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.159557 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-9z9rd"] Jul 22 18:18:10.162592 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.162576 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-9z9rd" Jul 22 18:18:10.169099 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.169075 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 22 18:18:10.169207 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.169128 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 22 18:18:10.169448 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.169404 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 22 18:18:10.169551 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.169477 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-7rssc\"" Jul 22 18:18:10.169551 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.169492 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 22 18:18:10.194480 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.194456 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-9z9rd"] Jul 22 18:18:10.229118 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.229091 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:10.243993 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.243974 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d7fbm_03a472de-a374-457c-9959-409546b51390/node-ca/0.log" Jul 22 18:18:10.315142 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.315111 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b4fa952a-4ec6-49ea-a291-4529c1c9eecd-signing-key\") pod \"service-ca-58598695f7-9z9rd\" (UID: \"b4fa952a-4ec6-49ea-a291-4529c1c9eecd\") " pod="openshift-service-ca/service-ca-58598695f7-9z9rd" Jul 22 18:18:10.315303 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.315152 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e7d448f-575c-4335-8274-d2b9541738eb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7lkxc\" (UID: \"5e7d448f-575c-4335-8274-d2b9541738eb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc" Jul 22 18:18:10.315303 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:10.315252 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 18:18:10.315303 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.315271 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7sz6\" (UniqueName: \"kubernetes.io/projected/b4fa952a-4ec6-49ea-a291-4529c1c9eecd-kube-api-access-l7sz6\") pod \"service-ca-58598695f7-9z9rd\" (UID: \"b4fa952a-4ec6-49ea-a291-4529c1c9eecd\") " pod="openshift-service-ca/service-ca-58598695f7-9z9rd" Jul 22 18:18:10.315303 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:10.315295 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7d448f-575c-4335-8274-d2b9541738eb-cluster-monitoring-operator-tls podName:5e7d448f-575c-4335-8274-d2b9541738eb nodeName:}" failed. No retries permitted until 2026-07-22 18:18:18.315281614 +0000 UTC m=+254.240176610 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5e7d448f-575c-4335-8274-d2b9541738eb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-7lkxc" (UID: "5e7d448f-575c-4335-8274-d2b9541738eb") : secret "cluster-monitoring-operator-tls" not found Jul 22 18:18:10.315517 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.315374 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b4fa952a-4ec6-49ea-a291-4529c1c9eecd-signing-cabundle\") pod \"service-ca-58598695f7-9z9rd\" (UID: \"b4fa952a-4ec6-49ea-a291-4529c1c9eecd\") " pod="openshift-service-ca/service-ca-58598695f7-9z9rd" Jul 22 18:18:10.415969 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.415877 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b4fa952a-4ec6-49ea-a291-4529c1c9eecd-signing-key\") pod \"service-ca-58598695f7-9z9rd\" (UID: \"b4fa952a-4ec6-49ea-a291-4529c1c9eecd\") " pod="openshift-service-ca/service-ca-58598695f7-9z9rd" Jul 22 18:18:10.415969 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.415969 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-tls\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:10.416195 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.416005 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7sz6\" (UniqueName: \"kubernetes.io/projected/b4fa952a-4ec6-49ea-a291-4529c1c9eecd-kube-api-access-l7sz6\") pod \"service-ca-58598695f7-9z9rd\" (UID: \"b4fa952a-4ec6-49ea-a291-4529c1c9eecd\") " pod="openshift-service-ca/service-ca-58598695f7-9z9rd" Jul 22 18:18:10.416195 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.416028 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b4fa952a-4ec6-49ea-a291-4529c1c9eecd-signing-cabundle\") pod \"service-ca-58598695f7-9z9rd\" (UID: \"b4fa952a-4ec6-49ea-a291-4529c1c9eecd\") " pod="openshift-service-ca/service-ca-58598695f7-9z9rd" Jul 22 18:18:10.416195 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:10.416109 2554 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 22 18:18:10.416195 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:10.416127 2554 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74f54455f9-gc992: secret "image-registry-tls" not found Jul 22 18:18:10.416195 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:10.416185 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-tls podName:a7c6a22e-b4f7-4017-897d-e479a3b258c1 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:18.41616764 +0000 UTC m=+254.341062636 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-tls") pod "image-registry-74f54455f9-gc992" (UID: "a7c6a22e-b4f7-4017-897d-e479a3b258c1") : secret "image-registry-tls" not found Jul 22 18:18:10.416764 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.416745 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b4fa952a-4ec6-49ea-a291-4529c1c9eecd-signing-cabundle\") pod \"service-ca-58598695f7-9z9rd\" (UID: \"b4fa952a-4ec6-49ea-a291-4529c1c9eecd\") " pod="openshift-service-ca/service-ca-58598695f7-9z9rd" Jul 22 18:18:10.418617 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.418593 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b4fa952a-4ec6-49ea-a291-4529c1c9eecd-signing-key\") pod \"service-ca-58598695f7-9z9rd\" (UID: \"b4fa952a-4ec6-49ea-a291-4529c1c9eecd\") " pod="openshift-service-ca/service-ca-58598695f7-9z9rd" Jul 22 18:18:10.426250 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.426232 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7sz6\" (UniqueName: \"kubernetes.io/projected/b4fa952a-4ec6-49ea-a291-4529c1c9eecd-kube-api-access-l7sz6\") pod \"service-ca-58598695f7-9z9rd\" (UID: \"b4fa952a-4ec6-49ea-a291-4529c1c9eecd\") " pod="openshift-service-ca/service-ca-58598695f7-9z9rd" Jul 22 18:18:10.471277 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.471241 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-9z9rd" Jul 22 18:18:10.603068 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:10.603036 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-9z9rd"] Jul 22 18:18:10.606898 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:18:10.606874 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4fa952a_4ec6_49ea_a291_4529c1c9eecd.slice/crio-65ab1e699fadc541a5eceb12117aefea2603fbf3bf4e905fcfec7ed652ec0024 WatchSource:0}: Error finding container 65ab1e699fadc541a5eceb12117aefea2603fbf3bf4e905fcfec7ed652ec0024: Status 404 returned error can't find the container with id 65ab1e699fadc541a5eceb12117aefea2603fbf3bf4e905fcfec7ed652ec0024 Jul 22 18:18:11.020863 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:11.020825 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3a449c1-034d-44c6-a5e4-d01189c070ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:11.021075 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:11.020877 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3a449c1-034d-44c6-a5e4-d01189c070ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:11.021075 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:11.020973 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 18:18:11.021075 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:11.020998 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 18:18:11.021075 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:11.021046 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3a449c1-034d-44c6-a5e4-d01189c070ff-insights-runtime-extractor-tls podName:d3a449c1-034d-44c6-a5e4-d01189c070ff nodeName:}" failed. No retries permitted until 2026-07-22 18:18:15.021030904 +0000 UTC m=+250.945925900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d3a449c1-034d-44c6-a5e4-d01189c070ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vh2pz" (UID: "d3a449c1-034d-44c6-a5e4-d01189c070ff") : secret "insights-runtime-extractor-tls" not found Jul 22 18:18:11.021075 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:11.021058 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3a449c1-034d-44c6-a5e4-d01189c070ff-kube-rbac-proxy-cm podName:d3a449c1-034d-44c6-a5e4-d01189c070ff nodeName:}" failed. No retries permitted until 2026-07-22 18:18:15.021052087 +0000 UTC m=+250.945947082 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d3a449c1-034d-44c6-a5e4-d01189c070ff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vh2pz" (UID: "d3a449c1-034d-44c6-a5e4-d01189c070ff") : configmap "kube-rbac-proxy" not found Jul 22 18:18:11.044242 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:11.044211 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rfdk4_6998e97e-e9c2-4a74-b215-7261baa166cf/serve-healthcheck-canary/0.log" Jul 22 18:18:11.293926 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:11.293842 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-9z9rd" event={"ID":"b4fa952a-4ec6-49ea-a291-4529c1c9eecd","Type":"ContainerStarted","Data":"65ab1e699fadc541a5eceb12117aefea2603fbf3bf4e905fcfec7ed652ec0024"} Jul 22 18:18:11.299322 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:11.299286 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:13.269912 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:13.269875 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:13.302507 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:13.302477 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-9z9rd" event={"ID":"b4fa952a-4ec6-49ea-a291-4529c1c9eecd","Type":"ContainerStarted","Data":"513842ad5b058ddf037bb4ce50e489b0e654a4347af71381ff5a20e35ff3d36e"} Jul 22 18:18:13.323082 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:13.323026 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-9z9rd" podStartSLOduration=1.489816969 podStartE2EDuration="3.323005959s" totalImagesPullingTime="1.83318899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:13.321661029 +0000 UTC m=+249.246556049" watchObservedRunningTime="2026-07-22 18:18:13.323005959 +0000 UTC m=+249.247900979" Jul 22 18:18:13.434603 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:13.434562 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:13.537488 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:13.537383 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:13.668740 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:13.668699 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:13.852294 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:13.852205 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:13.986884 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:13.986844 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:14.241784 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:14.241758 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:14.997470 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:14.997431 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:15.054691 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:15.054651 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3a449c1-034d-44c6-a5e4-d01189c070ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:15.054858 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:15.054706 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3a449c1-034d-44c6-a5e4-d01189c070ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:15.054858 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:15.054772 2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 22 18:18:15.054858 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:15.054839 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 18:18:15.054858 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:15.054851 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d3a449c1-034d-44c6-a5e4-d01189c070ff-kube-rbac-proxy-cm podName:d3a449c1-034d-44c6-a5e4-d01189c070ff nodeName:}" failed. No retries permitted until 2026-07-22 18:18:23.054834063 +0000 UTC m=+258.979729061 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d3a449c1-034d-44c6-a5e4-d01189c070ff-kube-rbac-proxy-cm") pod "insights-runtime-extractor-vh2pz" (UID: "d3a449c1-034d-44c6-a5e4-d01189c070ff") : configmap "kube-rbac-proxy" not found Jul 22 18:18:15.054993 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:15.054878 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3a449c1-034d-44c6-a5e4-d01189c070ff-insights-runtime-extractor-tls podName:d3a449c1-034d-44c6-a5e4-d01189c070ff nodeName:}" failed. No retries permitted until 2026-07-22 18:18:23.054866617 +0000 UTC m=+258.979761612 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d3a449c1-034d-44c6-a5e4-d01189c070ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vh2pz" (UID: "d3a449c1-034d-44c6-a5e4-d01189c070ff") : secret "insights-runtime-extractor-tls" not found Jul 22 18:18:15.374048 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:15.373964 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:15.608694 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:15.608649 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:15.775475 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:15.775446 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:16.190163 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:16.190053 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:16.265328 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:16.265294 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs\") pod \"network-metrics-daemon-tbzjc\" (UID: \"6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57\") " pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:18:16.265522 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:16.265493 2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 22 18:18:16.265585 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:16.265572 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs podName:6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57 nodeName:}" failed. No retries permitted until 2026-07-22 18:20:18.265552238 +0000 UTC m=+374.190447236 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs") pod "network-metrics-daemon-tbzjc" (UID: "6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57") : secret "metrics-daemon-secret" not found Jul 22 18:18:16.990223 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:16.990183 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:17.089932 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:17.089901 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:17.192593 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:17.192567 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:17.264745 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:17.264674 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:17.605196 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:17.605111 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:17.778176 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:17.778146 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:18.381946 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:18.381912 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e7d448f-575c-4335-8274-d2b9541738eb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7lkxc\" (UID: \"5e7d448f-575c-4335-8274-d2b9541738eb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc" Jul 22 18:18:18.382311 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:18.382054 2554 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 22 18:18:18.382311 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:18.382116 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e7d448f-575c-4335-8274-d2b9541738eb-cluster-monitoring-operator-tls podName:5e7d448f-575c-4335-8274-d2b9541738eb nodeName:}" failed. No retries permitted until 2026-07-22 18:18:34.382100348 +0000 UTC m=+270.306995343 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5e7d448f-575c-4335-8274-d2b9541738eb-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-7lkxc" (UID: "5e7d448f-575c-4335-8274-d2b9541738eb") : secret "cluster-monitoring-operator-tls" not found Jul 22 18:18:18.483158 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:18.483107 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-tls\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:18.485607 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:18.485579 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-tls\") pod \"image-registry-74f54455f9-gc992\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:18.524281 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:18.524257 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pfg7p\"" Jul 22 18:18:18.532409 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:18.532391 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:18.658470 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:18.658378 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74f54455f9-gc992"] Jul 22 18:18:18.666579 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:18:18.662589 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7c6a22e_b4f7_4017_897d_e479a3b258c1.slice/crio-f2b7df6eb9324069a2f6adbb38deb93514a4f383a940a30a72a101def4018c04 WatchSource:0}: Error finding container f2b7df6eb9324069a2f6adbb38deb93514a4f383a940a30a72a101def4018c04: Status 404 returned error can't find the container with id f2b7df6eb9324069a2f6adbb38deb93514a4f383a940a30a72a101def4018c04 Jul 22 18:18:19.322798 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:19.322760 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74f54455f9-gc992" event={"ID":"a7c6a22e-b4f7-4017-897d-e479a3b258c1","Type":"ContainerStarted","Data":"51e233c295f56550343c1bf6961cb3d2ea4891cef0108f0ae99b0d72834ed33b"} Jul 22 18:18:19.322968 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:19.322835 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74f54455f9-gc992" event={"ID":"a7c6a22e-b4f7-4017-897d-e479a3b258c1","Type":"ContainerStarted","Data":"f2b7df6eb9324069a2f6adbb38deb93514a4f383a940a30a72a101def4018c04"} Jul 22 18:18:19.322968 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:19.322905 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:19.343991 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:19.343939 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74f54455f9-gc992" podStartSLOduration=17.343921243 podStartE2EDuration="17.343921243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:19.342837235 +0000 UTC m=+255.267732254" watchObservedRunningTime="2026-07-22 18:18:19.343921243 +0000 UTC m=+255.268816261" Jul 22 18:18:19.535600 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:19.535567 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:19.590267 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:19.590188 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:19.754552 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:19.754523 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:20.103990 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:20.103963 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:20.360100 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:20.360001 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:20.751850 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:20.751819 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:20.952813 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:20.952780 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:21.355968 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:21.355935 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:21.760279 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:21.760246 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:22.559111 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:22.559081 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:22.753248 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:22.753219 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:22.873179 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:22.873104 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:23.122740 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:23.122707 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3a449c1-034d-44c6-a5e4-d01189c070ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:23.122887 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:23.122750 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3a449c1-034d-44c6-a5e4-d01189c070ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:23.122887 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:23.122858 2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 22 18:18:23.122966 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:23.122910 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3a449c1-034d-44c6-a5e4-d01189c070ff-insights-runtime-extractor-tls podName:d3a449c1-034d-44c6-a5e4-d01189c070ff nodeName:}" failed. No retries permitted until 2026-07-22 18:18:39.122896081 +0000 UTC m=+275.047791077 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d3a449c1-034d-44c6-a5e4-d01189c070ff-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vh2pz" (UID: "d3a449c1-034d-44c6-a5e4-d01189c070ff") : secret "insights-runtime-extractor-tls" not found Jul 22 18:18:23.123375 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:23.123333 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d3a449c1-034d-44c6-a5e4-d01189c070ff-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:23.165720 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:23.165687 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:23.365909 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:23.365869 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:23.754933 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:23.754899 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:23.897656 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:23.897625 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:23.997958 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:23.997927 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:27.056020 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:27.055945 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:28.256642 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:28.256611 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:28.358604 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:28.358566 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:28.417285 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:28.417254 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:28.511531 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:28.511447 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:28.623246 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:28.623214 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:34.410946 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:34.410916 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e7d448f-575c-4335-8274-d2b9541738eb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7lkxc\" (UID: \"5e7d448f-575c-4335-8274-d2b9541738eb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc" Jul 22 18:18:34.413323 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:34.413301 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5e7d448f-575c-4335-8274-d2b9541738eb-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-7lkxc\" (UID: \"5e7d448f-575c-4335-8274-d2b9541738eb\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc" Jul 22 18:18:34.711867 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:34.711786 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-4pnr4\"" Jul 22 18:18:34.719852 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:34.719823 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc" Jul 22 18:18:34.867798 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:34.867767 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc"] Jul 22 18:18:34.870795 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:18:34.870764 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e7d448f_575c_4335_8274_d2b9541738eb.slice/crio-d9a079cdba1947cac1b5eaee422c40daa8f491f36d69d5cceefe15e8771b0a31 WatchSource:0}: Error finding container d9a079cdba1947cac1b5eaee422c40daa8f491f36d69d5cceefe15e8771b0a31: Status 404 returned error can't find the container with id d9a079cdba1947cac1b5eaee422c40daa8f491f36d69d5cceefe15e8771b0a31 Jul 22 18:18:34.988822 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:34.988749 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-xmrzf"] Jul 22 18:18:34.994621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:34.994600 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-xmrzf" Jul 22 18:18:34.996373 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:34.996353 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74f54455f9-gc992"] Jul 22 18:18:34.997503 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:34.997482 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-w4nm5\"" Jul 22 18:18:34.997702 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:34.997682 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 22 18:18:34.997992 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:34.997974 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 22 18:18:35.001730 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.001704 2554 patch_prober.go:28] interesting pod/image-registry-74f54455f9-gc992 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 22 18:18:35.001822 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.001745 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-74f54455f9-gc992" podUID="a7c6a22e-b4f7-4017-897d-e479a3b258c1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 18:18:35.004794 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.004772 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-xmrzf"] Jul 22 18:18:35.014818 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.014795 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sttmh\" (UniqueName: \"kubernetes.io/projected/8060d058-e84a-43be-9cdc-f288cb37966d-kube-api-access-sttmh\") pod \"downloads-5bc67dcd46-xmrzf\" (UID: \"8060d058-e84a-43be-9cdc-f288cb37966d\") " pod="openshift-console/downloads-5bc67dcd46-xmrzf" Jul 22 18:18:35.091613 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.091572 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-867fdb9447-wwxjj"] Jul 22 18:18:35.095677 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.095653 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.115948 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.115916 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65e99ee8-3638-4997-92f8-41dac9890459-registry-tls\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.116084 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.115954 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65e99ee8-3638-4997-92f8-41dac9890459-ca-trust-extracted\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.116084 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.115990 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65e99ee8-3638-4997-92f8-41dac9890459-image-registry-private-configuration\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.116084 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.116024 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65e99ee8-3638-4997-92f8-41dac9890459-registry-certificates\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.116084 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.116047 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65e99ee8-3638-4997-92f8-41dac9890459-trusted-ca\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.116084 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.116079 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sttmh\" (UniqueName: \"kubernetes.io/projected/8060d058-e84a-43be-9cdc-f288cb37966d-kube-api-access-sttmh\") pod \"downloads-5bc67dcd46-xmrzf\" (UID: \"8060d058-e84a-43be-9cdc-f288cb37966d\") " pod="openshift-console/downloads-5bc67dcd46-xmrzf" Jul 22 18:18:35.116324 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.116104 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np7q6\" (UniqueName: \"kubernetes.io/projected/65e99ee8-3638-4997-92f8-41dac9890459-kube-api-access-np7q6\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.116324 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.116136 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65e99ee8-3638-4997-92f8-41dac9890459-bound-sa-token\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.116324 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.116165 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65e99ee8-3638-4997-92f8-41dac9890459-installation-pull-secrets\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.117081 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.117056 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-867fdb9447-wwxjj"] Jul 22 18:18:35.128948 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.128911 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:35.132670 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.132647 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sttmh\" (UniqueName: \"kubernetes.io/projected/8060d058-e84a-43be-9cdc-f288cb37966d-kube-api-access-sttmh\") pod \"downloads-5bc67dcd46-xmrzf\" (UID: \"8060d058-e84a-43be-9cdc-f288cb37966d\") " pod="openshift-console/downloads-5bc67dcd46-xmrzf" Jul 22 18:18:35.217347 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.217314 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65e99ee8-3638-4997-92f8-41dac9890459-image-registry-private-configuration\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.217567 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.217356 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65e99ee8-3638-4997-92f8-41dac9890459-registry-certificates\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.217567 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.217374 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65e99ee8-3638-4997-92f8-41dac9890459-trusted-ca\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.217567 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.217411 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np7q6\" (UniqueName: \"kubernetes.io/projected/65e99ee8-3638-4997-92f8-41dac9890459-kube-api-access-np7q6\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.217567 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.217471 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65e99ee8-3638-4997-92f8-41dac9890459-bound-sa-token\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.217567 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.217510 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65e99ee8-3638-4997-92f8-41dac9890459-installation-pull-secrets\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.217857 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.217589 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65e99ee8-3638-4997-92f8-41dac9890459-registry-tls\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.217857 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.217727 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65e99ee8-3638-4997-92f8-41dac9890459-ca-trust-extracted\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.218175 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.218123 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65e99ee8-3638-4997-92f8-41dac9890459-ca-trust-extracted\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.218306 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.218277 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65e99ee8-3638-4997-92f8-41dac9890459-registry-certificates\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.218654 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.218633 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65e99ee8-3638-4997-92f8-41dac9890459-trusted-ca\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.220057 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.220029 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65e99ee8-3638-4997-92f8-41dac9890459-installation-pull-secrets\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.220140 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.220093 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65e99ee8-3638-4997-92f8-41dac9890459-image-registry-private-configuration\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.220193 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.220178 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65e99ee8-3638-4997-92f8-41dac9890459-registry-tls\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.225573 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.225550 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:35.227222 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.227201 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-np7q6\" (UniqueName: \"kubernetes.io/projected/65e99ee8-3638-4997-92f8-41dac9890459-kube-api-access-np7q6\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.227445 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.227406 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65e99ee8-3638-4997-92f8-41dac9890459-bound-sa-token\") pod \"image-registry-867fdb9447-wwxjj\" (UID: \"65e99ee8-3638-4997-92f8-41dac9890459\") " pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.307679 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.307648 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-xmrzf" Jul 22 18:18:35.373666 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.373625 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc" event={"ID":"5e7d448f-575c-4335-8274-d2b9541738eb","Type":"ContainerStarted","Data":"d9a079cdba1947cac1b5eaee422c40daa8f491f36d69d5cceefe15e8771b0a31"} Jul 22 18:18:35.404166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.404136 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:35.438971 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.438944 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-xmrzf"] Jul 22 18:18:35.442639 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:18:35.442614 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8060d058_e84a_43be_9cdc_f288cb37966d.slice/crio-807a206ee41efd6fbf22972d3ab06131f4ca5d7f92a4b23227476f4f5d4cdcb3 WatchSource:0}: Error finding container 807a206ee41efd6fbf22972d3ab06131f4ca5d7f92a4b23227476f4f5d4cdcb3: Status 404 returned error can't find the container with id 807a206ee41efd6fbf22972d3ab06131f4ca5d7f92a4b23227476f4f5d4cdcb3 Jul 22 18:18:35.550968 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.550947 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-867fdb9447-wwxjj"] Jul 22 18:18:35.553210 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:18:35.553185 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e99ee8_3638_4997_92f8_41dac9890459.slice/crio-70c46d9bf23a9bd18a7ff54011ac95bb6ad0a1cb76bfdeb95da837382302f8d9 WatchSource:0}: Error finding container 70c46d9bf23a9bd18a7ff54011ac95bb6ad0a1cb76bfdeb95da837382302f8d9: Status 404 returned error can't find the container with id 70c46d9bf23a9bd18a7ff54011ac95bb6ad0a1cb76bfdeb95da837382302f8d9 Jul 22 18:18:35.910983 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.910896 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:35.963327 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:35.963280 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:36.380163 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:36.379851 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-xmrzf" event={"ID":"8060d058-e84a-43be-9cdc-f288cb37966d","Type":"ContainerStarted","Data":"807a206ee41efd6fbf22972d3ab06131f4ca5d7f92a4b23227476f4f5d4cdcb3"} Jul 22 18:18:36.382196 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:36.382162 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" event={"ID":"65e99ee8-3638-4997-92f8-41dac9890459","Type":"ContainerStarted","Data":"4ed1dac41e96ec2e5e35e12c4835be059be97a239bf4516883a509e92d716204"} Jul 22 18:18:36.382350 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:36.382218 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" event={"ID":"65e99ee8-3638-4997-92f8-41dac9890459","Type":"ContainerStarted","Data":"70c46d9bf23a9bd18a7ff54011ac95bb6ad0a1cb76bfdeb95da837382302f8d9"} Jul 22 18:18:36.382460 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:36.382432 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:36.405214 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:36.405155 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" podStartSLOduration=1.405137346 podStartE2EDuration="1.405137346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:36.402689032 +0000 UTC m=+272.327584064" watchObservedRunningTime="2026-07-22 18:18:36.405137346 +0000 UTC m=+272.330032344" Jul 22 18:18:37.263719 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:37.263690 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:37.368697 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:37.368638 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:37.389821 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:37.389772 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc" event={"ID":"5e7d448f-575c-4335-8274-d2b9541738eb","Type":"ContainerStarted","Data":"b3d7b80e4b29e12e626c7befced295c2eaa82fee51745749cc82a575b5abba4e"} Jul 22 18:18:37.409783 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:37.409715 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-7lkxc" podStartSLOduration=33.380344916 podStartE2EDuration="35.409683981s" totalImagesPullingTime="2.029339065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:37.408154605 +0000 UTC m=+273.333049626" watchObservedRunningTime="2026-07-22 18:18:37.409683981 +0000 UTC m=+273.334579002" Jul 22 18:18:37.473953 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:37.473904 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:37.854344 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:37.854287 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:38.118840 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:38.118752 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:39.152368 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:39.152325 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3a449c1-034d-44c6-a5e4-d01189c070ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:39.155017 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:39.154986 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d3a449c1-034d-44c6-a5e4-d01189c070ff-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vh2pz\" (UID: \"d3a449c1-034d-44c6-a5e4-d01189c070ff\") " pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:39.364577 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:39.364540 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vh2pz" Jul 22 18:18:39.514080 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:39.514048 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vh2pz"] Jul 22 18:18:39.517433 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:18:39.517380 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3a449c1_034d_44c6_a5e4_d01189c070ff.slice/crio-bd1b8fc3cd4e2eb877e6dd89aba7ea88ea55f85eb5d0dc2530338e8e6b6a5db5 WatchSource:0}: Error finding container bd1b8fc3cd4e2eb877e6dd89aba7ea88ea55f85eb5d0dc2530338e8e6b6a5db5: Status 404 returned error can't find the container with id bd1b8fc3cd4e2eb877e6dd89aba7ea88ea55f85eb5d0dc2530338e8e6b6a5db5 Jul 22 18:18:40.403916 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:40.403874 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vh2pz" event={"ID":"d3a449c1-034d-44c6-a5e4-d01189c070ff","Type":"ContainerStarted","Data":"bd1b8fc3cd4e2eb877e6dd89aba7ea88ea55f85eb5d0dc2530338e8e6b6a5db5"} Jul 22 18:18:40.455279 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:40.455237 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:40.525797 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:40.525679 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:40.896884 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:40.896829 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:42.123173 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:42.123088 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:43.749009 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:43.748975 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:43.810257 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:43.810193 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:44.725834 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:44.725787 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:45.002159 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:45.002040 2554 patch_prober.go:28] interesting pod/image-registry-74f54455f9-gc992 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 22 18:18:45.002159 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:45.002105 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-74f54455f9-gc992" podUID="a7c6a22e-b4f7-4017-897d-e479a3b258c1" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 18:18:45.427016 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:45.426980 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vh2pz" event={"ID":"d3a449c1-034d-44c6-a5e4-d01189c070ff","Type":"ContainerStarted","Data":"edfa4dc5b9958e5a1dd5b6b771b9c73d66171760625eb601d721b493cb5aeb8d"} Jul 22 18:18:46.011545 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:46.011507 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:46.691768 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:46.691721 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:46.792740 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:46.792698 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:46.894974 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:46.894921 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:47.051391 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:47.051345 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dhqrm" podUID="f40c4040-42e8-402a-b893-2055c35bc560" Jul 22 18:18:47.433906 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:47.433822 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dhqrm" Jul 22 18:18:47.531112 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:47.531075 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:47.607861 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:47.607828 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:49.578228 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.578191 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:49.796609 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.796546 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:49.846180 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.844663 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-cdtcf"] Jul 22 18:18:49.849711 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.849647 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" Jul 22 18:18:49.853174 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.853123 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 22 18:18:49.854476 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.854158 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 22 18:18:49.854476 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.854185 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 22 18:18:49.854476 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.854205 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 22 18:18:49.854476 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.854211 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-k28vc\"" Jul 22 18:18:49.863128 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.862167 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-cdtcf"] Jul 22 18:18:49.866599 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.865301 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ggj9z"] Jul 22 18:18:49.868809 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.868792 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:49.877260 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.876987 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 22 18:18:49.877260 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.877075 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 22 18:18:49.877260 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.877228 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-j2mzc\"" Jul 22 18:18:49.877542 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.877439 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 22 18:18:49.950095 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.950059 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf1e9f8e-d430-4187-958b-cd7137154d7b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:49.950274 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.950106 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e526eb5-3430-4be1-94bd-5971d7a3212e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-cdtcf\" (UID: \"7e526eb5-3430-4be1-94bd-5971d7a3212e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" Jul 22 18:18:49.950274 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.950126 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skrfz\" (UniqueName: \"kubernetes.io/projected/7e526eb5-3430-4be1-94bd-5971d7a3212e-kube-api-access-skrfz\") pod \"kube-state-metrics-56c5594674-cdtcf\" (UID: \"7e526eb5-3430-4be1-94bd-5971d7a3212e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" Jul 22 18:18:49.950274 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.950149 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bf1e9f8e-d430-4187-958b-cd7137154d7b-node-exporter-accelerators-collector-config\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:49.950274 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.950169 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bf1e9f8e-d430-4187-958b-cd7137154d7b-root\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:49.950274 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.950185 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bf1e9f8e-d430-4187-958b-cd7137154d7b-node-exporter-tls\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:49.950274 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.950205 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bf1e9f8e-d430-4187-958b-cd7137154d7b-node-exporter-textfile\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:49.950274 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.950243 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh5kn\" (UniqueName: \"kubernetes.io/projected/bf1e9f8e-d430-4187-958b-cd7137154d7b-kube-api-access-dh5kn\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:49.950274 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.950266 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bf1e9f8e-d430-4187-958b-cd7137154d7b-node-exporter-wtmp\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:49.950694 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.950301 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7e526eb5-3430-4be1-94bd-5971d7a3212e-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-cdtcf\" (UID: \"7e526eb5-3430-4be1-94bd-5971d7a3212e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" Jul 22 18:18:49.950694 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.950453 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e526eb5-3430-4be1-94bd-5971d7a3212e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-cdtcf\" (UID: \"7e526eb5-3430-4be1-94bd-5971d7a3212e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" Jul 22 18:18:49.950694 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.950492 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf1e9f8e-d430-4187-958b-cd7137154d7b-sys\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:49.950694 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.950536 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7e526eb5-3430-4be1-94bd-5971d7a3212e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-cdtcf\" (UID: \"7e526eb5-3430-4be1-94bd-5971d7a3212e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" Jul 22 18:18:49.950694 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.950588 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf1e9f8e-d430-4187-958b-cd7137154d7b-metrics-client-ca\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:49.950694 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:49.950612 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e526eb5-3430-4be1-94bd-5971d7a3212e-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-cdtcf\" (UID: \"7e526eb5-3430-4be1-94bd-5971d7a3212e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" Jul 22 18:18:50.052252 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.051693 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf1e9f8e-d430-4187-958b-cd7137154d7b-metrics-client-ca\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:50.052252 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.051737 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e526eb5-3430-4be1-94bd-5971d7a3212e-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-cdtcf\" (UID: \"7e526eb5-3430-4be1-94bd-5971d7a3212e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" Jul 22 18:18:50.052252 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.051780 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf1e9f8e-d430-4187-958b-cd7137154d7b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:50.052252 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.051806 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e526eb5-3430-4be1-94bd-5971d7a3212e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-cdtcf\" (UID: \"7e526eb5-3430-4be1-94bd-5971d7a3212e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" Jul 22 18:18:50.052718 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.052634 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf1e9f8e-d430-4187-958b-cd7137154d7b-metrics-client-ca\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:50.052718 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.052706 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skrfz\" (UniqueName: \"kubernetes.io/projected/7e526eb5-3430-4be1-94bd-5971d7a3212e-kube-api-access-skrfz\") pod \"kube-state-metrics-56c5594674-cdtcf\" (UID: \"7e526eb5-3430-4be1-94bd-5971d7a3212e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" Jul 22 18:18:50.052835 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.052755 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bf1e9f8e-d430-4187-958b-cd7137154d7b-node-exporter-accelerators-collector-config\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:50.052835 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.052790 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bf1e9f8e-d430-4187-958b-cd7137154d7b-root\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:50.052944 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.052831 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bf1e9f8e-d430-4187-958b-cd7137154d7b-node-exporter-tls\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:50.052944 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.052869 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bf1e9f8e-d430-4187-958b-cd7137154d7b-node-exporter-textfile\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:50.052944 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.052914 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh5kn\" (UniqueName: \"kubernetes.io/projected/bf1e9f8e-d430-4187-958b-cd7137154d7b-kube-api-access-dh5kn\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:50.052944 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.052940 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bf1e9f8e-d430-4187-958b-cd7137154d7b-node-exporter-wtmp\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:50.053131 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.052963 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7e526eb5-3430-4be1-94bd-5971d7a3212e-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-cdtcf\" (UID: \"7e526eb5-3430-4be1-94bd-5971d7a3212e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" Jul 22 18:18:50.053131 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.053033 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e526eb5-3430-4be1-94bd-5971d7a3212e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-cdtcf\" (UID: \"7e526eb5-3430-4be1-94bd-5971d7a3212e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" Jul 22 18:18:50.053131 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.053054 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e526eb5-3430-4be1-94bd-5971d7a3212e-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-cdtcf\" (UID: \"7e526eb5-3430-4be1-94bd-5971d7a3212e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" Jul 22 18:18:50.053131 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.053099 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf1e9f8e-d430-4187-958b-cd7137154d7b-sys\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:50.053308 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:50.053165 2554 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 22 18:18:50.053308 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.053166 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7e526eb5-3430-4be1-94bd-5971d7a3212e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-cdtcf\" (UID: \"7e526eb5-3430-4be1-94bd-5971d7a3212e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" Jul 22 18:18:50.053308 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:50.053249 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e526eb5-3430-4be1-94bd-5971d7a3212e-kube-state-metrics-tls podName:7e526eb5-3430-4be1-94bd-5971d7a3212e nodeName:}" failed. No retries permitted until 2026-07-22 18:18:50.553230724 +0000 UTC m=+286.478125728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7e526eb5-3430-4be1-94bd-5971d7a3212e-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-cdtcf" (UID: "7e526eb5-3430-4be1-94bd-5971d7a3212e") : secret "kube-state-metrics-tls" not found Jul 22 18:18:50.078615 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.053787 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7e526eb5-3430-4be1-94bd-5971d7a3212e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-cdtcf\" (UID: \"7e526eb5-3430-4be1-94bd-5971d7a3212e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" Jul 22 18:18:50.078615 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.053848 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf1e9f8e-d430-4187-958b-cd7137154d7b-sys\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:50.078615 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:50.054262 2554 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 22 18:18:50.078615 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:50.054325 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf1e9f8e-d430-4187-958b-cd7137154d7b-node-exporter-tls podName:bf1e9f8e-d430-4187-958b-cd7137154d7b nodeName:}" failed. No retries permitted until 2026-07-22 18:18:50.554308197 +0000 UTC m=+286.479203193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bf1e9f8e-d430-4187-958b-cd7137154d7b-node-exporter-tls") pod "node-exporter-ggj9z" (UID: "bf1e9f8e-d430-4187-958b-cd7137154d7b") : secret "node-exporter-tls" not found Jul 22 18:18:50.078615 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.054370 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bf1e9f8e-d430-4187-958b-cd7137154d7b-root\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:50.078615 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.054565 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bf1e9f8e-d430-4187-958b-cd7137154d7b-node-exporter-wtmp\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:50.078615 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.054643 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bf1e9f8e-d430-4187-958b-cd7137154d7b-node-exporter-textfile\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:50.078615 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.054678 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7e526eb5-3430-4be1-94bd-5971d7a3212e-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-cdtcf\" (UID: \"7e526eb5-3430-4be1-94bd-5971d7a3212e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" Jul 22 18:18:50.078615 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.055595 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bf1e9f8e-d430-4187-958b-cd7137154d7b-node-exporter-accelerators-collector-config\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:50.078615 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.060447 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7e526eb5-3430-4be1-94bd-5971d7a3212e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-cdtcf\" (UID: \"7e526eb5-3430-4be1-94bd-5971d7a3212e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" Jul 22 18:18:50.087134 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.086071 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf1e9f8e-d430-4187-958b-cd7137154d7b-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:50.088064 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.088021 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skrfz\" (UniqueName: \"kubernetes.io/projected/7e526eb5-3430-4be1-94bd-5971d7a3212e-kube-api-access-skrfz\") pod \"kube-state-metrics-56c5594674-cdtcf\" (UID: \"7e526eb5-3430-4be1-94bd-5971d7a3212e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" Jul 22 18:18:50.088599 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.088491 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh5kn\" (UniqueName: \"kubernetes.io/projected/bf1e9f8e-d430-4187-958b-cd7137154d7b-kube-api-access-dh5kn\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:50.558884 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.558856 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bf1e9f8e-d430-4187-958b-cd7137154d7b-node-exporter-tls\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:50.559074 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.558911 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e526eb5-3430-4be1-94bd-5971d7a3212e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-cdtcf\" (UID: \"7e526eb5-3430-4be1-94bd-5971d7a3212e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" Jul 22 18:18:50.561708 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.561682 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bf1e9f8e-d430-4187-958b-cd7137154d7b-node-exporter-tls\") pod \"node-exporter-ggj9z\" (UID: \"bf1e9f8e-d430-4187-958b-cd7137154d7b\") " pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:50.561823 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.561772 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7e526eb5-3430-4be1-94bd-5971d7a3212e-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-cdtcf\" (UID: \"7e526eb5-3430-4be1-94bd-5971d7a3212e\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" Jul 22 18:18:50.766446 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.766171 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" Jul 22 18:18:50.781135 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.781104 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ggj9z" Jul 22 18:18:50.962978 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.962880 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls\") pod \"dns-default-dhqrm\" (UID: \"f40c4040-42e8-402a-b893-2055c35bc560\") " pod="openshift-dns/dns-default-dhqrm" Jul 22 18:18:50.965959 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:50.965929 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f40c4040-42e8-402a-b893-2055c35bc560-metrics-tls\") pod \"dns-default-dhqrm\" (UID: \"f40c4040-42e8-402a-b893-2055c35bc560\") " pod="openshift-dns/dns-default-dhqrm" Jul 22 18:18:51.037720 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:51.037686 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ttgch\"" Jul 22 18:18:51.045879 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:51.045845 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dhqrm" Jul 22 18:18:51.358208 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:51.358176 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:51.711764 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:51.711666 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:52.757109 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:52.757075 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:52.826039 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:52.826000 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:53.073001 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:18:53.072971 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf1e9f8e_d430_4187_958b_cd7137154d7b.slice/crio-89119e930e9860584f2ada5b9862f1c2e3c2a36c4ea960aa2cb9cd3d6c3875dd WatchSource:0}: Error finding container 89119e930e9860584f2ada5b9862f1c2e3c2a36c4ea960aa2cb9cd3d6c3875dd: Status 404 returned error can't find the container with id 89119e930e9860584f2ada5b9862f1c2e3c2a36c4ea960aa2cb9cd3d6c3875dd Jul 22 18:18:53.161901 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:53.161787 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:53.235712 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:53.235114 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-cdtcf"] Jul 22 18:18:53.236379 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:53.236295 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:53.258666 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:53.257496 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dhqrm"] Jul 22 18:18:53.472473 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:53.472337 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-xmrzf" event={"ID":"8060d058-e84a-43be-9cdc-f288cb37966d","Type":"ContainerStarted","Data":"6ed4c4ac15387c7cdf180b0f86adf323df8932ecca332163abb708b0d291ea57"} Jul 22 18:18:53.472652 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:53.472524 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-xmrzf" Jul 22 18:18:53.475001 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:53.474699 2554 patch_prober.go:28] interesting pod/downloads-5bc67dcd46-xmrzf container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.16:8080/\": dial tcp 10.133.0.16:8080: connect: connection refused" start-of-body= Jul 22 18:18:53.475001 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:53.474749 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-5bc67dcd46-xmrzf" podUID="8060d058-e84a-43be-9cdc-f288cb37966d" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.16:8080/\": dial tcp 10.133.0.16:8080: connect: connection refused" Jul 22 18:18:53.476269 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:53.476242 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ggj9z" event={"ID":"bf1e9f8e-d430-4187-958b-cd7137154d7b","Type":"ContainerStarted","Data":"89119e930e9860584f2ada5b9862f1c2e3c2a36c4ea960aa2cb9cd3d6c3875dd"} Jul 22 18:18:53.478116 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:53.478062 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" event={"ID":"7e526eb5-3430-4be1-94bd-5971d7a3212e","Type":"ContainerStarted","Data":"c1b78e88157a5f0a461813187fa536b995f935786116aa776ce1494a046c4eb2"} Jul 22 18:18:53.480054 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:53.479997 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dhqrm" event={"ID":"f40c4040-42e8-402a-b893-2055c35bc560","Type":"ContainerStarted","Data":"5260d6f7954704352f5deecdd9d05e27005693e55abe7dc2f5c69056911e6ddb"} Jul 22 18:18:53.490137 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:53.489633 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-xmrzf" podStartSLOduration=1.758700504 podStartE2EDuration="19.489620219s" totalImagesPullingTime="17.730919715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:18:53.489286573 +0000 UTC m=+289.414181592" watchObservedRunningTime="2026-07-22 18:18:53.489620219 +0000 UTC m=+289.414515233" Jul 22 18:18:53.519870 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:53.519839 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:53.949975 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:53.949844 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:54.049461 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.049332 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:54.132279 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.132245 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7986f4464d-lccpm"] Jul 22 18:18:54.136718 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.136693 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.139637 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.139613 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-tjfbz\"" Jul 22 18:18:54.139927 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.139896 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 22 18:18:54.142221 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.141001 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 22 18:18:54.142221 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.141122 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2iqrpku4j379h\"" Jul 22 18:18:54.142221 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.141314 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 22 18:18:54.142221 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.141530 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 22 18:18:54.150726 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.148961 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7986f4464d-lccpm"] Jul 22 18:18:54.186488 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.186458 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:54.193879 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.193512 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a8f70565-0ea7-4f56-be71-4c6927371816-audit-log\") pod \"metrics-server-7986f4464d-lccpm\" (UID: \"a8f70565-0ea7-4f56-be71-4c6927371816\") " pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.193879 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.193574 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a8f70565-0ea7-4f56-be71-4c6927371816-secret-metrics-server-client-certs\") pod \"metrics-server-7986f4464d-lccpm\" (UID: \"a8f70565-0ea7-4f56-be71-4c6927371816\") " pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.193879 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.193612 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a8f70565-0ea7-4f56-be71-4c6927371816-metrics-server-audit-profiles\") pod \"metrics-server-7986f4464d-lccpm\" (UID: \"a8f70565-0ea7-4f56-be71-4c6927371816\") " pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.193879 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.193645 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a8f70565-0ea7-4f56-be71-4c6927371816-secret-metrics-server-tls\") pod \"metrics-server-7986f4464d-lccpm\" (UID: \"a8f70565-0ea7-4f56-be71-4c6927371816\") " pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.193879 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.193678 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8f70565-0ea7-4f56-be71-4c6927371816-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7986f4464d-lccpm\" (UID: \"a8f70565-0ea7-4f56-be71-4c6927371816\") " pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.193879 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.193716 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8f70565-0ea7-4f56-be71-4c6927371816-client-ca-bundle\") pod \"metrics-server-7986f4464d-lccpm\" (UID: \"a8f70565-0ea7-4f56-be71-4c6927371816\") " pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.193879 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.193756 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw6cv\" (UniqueName: \"kubernetes.io/projected/a8f70565-0ea7-4f56-be71-4c6927371816-kube-api-access-rw6cv\") pod \"metrics-server-7986f4464d-lccpm\" (UID: \"a8f70565-0ea7-4f56-be71-4c6927371816\") " pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.251037 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.250876 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:54.295163 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.295129 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a8f70565-0ea7-4f56-be71-4c6927371816-secret-metrics-server-client-certs\") pod \"metrics-server-7986f4464d-lccpm\" (UID: \"a8f70565-0ea7-4f56-be71-4c6927371816\") " pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.295434 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.295397 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a8f70565-0ea7-4f56-be71-4c6927371816-metrics-server-audit-profiles\") pod \"metrics-server-7986f4464d-lccpm\" (UID: \"a8f70565-0ea7-4f56-be71-4c6927371816\") " pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.295628 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.295572 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a8f70565-0ea7-4f56-be71-4c6927371816-secret-metrics-server-tls\") pod \"metrics-server-7986f4464d-lccpm\" (UID: \"a8f70565-0ea7-4f56-be71-4c6927371816\") " pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.295772 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.295754 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8f70565-0ea7-4f56-be71-4c6927371816-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7986f4464d-lccpm\" (UID: \"a8f70565-0ea7-4f56-be71-4c6927371816\") " pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.295902 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.295886 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8f70565-0ea7-4f56-be71-4c6927371816-client-ca-bundle\") pod \"metrics-server-7986f4464d-lccpm\" (UID: \"a8f70565-0ea7-4f56-be71-4c6927371816\") " pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.296021 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.296004 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw6cv\" (UniqueName: \"kubernetes.io/projected/a8f70565-0ea7-4f56-be71-4c6927371816-kube-api-access-rw6cv\") pod \"metrics-server-7986f4464d-lccpm\" (UID: \"a8f70565-0ea7-4f56-be71-4c6927371816\") " pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.296107 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.296077 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a8f70565-0ea7-4f56-be71-4c6927371816-audit-log\") pod \"metrics-server-7986f4464d-lccpm\" (UID: \"a8f70565-0ea7-4f56-be71-4c6927371816\") " pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.296497 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.296475 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/a8f70565-0ea7-4f56-be71-4c6927371816-audit-log\") pod \"metrics-server-7986f4464d-lccpm\" (UID: \"a8f70565-0ea7-4f56-be71-4c6927371816\") " pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.296988 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.296925 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/a8f70565-0ea7-4f56-be71-4c6927371816-metrics-server-audit-profiles\") pod \"metrics-server-7986f4464d-lccpm\" (UID: \"a8f70565-0ea7-4f56-be71-4c6927371816\") " pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.296988 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.296927 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8f70565-0ea7-4f56-be71-4c6927371816-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7986f4464d-lccpm\" (UID: \"a8f70565-0ea7-4f56-be71-4c6927371816\") " pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.299645 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.299591 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/a8f70565-0ea7-4f56-be71-4c6927371816-secret-metrics-server-client-certs\") pod \"metrics-server-7986f4464d-lccpm\" (UID: \"a8f70565-0ea7-4f56-be71-4c6927371816\") " pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.301502 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.301480 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/a8f70565-0ea7-4f56-be71-4c6927371816-client-ca-bundle\") pod \"metrics-server-7986f4464d-lccpm\" (UID: \"a8f70565-0ea7-4f56-be71-4c6927371816\") " pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.304095 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.304068 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/a8f70565-0ea7-4f56-be71-4c6927371816-secret-metrics-server-tls\") pod \"metrics-server-7986f4464d-lccpm\" (UID: \"a8f70565-0ea7-4f56-be71-4c6927371816\") " pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.312643 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.312590 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw6cv\" (UniqueName: \"kubernetes.io/projected/a8f70565-0ea7-4f56-be71-4c6927371816-kube-api-access-rw6cv\") pod \"metrics-server-7986f4464d-lccpm\" (UID: \"a8f70565-0ea7-4f56-be71-4c6927371816\") " pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.360090 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.359967 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:54.432726 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.432660 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:54.454975 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.454931 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:18:54.495978 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.495603 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-xmrzf" Jul 22 18:18:54.611888 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.611852 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:54.613568 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.612283 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjbnr"] Jul 22 18:18:54.635897 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.633253 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjbnr"] Jul 22 18:18:54.635897 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.633392 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjbnr" Jul 22 18:18:54.637975 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.636295 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 22 18:18:54.637975 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.637261 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-zlxcn\"" Jul 22 18:18:54.669746 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.669194 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:54.705163 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.704888 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/70369879-4cfb-47ec-96c5-8045bc22a2a7-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-cjbnr\" (UID: \"70369879-4cfb-47ec-96c5-8045bc22a2a7\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjbnr" Jul 22 18:18:54.705163 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.704952 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4x2s\" (UniqueName: \"kubernetes.io/projected/70369879-4cfb-47ec-96c5-8045bc22a2a7-kube-api-access-c4x2s\") pod \"monitoring-plugin-7b7b7bc8bf-cjbnr\" (UID: \"70369879-4cfb-47ec-96c5-8045bc22a2a7\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjbnr" Jul 22 18:18:54.786506 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.786439 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7986f4464d-lccpm"] Jul 22 18:18:54.807102 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.805974 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/70369879-4cfb-47ec-96c5-8045bc22a2a7-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-cjbnr\" (UID: \"70369879-4cfb-47ec-96c5-8045bc22a2a7\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjbnr" Jul 22 18:18:54.807102 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.806035 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4x2s\" (UniqueName: \"kubernetes.io/projected/70369879-4cfb-47ec-96c5-8045bc22a2a7-kube-api-access-c4x2s\") pod \"monitoring-plugin-7b7b7bc8bf-cjbnr\" (UID: \"70369879-4cfb-47ec-96c5-8045bc22a2a7\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjbnr" Jul 22 18:18:54.807102 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:54.806544 2554 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 22 18:18:54.807102 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:18:54.806618 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70369879-4cfb-47ec-96c5-8045bc22a2a7-monitoring-plugin-cert podName:70369879-4cfb-47ec-96c5-8045bc22a2a7 nodeName:}" failed. No retries permitted until 2026-07-22 18:18:55.306599118 +0000 UTC m=+291.231494121 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/70369879-4cfb-47ec-96c5-8045bc22a2a7-monitoring-plugin-cert") pod "monitoring-plugin-7b7b7bc8bf-cjbnr" (UID: "70369879-4cfb-47ec-96c5-8045bc22a2a7") : secret "monitoring-plugin-cert" not found Jul 22 18:18:54.818855 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.818824 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4x2s\" (UniqueName: \"kubernetes.io/projected/70369879-4cfb-47ec-96c5-8045bc22a2a7-kube-api-access-c4x2s\") pod \"monitoring-plugin-7b7b7bc8bf-cjbnr\" (UID: \"70369879-4cfb-47ec-96c5-8045bc22a2a7\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjbnr" Jul 22 18:18:54.922997 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:18:54.922905 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8f70565_0ea7_4f56_be71_4c6927371816.slice/crio-1f5e5af429c8cb55415acae15f96484701fa6134c0f4deaf52f538c67ac5fa3c WatchSource:0}: Error finding container 1f5e5af429c8cb55415acae15f96484701fa6134c0f4deaf52f538c67ac5fa3c: Status 404 returned error can't find the container with id 1f5e5af429c8cb55415acae15f96484701fa6134c0f4deaf52f538c67ac5fa3c Jul 22 18:18:54.945244 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:54.944944 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:55.005375 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:55.005197 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:18:55.030051 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:55.030016 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:55.112651 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:55.112578 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:55.311388 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:55.311354 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/70369879-4cfb-47ec-96c5-8045bc22a2a7-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-cjbnr\" (UID: \"70369879-4cfb-47ec-96c5-8045bc22a2a7\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjbnr" Jul 22 18:18:55.319722 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:55.319663 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/70369879-4cfb-47ec-96c5-8045bc22a2a7-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-cjbnr\" (UID: \"70369879-4cfb-47ec-96c5-8045bc22a2a7\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjbnr" Jul 22 18:18:55.413576 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:55.413006 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:55.471262 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:55.471196 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:55.493744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:55.493219 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" event={"ID":"a8f70565-0ea7-4f56-be71-4c6927371816","Type":"ContainerStarted","Data":"1f5e5af429c8cb55415acae15f96484701fa6134c0f4deaf52f538c67ac5fa3c"} Jul 22 18:18:55.558078 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:55.558046 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjbnr" Jul 22 18:18:56.060461 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.058459 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 18:18:56.061959 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.061930 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:56.078228 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.077227 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.078228 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.077946 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 18:18:56.080730 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.080112 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 22 18:18:56.080730 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.080243 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 22 18:18:56.080730 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.080493 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 22 18:18:56.080959 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.080858 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-funj1692le4ul\"" Jul 22 18:18:56.088940 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.081284 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 22 18:18:56.088940 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.081537 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 22 18:18:56.088940 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.081753 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 22 18:18:56.088940 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.081937 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 22 18:18:56.104115 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.102553 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 22 18:18:56.104623 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.104441 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 22 18:18:56.105332 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.105308 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 22 18:18:56.105569 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.105549 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 22 18:18:56.110287 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.110053 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qztjh\"" Jul 22 18:18:56.111311 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.111285 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 22 18:18:56.113456 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.111669 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 22 18:18:56.120807 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.120780 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 22 18:18:56.218775 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.218723 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.219103 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.218818 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.219103 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.218848 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.219103 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.218881 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.219103 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.218904 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.219103 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.218943 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.219103 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.218971 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-web-config\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.219103 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.218995 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.219103 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.219021 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.219629 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.219597 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.219769 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.219649 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.219769 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.219688 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-config\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.219769 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.219710 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4876d458-354c-4057-88e4-9d52cf5e5d6b-config-out\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.219769 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.219734 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.219769 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.219766 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4876d458-354c-4057-88e4-9d52cf5e5d6b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.220179 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.219786 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.220179 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.219812 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.220179 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.219845 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.220179 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.219868 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.220179 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.219894 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv2cp\" (UniqueName: \"kubernetes.io/projected/4876d458-354c-4057-88e4-9d52cf5e5d6b-kube-api-access-bv2cp\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.320932 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.320854 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-config\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.320932 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.320896 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4876d458-354c-4057-88e4-9d52cf5e5d6b-config-out\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.320932 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.320924 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.321197 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.320955 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4876d458-354c-4057-88e4-9d52cf5e5d6b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.321197 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.320975 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.321197 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.320995 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.321197 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.321024 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.321197 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.321044 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.321197 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.321067 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv2cp\" (UniqueName: \"kubernetes.io/projected/4876d458-354c-4057-88e4-9d52cf5e5d6b-kube-api-access-bv2cp\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.321197 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.321091 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.321197 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.321163 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.321197 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.321187 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.321655 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.321224 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.321655 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.321252 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.321655 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.321297 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.321655 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.321325 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-web-config\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.321655 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.321351 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.321655 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.321376 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.321655 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.321450 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.321655 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.321485 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.322255 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.322232 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.322884 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.322859 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.324698 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.324632 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.326812 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.326589 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.328274 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.328234 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.329119 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.328817 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.329223 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.329176 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.329724 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.329624 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.332114 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.332086 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.333432 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.333363 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.337387 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.337335 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv2cp\" (UniqueName: \"kubernetes.io/projected/4876d458-354c-4057-88e4-9d52cf5e5d6b-kube-api-access-bv2cp\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.337926 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.337887 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-config\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.339963 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.339276 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-web-config\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.339963 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.339400 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.339963 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.339458 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.339963 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.339918 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.340215 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.340094 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.340518 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.340472 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4876d458-354c-4057-88e4-9d52cf5e5d6b-config-out\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.341847 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.341346 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4876d458-354c-4057-88e4-9d52cf5e5d6b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.341847 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.341806 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:56.411028 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:56.410790 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:18:57.395083 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:57.395047 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-867fdb9447-wwxjj" Jul 22 18:18:57.538352 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:57.538317 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:57.641244 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:57.641203 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:18:59.548269 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:18:59.548229 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjbnr"] Jul 22 18:19:00.019888 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:00.019848 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74f54455f9-gc992" podUID="a7c6a22e-b4f7-4017-897d-e479a3b258c1" containerName="registry" containerID="cri-o://51e233c295f56550343c1bf6961cb3d2ea4891cef0108f0ae99b0d72834ed33b" gracePeriod=30 Jul 22 18:19:00.307176 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:19:00.307098 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70369879_4cfb_47ec_96c5_8045bc22a2a7.slice/crio-4a7359473caf8652481e377bee1d91b503bb181d0bbd0f33be20a94998877c5c WatchSource:0}: Error finding container 4a7359473caf8652481e377bee1d91b503bb181d0bbd0f33be20a94998877c5c: Status 404 returned error can't find the container with id 4a7359473caf8652481e377bee1d91b503bb181d0bbd0f33be20a94998877c5c Jul 22 18:19:00.468779 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:00.468619 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 18:19:00.522339 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:00.522293 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjbnr" event={"ID":"70369879-4cfb-47ec-96c5-8045bc22a2a7","Type":"ContainerStarted","Data":"4a7359473caf8652481e377bee1d91b503bb181d0bbd0f33be20a94998877c5c"} Jul 22 18:19:00.712181 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:19:00.712086 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4876d458_354c_4057_88e4_9d52cf5e5d6b.slice/crio-e8d5bed86e9bc1065fa9343b01dfcd75e69a7a33cbdc2805897c7420b836a516 WatchSource:0}: Error finding container e8d5bed86e9bc1065fa9343b01dfcd75e69a7a33cbdc2805897c7420b836a516: Status 404 returned error can't find the container with id e8d5bed86e9bc1065fa9343b01dfcd75e69a7a33cbdc2805897c7420b836a516 Jul 22 18:19:00.934009 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:00.933981 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:19:01.081268 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.077664 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7c6a22e-b4f7-4017-897d-e479a3b258c1-installation-pull-secrets\") pod \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " Jul 22 18:19:01.081268 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.077715 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7c6a22e-b4f7-4017-897d-e479a3b258c1-image-registry-private-configuration\") pod \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " Jul 22 18:19:01.081268 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.077742 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-certificates\") pod \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " Jul 22 18:19:01.081268 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.077787 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7c6a22e-b4f7-4017-897d-e479a3b258c1-ca-trust-extracted\") pod \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " Jul 22 18:19:01.081268 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.077821 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hn89\" (UniqueName: \"kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-kube-api-access-2hn89\") pod \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " Jul 22 18:19:01.081268 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.077879 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-bound-sa-token\") pod \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " Jul 22 18:19:01.081268 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.077910 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-tls\") pod \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " Jul 22 18:19:01.081268 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.077963 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7c6a22e-b4f7-4017-897d-e479a3b258c1-trusted-ca\") pod \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\" (UID: \"a7c6a22e-b4f7-4017-897d-e479a3b258c1\") " Jul 22 18:19:01.081268 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.080763 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a7c6a22e-b4f7-4017-897d-e479a3b258c1" (UID: "a7c6a22e-b4f7-4017-897d-e479a3b258c1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:19:01.082129 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.082079 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-kube-api-access-2hn89" (OuterVolumeSpecName: "kube-api-access-2hn89") pod "a7c6a22e-b4f7-4017-897d-e479a3b258c1" (UID: "a7c6a22e-b4f7-4017-897d-e479a3b258c1"). InnerVolumeSpecName "kube-api-access-2hn89". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:19:01.085029 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.084857 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a7c6a22e-b4f7-4017-897d-e479a3b258c1" (UID: "a7c6a22e-b4f7-4017-897d-e479a3b258c1"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:19:01.088265 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.088224 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7c6a22e-b4f7-4017-897d-e479a3b258c1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a7c6a22e-b4f7-4017-897d-e479a3b258c1" (UID: "a7c6a22e-b4f7-4017-897d-e479a3b258c1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:19:01.101175 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.101135 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7c6a22e-b4f7-4017-897d-e479a3b258c1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a7c6a22e-b4f7-4017-897d-e479a3b258c1" (UID: "a7c6a22e-b4f7-4017-897d-e479a3b258c1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:19:01.107643 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.106379 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7c6a22e-b4f7-4017-897d-e479a3b258c1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a7c6a22e-b4f7-4017-897d-e479a3b258c1" (UID: "a7c6a22e-b4f7-4017-897d-e479a3b258c1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:19:01.107643 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.106608 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a7c6a22e-b4f7-4017-897d-e479a3b258c1" (UID: "a7c6a22e-b4f7-4017-897d-e479a3b258c1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:19:01.112566 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.112507 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7c6a22e-b4f7-4017-897d-e479a3b258c1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a7c6a22e-b4f7-4017-897d-e479a3b258c1" (UID: "a7c6a22e-b4f7-4017-897d-e479a3b258c1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:19:01.179174 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.179120 2554 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7c6a22e-b4f7-4017-897d-e479a3b258c1-installation-pull-secrets\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:19:01.179174 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.179165 2554 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7c6a22e-b4f7-4017-897d-e479a3b258c1-image-registry-private-configuration\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:19:01.179174 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.179178 2554 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-certificates\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:19:01.179447 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.179190 2554 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7c6a22e-b4f7-4017-897d-e479a3b258c1-ca-trust-extracted\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:19:01.179447 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.179202 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hn89\" (UniqueName: \"kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-kube-api-access-2hn89\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:19:01.179447 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.179215 2554 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-bound-sa-token\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:19:01.179447 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.179227 2554 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7c6a22e-b4f7-4017-897d-e479a3b258c1-registry-tls\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:19:01.179447 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.179238 2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7c6a22e-b4f7-4017-897d-e479a3b258c1-trusted-ca\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:19:01.531390 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.530531 2554 generic.go:356] "Generic (PLEG): container finished" podID="a7c6a22e-b4f7-4017-897d-e479a3b258c1" containerID="51e233c295f56550343c1bf6961cb3d2ea4891cef0108f0ae99b0d72834ed33b" exitCode=0 Jul 22 18:19:01.531390 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.530621 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74f54455f9-gc992" event={"ID":"a7c6a22e-b4f7-4017-897d-e479a3b258c1","Type":"ContainerDied","Data":"51e233c295f56550343c1bf6961cb3d2ea4891cef0108f0ae99b0d72834ed33b"} Jul 22 18:19:01.531390 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.530677 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74f54455f9-gc992" event={"ID":"a7c6a22e-b4f7-4017-897d-e479a3b258c1","Type":"ContainerDied","Data":"f2b7df6eb9324069a2f6adbb38deb93514a4f383a940a30a72a101def4018c04"} Jul 22 18:19:01.531390 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.530726 2554 scope.go:117] "RemoveContainer" containerID="51e233c295f56550343c1bf6961cb3d2ea4891cef0108f0ae99b0d72834ed33b" Jul 22 18:19:01.531390 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.530880 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74f54455f9-gc992" Jul 22 18:19:01.541818 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.541486 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vh2pz" event={"ID":"d3a449c1-034d-44c6-a5e4-d01189c070ff","Type":"ContainerStarted","Data":"9c59cd9c823db21646fe26c6f72be0d3c875e0762b54b365f061bd89bba48436"} Jul 22 18:19:01.541818 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:19:01.541776 2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-tbzjc" podUID="6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57" Jul 22 18:19:01.546665 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.544965 2554 generic.go:356] "Generic (PLEG): container finished" podID="bf1e9f8e-d430-4187-958b-cd7137154d7b" containerID="0d3ea90f0624b8216fbdc78c910b55087d19d941dd0831efebda1caacfd38133" exitCode=0 Jul 22 18:19:01.546665 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.545070 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ggj9z" event={"ID":"bf1e9f8e-d430-4187-958b-cd7137154d7b","Type":"ContainerDied","Data":"0d3ea90f0624b8216fbdc78c910b55087d19d941dd0831efebda1caacfd38133"} Jul 22 18:19:01.549461 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.549437 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dhqrm" event={"ID":"f40c4040-42e8-402a-b893-2055c35bc560","Type":"ContainerStarted","Data":"dc88d86bff7e1208c0fd39a5b67717275561b84910945acbba8bab7c1f76170f"} Jul 22 18:19:01.550549 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.550527 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dhqrm" event={"ID":"f40c4040-42e8-402a-b893-2055c35bc560","Type":"ContainerStarted","Data":"7f8ba66ad5e94c758776c7896b66ce729d3bf266488c671321eb0c6169388d6c"} Jul 22 18:19:01.551185 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.551168 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dhqrm" Jul 22 18:19:01.553153 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.552072 2554 scope.go:117] "RemoveContainer" containerID="51e233c295f56550343c1bf6961cb3d2ea4891cef0108f0ae99b0d72834ed33b" Jul 22 18:19:01.555515 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:19:01.555397 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51e233c295f56550343c1bf6961cb3d2ea4891cef0108f0ae99b0d72834ed33b\": container with ID starting with 51e233c295f56550343c1bf6961cb3d2ea4891cef0108f0ae99b0d72834ed33b not found: ID does not exist" containerID="51e233c295f56550343c1bf6961cb3d2ea4891cef0108f0ae99b0d72834ed33b" Jul 22 18:19:01.555515 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.555448 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51e233c295f56550343c1bf6961cb3d2ea4891cef0108f0ae99b0d72834ed33b"} err="failed to get container status \"51e233c295f56550343c1bf6961cb3d2ea4891cef0108f0ae99b0d72834ed33b\": rpc error: code = NotFound desc = could not find container \"51e233c295f56550343c1bf6961cb3d2ea4891cef0108f0ae99b0d72834ed33b\": container with ID starting with 51e233c295f56550343c1bf6961cb3d2ea4891cef0108f0ae99b0d72834ed33b not found: ID does not exist" Jul 22 18:19:01.561000 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.560879 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" event={"ID":"7e526eb5-3430-4be1-94bd-5971d7a3212e","Type":"ContainerStarted","Data":"4a768529cc7b311775993f5ea4226a30fd2e38ccc9faaac254f44c652687c2c8"} Jul 22 18:19:01.561000 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.560935 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" event={"ID":"7e526eb5-3430-4be1-94bd-5971d7a3212e","Type":"ContainerStarted","Data":"e10adaed86cac45d56103f7b1e5993e932260ebedb00c13d9ec43dc4d05f8a30"} Jul 22 18:19:01.561000 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.560963 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" event={"ID":"7e526eb5-3430-4be1-94bd-5971d7a3212e","Type":"ContainerStarted","Data":"f72598b5f6f940b9ca596326df157414ca2ffa9704a1b75878f3abb3eab52c29"} Jul 22 18:19:01.564041 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.563672 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" event={"ID":"a8f70565-0ea7-4f56-be71-4c6927371816","Type":"ContainerStarted","Data":"52b0d1f0d36e5617f94bee36b7442056efa872805256bce7fea79ac056137e49"} Jul 22 18:19:01.580256 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.577807 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4876d458-354c-4057-88e4-9d52cf5e5d6b","Type":"ContainerStarted","Data":"e8d5bed86e9bc1065fa9343b01dfcd75e69a7a33cbdc2805897c7420b836a516"} Jul 22 18:19:01.631256 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.628797 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-cdtcf" podStartSLOduration=6.276327362 podStartE2EDuration="12.628774981s" totalImagesPullingTime="6.352447619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:19:01.607000113 +0000 UTC m=+297.531895131" watchObservedRunningTime="2026-07-22 18:19:01.628774981 +0000 UTC m=+297.553670002" Jul 22 18:19:01.631256 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.630323 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74f54455f9-gc992"] Jul 22 18:19:01.631256 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.631206 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74f54455f9-gc992"] Jul 22 18:19:01.652387 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.652251 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dhqrm" podStartSLOduration=253.15882032 podStartE2EDuration="4m20.652230799s" totalImagesPullingTime="7.493410479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:19:01.65112713 +0000 UTC m=+297.576022150" watchObservedRunningTime="2026-07-22 18:19:01.652230799 +0000 UTC m=+297.577125819" Jul 22 18:19:01.674686 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:01.673578 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" podStartSLOduration=1.847469222 podStartE2EDuration="7.673554568s" totalImagesPullingTime="5.826085346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:19:01.672518312 +0000 UTC m=+297.597413332" watchObservedRunningTime="2026-07-22 18:19:01.673554568 +0000 UTC m=+297.598449587" Jul 22 18:19:02.549038 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:02.549001 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7c6a22e-b4f7-4017-897d-e479a3b258c1" path="/var/lib/kubelet/pods/a7c6a22e-b4f7-4017-897d-e479a3b258c1/volumes" Jul 22 18:19:02.588031 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:02.587994 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ggj9z" event={"ID":"bf1e9f8e-d430-4187-958b-cd7137154d7b","Type":"ContainerStarted","Data":"c32cb0f2431f89ad5d382ba59451e1ea7a10b388918ddbede35d079f7662c524"} Jul 22 18:19:02.588263 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:02.588052 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ggj9z" event={"ID":"bf1e9f8e-d430-4187-958b-cd7137154d7b","Type":"ContainerStarted","Data":"d757ae7d321a5e1a90619d23c7ec1eb1ae36219b0ef89670a5bf7b0d3f81b60d"} Jul 22 18:19:02.609456 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:02.609360 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ggj9z" podStartSLOduration=7.688722289 podStartE2EDuration="13.609340083s" totalImagesPullingTime="5.696151515s" totalInitContainerRuntime="224.466279ms" isStatefulPod=true podCreationTimestamp="2026-07-22 18:18:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:19:02.607684697 +0000 UTC m=+298.532579716" watchObservedRunningTime="2026-07-22 18:19:02.609340083 +0000 UTC m=+298.534235104" Jul 22 18:19:03.573922 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:03.573891 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:19:03.632255 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:03.632222 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:19:05.239916 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:05.237292 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:19:05.239916 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:05.238089 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:19:05.244801 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:05.244785 2554 kubelet.go:1648] "Image garbage collection succeeded" Jul 22 18:19:05.603381 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:05.603346 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjbnr" event={"ID":"70369879-4cfb-47ec-96c5-8045bc22a2a7","Type":"ContainerStarted","Data":"c6b1e5cc13433670341787f51821874ce756b794ab1ab799ef29ba33585105d1"} Jul 22 18:19:05.603622 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:05.603530 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjbnr" Jul 22 18:19:05.604885 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:05.604859 2554 generic.go:356] "Generic (PLEG): container finished" podID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerID="4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b" exitCode=0 Jul 22 18:19:05.604997 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:05.604891 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4876d458-354c-4057-88e4-9d52cf5e5d6b","Type":"ContainerDied","Data":"4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b"} Jul 22 18:19:05.608681 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:05.608656 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjbnr" Jul 22 18:19:05.621035 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:05.620980 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjbnr" podStartSLOduration=7.117940156 podStartE2EDuration="11.620962658s" totalImagesPullingTime="4.503022502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:19:05.618441932 +0000 UTC m=+301.543336950" watchObservedRunningTime="2026-07-22 18:19:05.620962658 +0000 UTC m=+301.545857681" Jul 22 18:19:06.118338 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:06.118305 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:19:06.219571 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:06.219544 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:19:06.611594 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:06.611547 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vh2pz" event={"ID":"d3a449c1-034d-44c6-a5e4-d01189c070ff","Type":"ContainerStarted","Data":"6ba7db9b4a9e207301423d516e6097d950439f6dc2709ac38e081be234f4ba31"} Jul 22 18:19:06.631117 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:06.631062 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vh2pz" podStartSLOduration=33.772888878 podStartE2EDuration="59.631046324s" totalImagesPullingTime="25.858157446s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 18:18:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:19:06.629576849 +0000 UTC m=+302.554471871" watchObservedRunningTime="2026-07-22 18:19:06.631046324 +0000 UTC m=+302.555941341" Jul 22 18:19:09.627846 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:09.627818 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4876d458-354c-4057-88e4-9d52cf5e5d6b","Type":"ContainerStarted","Data":"0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298"} Jul 22 18:19:09.733393 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:09.733363 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 18:19:10.634542 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:10.634503 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4876d458-354c-4057-88e4-9d52cf5e5d6b","Type":"ContainerStarted","Data":"335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d"} Jul 22 18:19:12.404794 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:12.403808 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:19:12.502658 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:12.502634 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:19:12.594379 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:12.594310 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dhqrm" Jul 22 18:19:12.602452 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:12.602409 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:19:12.647230 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:12.647200 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4876d458-354c-4057-88e4-9d52cf5e5d6b","Type":"ContainerStarted","Data":"10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315"} Jul 22 18:19:12.647451 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:12.647259 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4876d458-354c-4057-88e4-9d52cf5e5d6b","Type":"ContainerStarted","Data":"99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a"} Jul 22 18:19:12.647451 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:12.647287 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4876d458-354c-4057-88e4-9d52cf5e5d6b","Type":"ContainerStarted","Data":"aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7"} Jul 22 18:19:12.647451 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:12.647310 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4876d458-354c-4057-88e4-9d52cf5e5d6b","Type":"ContainerStarted","Data":"d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739"} Jul 22 18:19:12.676658 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:12.676599 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.038376757 podStartE2EDuration="16.676581046s" totalImagesPullingTime="10.613070875s" totalInitContainerRuntime="25.133414ms" isStatefulPod=false podCreationTimestamp="2026-07-22 18:18:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:19:12.674180345 +0000 UTC m=+308.599075362" watchObservedRunningTime="2026-07-22 18:19:12.676581046 +0000 UTC m=+308.601476064" Jul 22 18:19:12.682009 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:12.681988 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:19:14.352534 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:14.352498 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:19:14.455975 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:14.455944 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:19:14.456162 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:14.456031 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:19:14.459731 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:14.459704 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:19:16.411753 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:16.411717 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:19:16.541156 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:16.541126 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:19:20.087293 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:20.087260 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:19:20.187871 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:20.187836 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:19:21.682655 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:21.682623 2554 generic.go:356] "Generic (PLEG): container finished" podID="a3e31864-a150-4faf-9f4d-28d655bd4795" containerID="2938ea53c1886236a6c9fa53f171a97dc6519d3c0157d42224e10660546315a2" exitCode=0 Jul 22 18:19:21.683024 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:21.682700 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qxkn8" event={"ID":"a3e31864-a150-4faf-9f4d-28d655bd4795","Type":"ContainerDied","Data":"2938ea53c1886236a6c9fa53f171a97dc6519d3c0157d42224e10660546315a2"} Jul 22 18:19:21.683066 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:21.683031 2554 scope.go:117] "RemoveContainer" containerID="2938ea53c1886236a6c9fa53f171a97dc6519d3c0157d42224e10660546315a2" Jul 22 18:19:22.687974 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:22.687936 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-qxkn8" event={"ID":"a3e31864-a150-4faf-9f4d-28d655bd4795","Type":"ContainerStarted","Data":"6aaaff43a8c5598b841be8add1212a000545c0fb8428e26729d50df36297da95"} Jul 22 18:19:23.376527 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:23.376494 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:19:23.475963 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:23.475925 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:19:34.460760 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:34.460729 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:19:34.464805 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:34.464784 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7986f4464d-lccpm" Jul 22 18:19:35.097870 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:35.097838 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:19:35.195981 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:35.195941 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:19:56.411673 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:56.411589 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:19:56.430701 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:56.430675 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:19:56.832698 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:19:56.832670 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:03.554563 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:03.554530 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:20:03.614067 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:03.614034 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:20:05.904067 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:05.904037 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:20:05.965589 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:05.965552 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:20:14.388672 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.388634 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 18:20:14.389165 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.389030 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="prometheus" containerID="cri-o://0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298" gracePeriod=600 Jul 22 18:20:14.389165 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.389080 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="kube-rbac-proxy-thanos" containerID="cri-o://10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315" gracePeriod=600 Jul 22 18:20:14.389165 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.389073 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="kube-rbac-proxy-web" containerID="cri-o://aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7" gracePeriod=600 Jul 22 18:20:14.389165 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.389120 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="config-reloader" containerID="cri-o://335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d" gracePeriod=600 Jul 22 18:20:14.389341 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.389035 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="kube-rbac-proxy" containerID="cri-o://99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a" gracePeriod=600 Jul 22 18:20:14.389341 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.389055 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="thanos-sidecar" containerID="cri-o://d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739" gracePeriod=600 Jul 22 18:20:14.635339 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.635314 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:14.731473 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.731357 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bv2cp\" (UniqueName: \"kubernetes.io/projected/4876d458-354c-4057-88e4-9d52cf5e5d6b-kube-api-access-bv2cp\") pod \"4876d458-354c-4057-88e4-9d52cf5e5d6b\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " Jul 22 18:20:14.731473 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.731398 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-config\") pod \"4876d458-354c-4057-88e4-9d52cf5e5d6b\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " Jul 22 18:20:14.731473 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.731429 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-configmap-serving-certs-ca-bundle\") pod \"4876d458-354c-4057-88e4-9d52cf5e5d6b\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " Jul 22 18:20:14.731473 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.731456 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4876d458-354c-4057-88e4-9d52cf5e5d6b\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " Jul 22 18:20:14.731804 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.731481 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-trusted-ca-bundle\") pod \"4876d458-354c-4057-88e4-9d52cf5e5d6b\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " Jul 22 18:20:14.731804 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.731602 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-rulefiles-0\") pod \"4876d458-354c-4057-88e4-9d52cf5e5d6b\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " Jul 22 18:20:14.731804 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.731648 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-grpc-tls\") pod \"4876d458-354c-4057-88e4-9d52cf5e5d6b\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " Jul 22 18:20:14.731804 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.731677 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-configmap-metrics-client-ca\") pod \"4876d458-354c-4057-88e4-9d52cf5e5d6b\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " Jul 22 18:20:14.731804 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.731707 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-db\") pod \"4876d458-354c-4057-88e4-9d52cf5e5d6b\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " Jul 22 18:20:14.731804 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.731736 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4876d458-354c-4057-88e4-9d52cf5e5d6b-tls-assets\") pod \"4876d458-354c-4057-88e4-9d52cf5e5d6b\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " Jul 22 18:20:14.731804 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.731785 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-metrics-client-certs\") pod \"4876d458-354c-4057-88e4-9d52cf5e5d6b\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " Jul 22 18:20:14.731804 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.731809 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-kube-rbac-proxy\") pod \"4876d458-354c-4057-88e4-9d52cf5e5d6b\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " Jul 22 18:20:14.732193 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.731834 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4876d458-354c-4057-88e4-9d52cf5e5d6b-config-out\") pod \"4876d458-354c-4057-88e4-9d52cf5e5d6b\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " Jul 22 18:20:14.732193 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.731859 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-rulefiles-2\") pod \"4876d458-354c-4057-88e4-9d52cf5e5d6b\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " Jul 22 18:20:14.732193 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.731878 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4876d458-354c-4057-88e4-9d52cf5e5d6b" (UID: "4876d458-354c-4057-88e4-9d52cf5e5d6b"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:20:14.732193 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.731899 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-thanos-prometheus-http-client-file\") pod \"4876d458-354c-4057-88e4-9d52cf5e5d6b\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " Jul 22 18:20:14.732193 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.731935 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-prometheus-k8s-tls\") pod \"4876d458-354c-4057-88e4-9d52cf5e5d6b\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " Jul 22 18:20:14.732193 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.731967 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-rulefiles-1\") pod \"4876d458-354c-4057-88e4-9d52cf5e5d6b\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " Jul 22 18:20:14.732193 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.731999 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-configmap-kubelet-serving-ca-bundle\") pod \"4876d458-354c-4057-88e4-9d52cf5e5d6b\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " Jul 22 18:20:14.732193 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.732039 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4876d458-354c-4057-88e4-9d52cf5e5d6b\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " Jul 22 18:20:14.732193 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.732074 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-web-config\") pod \"4876d458-354c-4057-88e4-9d52cf5e5d6b\" (UID: \"4876d458-354c-4057-88e4-9d52cf5e5d6b\") " Jul 22 18:20:14.732193 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.732083 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4876d458-354c-4057-88e4-9d52cf5e5d6b" (UID: "4876d458-354c-4057-88e4-9d52cf5e5d6b"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:20:14.732891 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.732554 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:20:14.732891 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.732575 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:20:14.734148 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.734118 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-config" (OuterVolumeSpecName: "config") pod "4876d458-354c-4057-88e4-9d52cf5e5d6b" (UID: "4876d458-354c-4057-88e4-9d52cf5e5d6b"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:20:14.734148 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.734131 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4876d458-354c-4057-88e4-9d52cf5e5d6b" (UID: "4876d458-354c-4057-88e4-9d52cf5e5d6b"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:20:14.734382 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.734352 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4876d458-354c-4057-88e4-9d52cf5e5d6b" (UID: "4876d458-354c-4057-88e4-9d52cf5e5d6b"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:20:14.734521 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.734380 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4876d458-354c-4057-88e4-9d52cf5e5d6b" (UID: "4876d458-354c-4057-88e4-9d52cf5e5d6b"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:20:14.734521 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.734437 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4876d458-354c-4057-88e4-9d52cf5e5d6b" (UID: "4876d458-354c-4057-88e4-9d52cf5e5d6b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:20:14.734646 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.734548 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4876d458-354c-4057-88e4-9d52cf5e5d6b" (UID: "4876d458-354c-4057-88e4-9d52cf5e5d6b"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:20:14.735089 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.734747 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4876d458-354c-4057-88e4-9d52cf5e5d6b" (UID: "4876d458-354c-4057-88e4-9d52cf5e5d6b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:20:14.735089 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.735042 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4876d458-354c-4057-88e4-9d52cf5e5d6b" (UID: "4876d458-354c-4057-88e4-9d52cf5e5d6b"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:20:14.735339 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.735313 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4876d458-354c-4057-88e4-9d52cf5e5d6b" (UID: "4876d458-354c-4057-88e4-9d52cf5e5d6b"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:20:14.735981 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.735953 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4876d458-354c-4057-88e4-9d52cf5e5d6b" (UID: "4876d458-354c-4057-88e4-9d52cf5e5d6b"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:20:14.736185 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.736161 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4876d458-354c-4057-88e4-9d52cf5e5d6b-kube-api-access-bv2cp" (OuterVolumeSpecName: "kube-api-access-bv2cp") pod "4876d458-354c-4057-88e4-9d52cf5e5d6b" (UID: "4876d458-354c-4057-88e4-9d52cf5e5d6b"). InnerVolumeSpecName "kube-api-access-bv2cp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:20:14.736656 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.736623 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4876d458-354c-4057-88e4-9d52cf5e5d6b" (UID: "4876d458-354c-4057-88e4-9d52cf5e5d6b"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:20:14.736738 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.736711 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4876d458-354c-4057-88e4-9d52cf5e5d6b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4876d458-354c-4057-88e4-9d52cf5e5d6b" (UID: "4876d458-354c-4057-88e4-9d52cf5e5d6b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:20:14.736967 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.736952 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4876d458-354c-4057-88e4-9d52cf5e5d6b-config-out" (OuterVolumeSpecName: "config-out") pod "4876d458-354c-4057-88e4-9d52cf5e5d6b" (UID: "4876d458-354c-4057-88e4-9d52cf5e5d6b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:20:14.737481 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.737464 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4876d458-354c-4057-88e4-9d52cf5e5d6b" (UID: "4876d458-354c-4057-88e4-9d52cf5e5d6b"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:20:14.737552 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.737532 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4876d458-354c-4057-88e4-9d52cf5e5d6b" (UID: "4876d458-354c-4057-88e4-9d52cf5e5d6b"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:20:14.737615 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.737596 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4876d458-354c-4057-88e4-9d52cf5e5d6b" (UID: "4876d458-354c-4057-88e4-9d52cf5e5d6b"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:20:14.746161 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.746134 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-web-config" (OuterVolumeSpecName: "web-config") pod "4876d458-354c-4057-88e4-9d52cf5e5d6b" (UID: "4876d458-354c-4057-88e4-9d52cf5e5d6b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:20:14.833971 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.833936 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:20:14.833971 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.833967 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:20:14.833971 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.833978 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:20:14.834209 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.833988 2554 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-web-config\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:20:14.834209 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.833997 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bv2cp\" (UniqueName: \"kubernetes.io/projected/4876d458-354c-4057-88e4-9d52cf5e5d6b-kube-api-access-bv2cp\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:20:14.834209 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.834005 2554 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-config\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:20:14.834209 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.834013 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:20:14.834209 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.834022 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:20:14.834209 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.834031 2554 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-grpc-tls\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:20:14.834209 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.834041 2554 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-configmap-metrics-client-ca\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:20:14.834209 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.834048 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-db\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:20:14.834209 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.834057 2554 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4876d458-354c-4057-88e4-9d52cf5e5d6b-tls-assets\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:20:14.834209 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.834065 2554 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-metrics-client-certs\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:20:14.834209 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.834073 2554 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-kube-rbac-proxy\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:20:14.834209 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.834081 2554 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4876d458-354c-4057-88e4-9d52cf5e5d6b-config-out\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:20:14.834209 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.834088 2554 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4876d458-354c-4057-88e4-9d52cf5e5d6b-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:20:14.834209 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.834096 2554 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:20:14.834209 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.834105 2554 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4876d458-354c-4057-88e4-9d52cf5e5d6b-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:20:14.884429 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.884384 2554 generic.go:356] "Generic (PLEG): container finished" podID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerID="10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315" exitCode=0 Jul 22 18:20:14.884429 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.884409 2554 generic.go:356] "Generic (PLEG): container finished" podID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerID="99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a" exitCode=0 Jul 22 18:20:14.884429 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.884431 2554 generic.go:356] "Generic (PLEG): container finished" podID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerID="aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7" exitCode=0 Jul 22 18:20:14.884429 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.884437 2554 generic.go:356] "Generic (PLEG): container finished" podID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerID="d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739" exitCode=0 Jul 22 18:20:14.884764 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.884442 2554 generic.go:356] "Generic (PLEG): container finished" podID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerID="335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d" exitCode=0 Jul 22 18:20:14.884764 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.884447 2554 generic.go:356] "Generic (PLEG): container finished" podID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerID="0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298" exitCode=0 Jul 22 18:20:14.884764 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.884473 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:14.884764 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.884472 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4876d458-354c-4057-88e4-9d52cf5e5d6b","Type":"ContainerDied","Data":"10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315"} Jul 22 18:20:14.884764 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.884548 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4876d458-354c-4057-88e4-9d52cf5e5d6b","Type":"ContainerDied","Data":"99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a"} Jul 22 18:20:14.884764 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.884575 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4876d458-354c-4057-88e4-9d52cf5e5d6b","Type":"ContainerDied","Data":"aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7"} Jul 22 18:20:14.884764 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.884599 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4876d458-354c-4057-88e4-9d52cf5e5d6b","Type":"ContainerDied","Data":"d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739"} Jul 22 18:20:14.884764 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.884623 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4876d458-354c-4057-88e4-9d52cf5e5d6b","Type":"ContainerDied","Data":"335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d"} Jul 22 18:20:14.884764 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.884630 2554 scope.go:117] "RemoveContainer" containerID="10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315" Jul 22 18:20:14.884764 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.884646 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4876d458-354c-4057-88e4-9d52cf5e5d6b","Type":"ContainerDied","Data":"0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298"} Jul 22 18:20:14.884764 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.884672 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4876d458-354c-4057-88e4-9d52cf5e5d6b","Type":"ContainerDied","Data":"e8d5bed86e9bc1065fa9343b01dfcd75e69a7a33cbdc2805897c7420b836a516"} Jul 22 18:20:14.893604 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.893575 2554 scope.go:117] "RemoveContainer" containerID="99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a" Jul 22 18:20:14.900836 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.900819 2554 scope.go:117] "RemoveContainer" containerID="aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7" Jul 22 18:20:14.908213 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.908191 2554 scope.go:117] "RemoveContainer" containerID="d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739" Jul 22 18:20:14.908327 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.908308 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 18:20:14.912075 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.912054 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 18:20:14.918542 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.918516 2554 scope.go:117] "RemoveContainer" containerID="335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d" Jul 22 18:20:14.925736 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.925716 2554 scope.go:117] "RemoveContainer" containerID="0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298" Jul 22 18:20:14.933341 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.933325 2554 scope.go:117] "RemoveContainer" containerID="4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b" Jul 22 18:20:14.937815 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.937791 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 18:20:14.938197 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938178 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7c6a22e-b4f7-4017-897d-e479a3b258c1" containerName="registry" Jul 22 18:20:14.938237 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938204 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7c6a22e-b4f7-4017-897d-e479a3b258c1" containerName="registry" Jul 22 18:20:14.938237 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938218 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="prometheus" Jul 22 18:20:14.938237 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938227 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="prometheus" Jul 22 18:20:14.938323 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938242 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="init-config-reloader" Jul 22 18:20:14.938323 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938252 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="init-config-reloader" Jul 22 18:20:14.938323 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938263 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="kube-rbac-proxy" Jul 22 18:20:14.938323 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938272 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="kube-rbac-proxy" Jul 22 18:20:14.938323 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938285 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="config-reloader" Jul 22 18:20:14.938323 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938293 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="config-reloader" Jul 22 18:20:14.938323 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938304 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="thanos-sidecar" Jul 22 18:20:14.938323 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938315 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="thanos-sidecar" Jul 22 18:20:14.938635 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938331 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="kube-rbac-proxy-thanos" Jul 22 18:20:14.938635 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938340 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="kube-rbac-proxy-thanos" Jul 22 18:20:14.938635 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938355 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="kube-rbac-proxy-web" Jul 22 18:20:14.938635 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938363 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="kube-rbac-proxy-web" Jul 22 18:20:14.938635 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938467 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="kube-rbac-proxy-thanos" Jul 22 18:20:14.938635 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938481 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="prometheus" Jul 22 18:20:14.938635 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938492 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="kube-rbac-proxy-web" Jul 22 18:20:14.938635 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938503 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7c6a22e-b4f7-4017-897d-e479a3b258c1" containerName="registry" Jul 22 18:20:14.938635 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938511 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="config-reloader" Jul 22 18:20:14.938635 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938520 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="thanos-sidecar" Jul 22 18:20:14.938635 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.938528 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" containerName="kube-rbac-proxy" Jul 22 18:20:14.941367 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.941347 2554 scope.go:117] "RemoveContainer" containerID="10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315" Jul 22 18:20:14.941696 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:20:14.941679 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315\": container with ID starting with 10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315 not found: ID does not exist" containerID="10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315" Jul 22 18:20:14.941751 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.941706 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315"} err="failed to get container status \"10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315\": rpc error: code = NotFound desc = could not find container \"10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315\": container with ID starting with 10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315 not found: ID does not exist" Jul 22 18:20:14.941751 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.941725 2554 scope.go:117] "RemoveContainer" containerID="99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a" Jul 22 18:20:14.941983 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:20:14.941968 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a\": container with ID starting with 99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a not found: ID does not exist" containerID="99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a" Jul 22 18:20:14.942017 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.941991 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a"} err="failed to get container status \"99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a\": rpc error: code = NotFound desc = could not find container \"99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a\": container with ID starting with 99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a not found: ID does not exist" Jul 22 18:20:14.942017 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.942006 2554 scope.go:117] "RemoveContainer" containerID="aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7" Jul 22 18:20:14.942236 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:20:14.942220 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7\": container with ID starting with aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7 not found: ID does not exist" containerID="aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7" Jul 22 18:20:14.942288 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.942242 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7"} err="failed to get container status \"aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7\": rpc error: code = NotFound desc = could not find container \"aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7\": container with ID starting with aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7 not found: ID does not exist" Jul 22 18:20:14.942288 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.942258 2554 scope.go:117] "RemoveContainer" containerID="d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739" Jul 22 18:20:14.942455 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:20:14.942441 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739\": container with ID starting with d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739 not found: ID does not exist" containerID="d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739" Jul 22 18:20:14.942496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.942458 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739"} err="failed to get container status \"d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739\": rpc error: code = NotFound desc = could not find container \"d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739\": container with ID starting with d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739 not found: ID does not exist" Jul 22 18:20:14.942496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.942469 2554 scope.go:117] "RemoveContainer" containerID="335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d" Jul 22 18:20:14.942679 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:20:14.942660 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d\": container with ID starting with 335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d not found: ID does not exist" containerID="335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d" Jul 22 18:20:14.942748 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.942688 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d"} err="failed to get container status \"335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d\": rpc error: code = NotFound desc = could not find container \"335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d\": container with ID starting with 335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d not found: ID does not exist" Jul 22 18:20:14.942748 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.942709 2554 scope.go:117] "RemoveContainer" containerID="0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298" Jul 22 18:20:14.942938 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:20:14.942920 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298\": container with ID starting with 0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298 not found: ID does not exist" containerID="0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298" Jul 22 18:20:14.942978 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.942942 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298"} err="failed to get container status \"0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298\": rpc error: code = NotFound desc = could not find container \"0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298\": container with ID starting with 0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298 not found: ID does not exist" Jul 22 18:20:14.942978 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.942955 2554 scope.go:117] "RemoveContainer" containerID="4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b" Jul 22 18:20:14.943147 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:20:14.943132 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b\": container with ID starting with 4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b not found: ID does not exist" containerID="4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b" Jul 22 18:20:14.943189 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.943150 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b"} err="failed to get container status \"4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b\": rpc error: code = NotFound desc = could not find container \"4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b\": container with ID starting with 4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b not found: ID does not exist" Jul 22 18:20:14.943189 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.943162 2554 scope.go:117] "RemoveContainer" containerID="10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315" Jul 22 18:20:14.943399 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.943368 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315"} err="failed to get container status \"10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315\": rpc error: code = NotFound desc = could not find container \"10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315\": container with ID starting with 10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315 not found: ID does not exist" Jul 22 18:20:14.943399 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.943387 2554 scope.go:117] "RemoveContainer" containerID="99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a" Jul 22 18:20:14.944125 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.944103 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a"} err="failed to get container status \"99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a\": rpc error: code = NotFound desc = could not find container \"99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a\": container with ID starting with 99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a not found: ID does not exist" Jul 22 18:20:14.944178 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.944128 2554 scope.go:117] "RemoveContainer" containerID="aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7" Jul 22 18:20:14.944326 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.944309 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:14.944485 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.944348 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7"} err="failed to get container status \"aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7\": rpc error: code = NotFound desc = could not find container \"aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7\": container with ID starting with aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7 not found: ID does not exist" Jul 22 18:20:14.944485 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.944367 2554 scope.go:117] "RemoveContainer" containerID="d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739" Jul 22 18:20:14.944892 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.944867 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739"} err="failed to get container status \"d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739\": rpc error: code = NotFound desc = could not find container \"d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739\": container with ID starting with d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739 not found: ID does not exist" Jul 22 18:20:14.944980 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.944894 2554 scope.go:117] "RemoveContainer" containerID="335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d" Jul 22 18:20:14.945157 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.945138 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d"} err="failed to get container status \"335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d\": rpc error: code = NotFound desc = could not find container \"335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d\": container with ID starting with 335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d not found: ID does not exist" Jul 22 18:20:14.945234 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.945158 2554 scope.go:117] "RemoveContainer" containerID="0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298" Jul 22 18:20:14.945448 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.945401 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298"} err="failed to get container status \"0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298\": rpc error: code = NotFound desc = could not find container \"0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298\": container with ID starting with 0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298 not found: ID does not exist" Jul 22 18:20:14.945504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.945450 2554 scope.go:117] "RemoveContainer" containerID="4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b" Jul 22 18:20:14.945709 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.945689 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b"} err="failed to get container status \"4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b\": rpc error: code = NotFound desc = could not find container \"4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b\": container with ID starting with 4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b not found: ID does not exist" Jul 22 18:20:14.945788 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.945713 2554 scope.go:117] "RemoveContainer" containerID="10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315" Jul 22 18:20:14.945938 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.945918 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315"} err="failed to get container status \"10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315\": rpc error: code = NotFound desc = could not find container \"10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315\": container with ID starting with 10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315 not found: ID does not exist" Jul 22 18:20:14.946017 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.945939 2554 scope.go:117] "RemoveContainer" containerID="99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a" Jul 22 18:20:14.946174 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.946152 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a"} err="failed to get container status \"99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a\": rpc error: code = NotFound desc = could not find container \"99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a\": container with ID starting with 99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a not found: ID does not exist" Jul 22 18:20:14.946218 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.946178 2554 scope.go:117] "RemoveContainer" containerID="aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7" Jul 22 18:20:14.946393 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.946373 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7"} err="failed to get container status \"aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7\": rpc error: code = NotFound desc = could not find container \"aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7\": container with ID starting with aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7 not found: ID does not exist" Jul 22 18:20:14.946472 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.946394 2554 scope.go:117] "RemoveContainer" containerID="d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739" Jul 22 18:20:14.946657 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.946631 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739"} err="failed to get container status \"d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739\": rpc error: code = NotFound desc = could not find container \"d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739\": container with ID starting with d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739 not found: ID does not exist" Jul 22 18:20:14.946717 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.946660 2554 scope.go:117] "RemoveContainer" containerID="335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d" Jul 22 18:20:14.946896 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.946873 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d"} err="failed to get container status \"335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d\": rpc error: code = NotFound desc = could not find container \"335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d\": container with ID starting with 335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d not found: ID does not exist" Jul 22 18:20:14.946982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.946898 2554 scope.go:117] "RemoveContainer" containerID="0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298" Jul 22 18:20:14.947081 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.947066 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qztjh\"" Jul 22 18:20:14.947155 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.947126 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298"} err="failed to get container status \"0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298\": rpc error: code = NotFound desc = could not find container \"0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298\": container with ID starting with 0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298 not found: ID does not exist" Jul 22 18:20:14.947155 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.947149 2554 scope.go:117] "RemoveContainer" containerID="4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b" Jul 22 18:20:14.947494 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.947460 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 22 18:20:14.947494 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.947493 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 22 18:20:14.947646 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.947460 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-funj1692le4ul\"" Jul 22 18:20:14.947646 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.947578 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 22 18:20:14.947646 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.947460 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b"} err="failed to get container status \"4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b\": rpc error: code = NotFound desc = could not find container \"4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b\": container with ID starting with 4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b not found: ID does not exist" Jul 22 18:20:14.947646 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.947602 2554 scope.go:117] "RemoveContainer" containerID="10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315" Jul 22 18:20:14.947841 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.947826 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 22 18:20:14.947910 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.947845 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 22 18:20:14.948003 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.947978 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315"} err="failed to get container status \"10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315\": rpc error: code = NotFound desc = could not find container \"10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315\": container with ID starting with 10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315 not found: ID does not exist" Jul 22 18:20:14.948003 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.948004 2554 scope.go:117] "RemoveContainer" containerID="99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a" Jul 22 18:20:14.948240 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.948068 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 22 18:20:14.948240 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.948075 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 22 18:20:14.948240 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.948082 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 22 18:20:14.948388 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.948265 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a"} err="failed to get container status \"99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a\": rpc error: code = NotFound desc = could not find container \"99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a\": container with ID starting with 99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a not found: ID does not exist" Jul 22 18:20:14.948388 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.948304 2554 scope.go:117] "RemoveContainer" containerID="aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7" Jul 22 18:20:14.948388 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.948359 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 22 18:20:14.948625 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.948569 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7"} err="failed to get container status \"aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7\": rpc error: code = NotFound desc = could not find container \"aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7\": container with ID starting with aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7 not found: ID does not exist" Jul 22 18:20:14.948625 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.948585 2554 scope.go:117] "RemoveContainer" containerID="d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739" Jul 22 18:20:14.948818 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.948694 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 22 18:20:14.948877 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.948833 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739"} err="failed to get container status \"d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739\": rpc error: code = NotFound desc = could not find container \"d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739\": container with ID starting with d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739 not found: ID does not exist" Jul 22 18:20:14.948877 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.948857 2554 scope.go:117] "RemoveContainer" containerID="335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d" Jul 22 18:20:14.949035 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.948976 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 22 18:20:14.949035 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.948991 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 22 18:20:14.949351 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.949332 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d"} err="failed to get container status \"335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d\": rpc error: code = NotFound desc = could not find container \"335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d\": container with ID starting with 335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d not found: ID does not exist" Jul 22 18:20:14.949442 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.949351 2554 scope.go:117] "RemoveContainer" containerID="0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298" Jul 22 18:20:14.949630 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.949609 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298"} err="failed to get container status \"0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298\": rpc error: code = NotFound desc = could not find container \"0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298\": container with ID starting with 0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298 not found: ID does not exist" Jul 22 18:20:14.949630 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.949628 2554 scope.go:117] "RemoveContainer" containerID="4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b" Jul 22 18:20:14.949902 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.949873 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b"} err="failed to get container status \"4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b\": rpc error: code = NotFound desc = could not find container \"4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b\": container with ID starting with 4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b not found: ID does not exist" Jul 22 18:20:14.950021 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.949905 2554 scope.go:117] "RemoveContainer" containerID="10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315" Jul 22 18:20:14.950212 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.950192 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315"} err="failed to get container status \"10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315\": rpc error: code = NotFound desc = could not find container \"10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315\": container with ID starting with 10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315 not found: ID does not exist" Jul 22 18:20:14.950212 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.950224 2554 scope.go:117] "RemoveContainer" containerID="99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a" Jul 22 18:20:14.950528 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.950502 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a"} err="failed to get container status \"99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a\": rpc error: code = NotFound desc = could not find container \"99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a\": container with ID starting with 99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a not found: ID does not exist" Jul 22 18:20:14.950528 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.950527 2554 scope.go:117] "RemoveContainer" containerID="aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7" Jul 22 18:20:14.950877 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.950844 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7"} err="failed to get container status \"aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7\": rpc error: code = NotFound desc = could not find container \"aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7\": container with ID starting with aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7 not found: ID does not exist" Jul 22 18:20:14.950877 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.950866 2554 scope.go:117] "RemoveContainer" containerID="d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739" Jul 22 18:20:14.951125 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.951082 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 22 18:20:14.951196 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.951120 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739"} err="failed to get container status \"d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739\": rpc error: code = NotFound desc = could not find container \"d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739\": container with ID starting with d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739 not found: ID does not exist" Jul 22 18:20:14.951196 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.951138 2554 scope.go:117] "RemoveContainer" containerID="335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d" Jul 22 18:20:14.951487 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.951461 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d"} err="failed to get container status \"335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d\": rpc error: code = NotFound desc = could not find container \"335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d\": container with ID starting with 335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d not found: ID does not exist" Jul 22 18:20:14.951583 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.951489 2554 scope.go:117] "RemoveContainer" containerID="0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298" Jul 22 18:20:14.951800 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.951779 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298"} err="failed to get container status \"0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298\": rpc error: code = NotFound desc = could not find container \"0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298\": container with ID starting with 0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298 not found: ID does not exist" Jul 22 18:20:14.951859 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.951801 2554 scope.go:117] "RemoveContainer" containerID="4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b" Jul 22 18:20:14.952064 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.952041 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b"} err="failed to get container status \"4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b\": rpc error: code = NotFound desc = could not find container \"4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b\": container with ID starting with 4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b not found: ID does not exist" Jul 22 18:20:14.952064 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.952065 2554 scope.go:117] "RemoveContainer" containerID="10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315" Jul 22 18:20:14.952282 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.952259 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315"} err="failed to get container status \"10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315\": rpc error: code = NotFound desc = could not find container \"10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315\": container with ID starting with 10e98256b54f496aab801e17679577e8c706a8e2e44f8abfce1f9bd7e32fe315 not found: ID does not exist" Jul 22 18:20:14.952352 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.952284 2554 scope.go:117] "RemoveContainer" containerID="99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a" Jul 22 18:20:14.952833 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.952708 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a"} err="failed to get container status \"99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a\": rpc error: code = NotFound desc = could not find container \"99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a\": container with ID starting with 99abf8e63dace419f7c24377ddda86c3793590fbfed98ceb9c62f23262472a9a not found: ID does not exist" Jul 22 18:20:14.952833 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.952746 2554 scope.go:117] "RemoveContainer" containerID="aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7" Jul 22 18:20:14.953068 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.953046 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7"} err="failed to get container status \"aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7\": rpc error: code = NotFound desc = could not find container \"aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7\": container with ID starting with aca968bd703386faa2849f39760c2f4ba2aae53382753be5cf610f8f100631b7 not found: ID does not exist" Jul 22 18:20:14.953133 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.953068 2554 scope.go:117] "RemoveContainer" containerID="d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739" Jul 22 18:20:14.953305 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.953275 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 22 18:20:14.953305 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.953292 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739"} err="failed to get container status \"d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739\": rpc error: code = NotFound desc = could not find container \"d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739\": container with ID starting with d733462ffc756bd79a7a20f000355b205487188fe734a4122425973084ada739 not found: ID does not exist" Jul 22 18:20:14.953408 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.953314 2554 scope.go:117] "RemoveContainer" containerID="335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d" Jul 22 18:20:14.953660 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.953643 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d"} err="failed to get container status \"335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d\": rpc error: code = NotFound desc = could not find container \"335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d\": container with ID starting with 335f9adcc02a4d443ef6b93883811235e3f7213215fb8263c6943fb9481b0d6d not found: ID does not exist" Jul 22 18:20:14.953708 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.953662 2554 scope.go:117] "RemoveContainer" containerID="0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298" Jul 22 18:20:14.953908 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.953892 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298"} err="failed to get container status \"0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298\": rpc error: code = NotFound desc = could not find container \"0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298\": container with ID starting with 0817de03668cf6a75523af0443ed31854b3d475c1915d1f498148e0b89102298 not found: ID does not exist" Jul 22 18:20:14.953908 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.953908 2554 scope.go:117] "RemoveContainer" containerID="4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b" Jul 22 18:20:14.954136 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.954121 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b"} err="failed to get container status \"4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b\": rpc error: code = NotFound desc = could not find container \"4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b\": container with ID starting with 4a9bb6d384ae0750a3e21767f6438bf0f734efcc43c4b6de795f685892d88a1b not found: ID does not exist" Jul 22 18:20:14.962794 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:14.962762 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 18:20:15.035361 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.035326 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.035361 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.035363 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98h4t\" (UniqueName: \"kubernetes.io/projected/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-kube-api-access-98h4t\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.035646 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.035382 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-config-out\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.035646 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.035411 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.035646 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.035462 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.035646 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.035480 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.035646 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.035494 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.035646 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.035576 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.035646 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.035609 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.035646 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.035642 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.036037 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.035685 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-web-config\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.036037 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.035709 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.036037 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.035735 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.036037 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.035783 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.036037 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.035851 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.036037 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.035875 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.036037 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.035905 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.036037 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.035930 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.036037 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.035956 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.036037 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.036011 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-config\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.136531 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.136494 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.136710 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.136547 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.136710 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.136576 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.136710 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.136605 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.136710 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.136630 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.136870 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.136768 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.136870 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.136828 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-config\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.136969 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.136872 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.136969 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.136901 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98h4t\" (UniqueName: \"kubernetes.io/projected/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-kube-api-access-98h4t\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.136969 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.136930 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-config-out\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.136969 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.136953 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.137166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.136983 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.137166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.137006 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.137166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.137027 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.137166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.137067 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.137166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.137091 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.137166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.137122 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.137496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.137169 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-web-config\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.137496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.137195 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.137496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.137224 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.137496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.137353 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.137496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.137378 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.137496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.137379 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.138045 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.137938 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.140624 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.140183 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.140624 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.140458 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.140624 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.140470 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-web-config\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.140624 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.140509 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.140624 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.140533 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.140624 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.140566 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-config\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.141005 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.140699 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.141063 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.141032 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.141199 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.141175 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.141734 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.141578 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-config-out\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.141734 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.141697 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.142449 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.142403 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.143511 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.143487 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.143579 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.143511 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.143629 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.143599 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.145269 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.145253 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98h4t\" (UniqueName: \"kubernetes.io/projected/d6903f5d-2e4c-4df5-bc19-5ee5e4693998-kube-api-access-98h4t\") pod \"prometheus-k8s-0\" (UID: \"d6903f5d-2e4c-4df5-bc19-5ee5e4693998\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.255392 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.255357 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:15.401487 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.401454 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 22 18:20:15.405172 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:20:15.405141 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6903f5d_2e4c_4df5_bc19_5ee5e4693998.slice/crio-3e368ff7e1990afc622a632e8725c369a21b8846a5347d4e1c55a3363d1d84a5 WatchSource:0}: Error finding container 3e368ff7e1990afc622a632e8725c369a21b8846a5347d4e1c55a3363d1d84a5: Status 404 returned error can't find the container with id 3e368ff7e1990afc622a632e8725c369a21b8846a5347d4e1c55a3363d1d84a5 Jul 22 18:20:15.890077 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.890039 2554 generic.go:356] "Generic (PLEG): container finished" podID="d6903f5d-2e4c-4df5-bc19-5ee5e4693998" containerID="3742f23b9c30ac3b03b3141de8afc401bd2fa002628fdeeb9cba4e6a974a7f1f" exitCode=0 Jul 22 18:20:15.890274 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.890124 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6903f5d-2e4c-4df5-bc19-5ee5e4693998","Type":"ContainerDied","Data":"3742f23b9c30ac3b03b3141de8afc401bd2fa002628fdeeb9cba4e6a974a7f1f"} Jul 22 18:20:15.890274 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:15.890204 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6903f5d-2e4c-4df5-bc19-5ee5e4693998","Type":"ContainerStarted","Data":"3e368ff7e1990afc622a632e8725c369a21b8846a5347d4e1c55a3363d1d84a5"} Jul 22 18:20:16.546460 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:16.546404 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4876d458-354c-4057-88e4-9d52cf5e5d6b" path="/var/lib/kubelet/pods/4876d458-354c-4057-88e4-9d52cf5e5d6b/volumes" Jul 22 18:20:16.898482 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:16.898364 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6903f5d-2e4c-4df5-bc19-5ee5e4693998","Type":"ContainerStarted","Data":"88b95cfecea6bcc53b962cccf61194125db3e28536e9d4663cd88aca90b3616f"} Jul 22 18:20:16.898482 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:16.898467 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6903f5d-2e4c-4df5-bc19-5ee5e4693998","Type":"ContainerStarted","Data":"6ce0e755f62c1fce7eb9fc6c03b1a09d8a897670684c64ea61dd3b95f1c8eafc"} Jul 22 18:20:16.898691 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:16.898540 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6903f5d-2e4c-4df5-bc19-5ee5e4693998","Type":"ContainerStarted","Data":"b07db53588abdf45471f7e78115a59d0f7aa06640e481146fcc8f612f2a3ea42"} Jul 22 18:20:16.898691 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:16.898578 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6903f5d-2e4c-4df5-bc19-5ee5e4693998","Type":"ContainerStarted","Data":"11cbd69e1364717be445f61fff187bbc9b2d99bc521fc354502a8f0b5fdd51f7"} Jul 22 18:20:16.898691 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:16.898613 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6903f5d-2e4c-4df5-bc19-5ee5e4693998","Type":"ContainerStarted","Data":"8a5cfd950bab15243887e721381a4be08f67fd90ffbc9bcec493ebbe7ff78cfd"} Jul 22 18:20:16.898691 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:16.898650 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d6903f5d-2e4c-4df5-bc19-5ee5e4693998","Type":"ContainerStarted","Data":"5fcae9ff3c8cbfe83fcf70cfb1ae16d59d8e19029ade6217f7b78c0af6f99d3d"} Jul 22 18:20:16.931649 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:16.931591 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.912837107 podStartE2EDuration="2.931574414s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.737307ms" isStatefulPod=false podCreationTimestamp="2026-07-22 18:20:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:20:16.927849215 +0000 UTC m=+372.852744232" watchObservedRunningTime="2026-07-22 18:20:16.931574414 +0000 UTC m=+372.856469431" Jul 22 18:20:17.868224 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:17.868187 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:20:17.925288 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:17.925253 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:20:18.271170 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:18.271135 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs\") pod \"network-metrics-daemon-tbzjc\" (UID: \"6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57\") " pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:20:18.273608 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:18.273579 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57-metrics-certs\") pod \"network-metrics-daemon-tbzjc\" (UID: \"6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57\") " pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:20:18.343935 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:18.343906 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vjc8f\"" Jul 22 18:20:18.351941 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:18.351915 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbzjc" Jul 22 18:20:18.480535 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:18.480504 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tbzjc"] Jul 22 18:20:18.483770 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:20:18.483738 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b49af7a_b8a8_4675_bbf2_f2ffe9f28a57.slice/crio-f5d2359ea912d878e4ffb783170460768da9dc94a3821fe5a0105e0610c747a7 WatchSource:0}: Error finding container f5d2359ea912d878e4ffb783170460768da9dc94a3821fe5a0105e0610c747a7: Status 404 returned error can't find the container with id f5d2359ea912d878e4ffb783170460768da9dc94a3821fe5a0105e0610c747a7 Jul 22 18:20:18.906091 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:18.906058 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tbzjc" event={"ID":"6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57","Type":"ContainerStarted","Data":"f5d2359ea912d878e4ffb783170460768da9dc94a3821fe5a0105e0610c747a7"} Jul 22 18:20:20.256122 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:20.256085 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:20:20.915830 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:20.915748 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tbzjc" event={"ID":"6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57","Type":"ContainerStarted","Data":"2841c947e567db6755daddfc584b8e863d51c233fde9e23551ee42063e0f6eca"} Jul 22 18:20:20.915830 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:20.915798 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tbzjc" event={"ID":"6b49af7a-b8a8-4675-bbf2-f2ffe9f28a57","Type":"ContainerStarted","Data":"98e94d65a3c3a6953939f0625610baac75ce34add256caa913f59cacfb43a73f"} Jul 22 18:20:20.932701 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:20.932652 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tbzjc" podStartSLOduration=373.958592887 podStartE2EDuration="6m15.932635734s" totalImagesPullingTime="1.974042847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:14:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:20:20.931359441 +0000 UTC m=+376.856254460" watchObservedRunningTime="2026-07-22 18:20:20.932635734 +0000 UTC m=+376.857530751" Jul 22 18:20:21.037490 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:21.037462 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:20:21.092284 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:21.092256 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:20:21.624943 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:21.624911 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:20:21.685554 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:21.685524 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:20:22.178305 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:22.178276 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:20:22.229982 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:22.229949 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:20:29.671235 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:29.671199 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:20:29.773977 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:29.773942 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:20:32.724690 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:32.724657 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:20:32.776375 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:32.776326 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:20:32.835952 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:32.835919 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:20:58.112889 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:58.112858 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:20:58.215565 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:20:58.215533 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:05.807599 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:05.807545 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:09.377434 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:09.377384 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:09.462618 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:09.462585 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:15.255765 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:15.255728 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:21:15.272185 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:15.272160 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:21:16.140540 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:16.140507 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 22 18:21:29.040645 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:29.040538 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:36.100411 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:36.100374 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:36.941974 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:36.941938 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:39.716997 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:39.716959 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:39.817688 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:39.817650 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:41.088868 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:41.088831 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:41.189916 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:41.189879 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:41.309727 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:41.309689 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:41.483490 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:41.483399 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:43.300274 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:43.300234 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:43.902645 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:43.902595 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:46.505652 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:46.505613 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:46.605681 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:46.605649 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:50.123150 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:50.123115 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:50.221535 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:50.221504 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:51.733066 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:51.733028 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:55.693765 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:55.693719 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:55.801856 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:55.801825 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:57.300364 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:57.300333 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:57.413186 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:57.413157 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:21:58.492820 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:21:58.492784 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:20.812902 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:20.812871 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:20.919137 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:20.919103 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:22.327241 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:22.327208 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:22.414965 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:22.414921 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:22.929813 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:22.929767 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:23.210477 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.210395 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:23.314544 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.314518 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:23.346786 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.346754 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q"] Jul 22 18:22:23.350163 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.350139 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" Jul 22 18:22:23.355149 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.355130 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 22 18:22:23.356621 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.356499 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-wz8qr\"" Jul 22 18:22:23.365452 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.365408 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 22 18:22:23.366603 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.366581 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 22 18:22:23.371535 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.371519 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 22 18:22:23.381834 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.381810 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q"] Jul 22 18:22:23.519916 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.519881 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41688e46-a79d-4770-a7ed-438f0893c8d7-tmp\") pod \"opendatahub-operator-controller-manager-549865fcdf-f2l5q\" (UID: \"41688e46-a79d-4770-a7ed-438f0893c8d7\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" Jul 22 18:22:23.520089 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.519922 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41688e46-a79d-4770-a7ed-438f0893c8d7-webhook-cert\") pod \"opendatahub-operator-controller-manager-549865fcdf-f2l5q\" (UID: \"41688e46-a79d-4770-a7ed-438f0893c8d7\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" Jul 22 18:22:23.520089 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.519981 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41688e46-a79d-4770-a7ed-438f0893c8d7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-549865fcdf-f2l5q\" (UID: \"41688e46-a79d-4770-a7ed-438f0893c8d7\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" Jul 22 18:22:23.520089 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.520048 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdmfw\" (UniqueName: \"kubernetes.io/projected/41688e46-a79d-4770-a7ed-438f0893c8d7-kube-api-access-hdmfw\") pod \"opendatahub-operator-controller-manager-549865fcdf-f2l5q\" (UID: \"41688e46-a79d-4770-a7ed-438f0893c8d7\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" Jul 22 18:22:23.520089 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.520069 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/41688e46-a79d-4770-a7ed-438f0893c8d7-manifests\") pod \"opendatahub-operator-controller-manager-549865fcdf-f2l5q\" (UID: \"41688e46-a79d-4770-a7ed-438f0893c8d7\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" Jul 22 18:22:23.539475 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.539447 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:23.620517 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.620480 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdmfw\" (UniqueName: \"kubernetes.io/projected/41688e46-a79d-4770-a7ed-438f0893c8d7-kube-api-access-hdmfw\") pod \"opendatahub-operator-controller-manager-549865fcdf-f2l5q\" (UID: \"41688e46-a79d-4770-a7ed-438f0893c8d7\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" Jul 22 18:22:23.620517 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.620519 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/41688e46-a79d-4770-a7ed-438f0893c8d7-manifests\") pod \"opendatahub-operator-controller-manager-549865fcdf-f2l5q\" (UID: \"41688e46-a79d-4770-a7ed-438f0893c8d7\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" Jul 22 18:22:23.620755 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.620571 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41688e46-a79d-4770-a7ed-438f0893c8d7-tmp\") pod \"opendatahub-operator-controller-manager-549865fcdf-f2l5q\" (UID: \"41688e46-a79d-4770-a7ed-438f0893c8d7\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" Jul 22 18:22:23.620755 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.620598 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41688e46-a79d-4770-a7ed-438f0893c8d7-webhook-cert\") pod \"opendatahub-operator-controller-manager-549865fcdf-f2l5q\" (UID: \"41688e46-a79d-4770-a7ed-438f0893c8d7\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" Jul 22 18:22:23.620755 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.620632 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41688e46-a79d-4770-a7ed-438f0893c8d7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-549865fcdf-f2l5q\" (UID: \"41688e46-a79d-4770-a7ed-438f0893c8d7\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" Jul 22 18:22:23.620954 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.620930 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/41688e46-a79d-4770-a7ed-438f0893c8d7-manifests\") pod \"opendatahub-operator-controller-manager-549865fcdf-f2l5q\" (UID: \"41688e46-a79d-4770-a7ed-438f0893c8d7\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" Jul 22 18:22:23.623078 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.623053 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/41688e46-a79d-4770-a7ed-438f0893c8d7-tmp\") pod \"opendatahub-operator-controller-manager-549865fcdf-f2l5q\" (UID: \"41688e46-a79d-4770-a7ed-438f0893c8d7\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" Jul 22 18:22:23.623195 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.623180 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/41688e46-a79d-4770-a7ed-438f0893c8d7-webhook-cert\") pod \"opendatahub-operator-controller-manager-549865fcdf-f2l5q\" (UID: \"41688e46-a79d-4770-a7ed-438f0893c8d7\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" Jul 22 18:22:23.623348 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.623329 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/41688e46-a79d-4770-a7ed-438f0893c8d7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-549865fcdf-f2l5q\" (UID: \"41688e46-a79d-4770-a7ed-438f0893c8d7\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" Jul 22 18:22:23.629102 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.629082 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdmfw\" (UniqueName: \"kubernetes.io/projected/41688e46-a79d-4770-a7ed-438f0893c8d7-kube-api-access-hdmfw\") pod \"opendatahub-operator-controller-manager-549865fcdf-f2l5q\" (UID: \"41688e46-a79d-4770-a7ed-438f0893c8d7\") " pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" Jul 22 18:22:23.640520 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.640495 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:23.659572 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.659542 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" Jul 22 18:22:23.741429 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.741377 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:23.796017 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.795994 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q"] Jul 22 18:22:23.799055 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:22:23.799023 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41688e46_a79d_4770_a7ed_438f0893c8d7.slice/crio-f8e3d7f63ef1480f9cd4dbc0d563d69d827485474cfd9520da1afa789c9076d1 WatchSource:0}: Error finding container f8e3d7f63ef1480f9cd4dbc0d563d69d827485474cfd9520da1afa789c9076d1: Status 404 returned error can't find the container with id f8e3d7f63ef1480f9cd4dbc0d563d69d827485474cfd9520da1afa789c9076d1 Jul 22 18:22:23.837368 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.837337 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:23.896777 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.896729 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:23.998269 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:23.998238 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:24.101110 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:24.101032 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:24.381024 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:24.380943 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" event={"ID":"41688e46-a79d-4770-a7ed-438f0893c8d7","Type":"ContainerStarted","Data":"f8e3d7f63ef1480f9cd4dbc0d563d69d827485474cfd9520da1afa789c9076d1"} Jul 22 18:22:27.396844 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:27.396809 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" event={"ID":"41688e46-a79d-4770-a7ed-438f0893c8d7","Type":"ContainerStarted","Data":"abad6684b6e987defe86cccfb9db114f25d5019f6f695b9a1d94508b6adde559"} Jul 22 18:22:28.403263 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:28.403231 2554 generic.go:356] "Generic (PLEG): container finished" podID="41688e46-a79d-4770-a7ed-438f0893c8d7" containerID="abad6684b6e987defe86cccfb9db114f25d5019f6f695b9a1d94508b6adde559" exitCode=0 Jul 22 18:22:28.403707 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:28.403282 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" event={"ID":"41688e46-a79d-4770-a7ed-438f0893c8d7","Type":"ContainerDied","Data":"abad6684b6e987defe86cccfb9db114f25d5019f6f695b9a1d94508b6adde559"} Jul 22 18:22:29.409991 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:29.409905 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" event={"ID":"41688e46-a79d-4770-a7ed-438f0893c8d7","Type":"ContainerStarted","Data":"6e570320bb78e8148d77199d82220aba1ee4d1a813f052fe83d451d117a01cf2"} Jul 22 18:22:29.410401 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:29.410049 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" Jul 22 18:22:29.434243 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:29.434188 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" podStartSLOduration=1.314181657 podStartE2EDuration="6.434172988s" totalImagesPullingTime="4.047248966s" totalInitContainerRuntime="1.072742365s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:22:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:22:29.432971583 +0000 UTC m=+505.357866602" watchObservedRunningTime="2026-07-22 18:22:29.434172988 +0000 UTC m=+505.359068006" Jul 22 18:22:35.008219 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:35.008188 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:35.114401 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:35.114360 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:40.416890 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:40.416856 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-549865fcdf-f2l5q" Jul 22 18:22:42.924013 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:42.923976 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:43.034977 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:43.034939 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:43.552472 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:43.552436 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:43.712606 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:43.712576 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:43.794364 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:43.794334 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:43.896249 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:43.896165 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:43.996513 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:43.996483 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:44.340713 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:44.340681 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:44.621170 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:44.621084 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:44.880102 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:44.880013 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:44.982371 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:44.982339 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:45.042731 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:45.042698 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:45.873541 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:45.873491 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:51.276662 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.276627 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:51.383005 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.382974 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:51.653830 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.653743 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd"] Jul 22 18:22:51.668389 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.668361 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd" Jul 22 18:22:51.670874 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.670845 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd"] Jul 22 18:22:51.672623 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.672601 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 22 18:22:51.672803 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.672601 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 22 18:22:51.672803 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.672608 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 22 18:22:51.672977 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.672615 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-dlwn8\"" Jul 22 18:22:51.672977 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.672625 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 22 18:22:51.672977 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.672686 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 22 18:22:51.761031 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.760995 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d07c8ea0-3502-4e0f-8f2c-157365147b2e-cert\") pod \"lws-controller-manager-7b479b546f-26gvd\" (UID: \"d07c8ea0-3502-4e0f-8f2c-157365147b2e\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd" Jul 22 18:22:51.761248 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.761046 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljsqd\" (UniqueName: \"kubernetes.io/projected/d07c8ea0-3502-4e0f-8f2c-157365147b2e-kube-api-access-ljsqd\") pod \"lws-controller-manager-7b479b546f-26gvd\" (UID: \"d07c8ea0-3502-4e0f-8f2c-157365147b2e\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd" Jul 22 18:22:51.761248 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.761135 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d07c8ea0-3502-4e0f-8f2c-157365147b2e-metrics-cert\") pod \"lws-controller-manager-7b479b546f-26gvd\" (UID: \"d07c8ea0-3502-4e0f-8f2c-157365147b2e\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd" Jul 22 18:22:51.761248 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.761201 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d07c8ea0-3502-4e0f-8f2c-157365147b2e-manager-config\") pod \"lws-controller-manager-7b479b546f-26gvd\" (UID: \"d07c8ea0-3502-4e0f-8f2c-157365147b2e\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd" Jul 22 18:22:51.861903 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.861865 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d07c8ea0-3502-4e0f-8f2c-157365147b2e-manager-config\") pod \"lws-controller-manager-7b479b546f-26gvd\" (UID: \"d07c8ea0-3502-4e0f-8f2c-157365147b2e\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd" Jul 22 18:22:51.862100 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.861923 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d07c8ea0-3502-4e0f-8f2c-157365147b2e-cert\") pod \"lws-controller-manager-7b479b546f-26gvd\" (UID: \"d07c8ea0-3502-4e0f-8f2c-157365147b2e\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd" Jul 22 18:22:51.862100 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.861972 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljsqd\" (UniqueName: \"kubernetes.io/projected/d07c8ea0-3502-4e0f-8f2c-157365147b2e-kube-api-access-ljsqd\") pod \"lws-controller-manager-7b479b546f-26gvd\" (UID: \"d07c8ea0-3502-4e0f-8f2c-157365147b2e\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd" Jul 22 18:22:51.862100 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.862006 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d07c8ea0-3502-4e0f-8f2c-157365147b2e-metrics-cert\") pod \"lws-controller-manager-7b479b546f-26gvd\" (UID: \"d07c8ea0-3502-4e0f-8f2c-157365147b2e\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd" Jul 22 18:22:51.862718 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.862698 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d07c8ea0-3502-4e0f-8f2c-157365147b2e-manager-config\") pod \"lws-controller-manager-7b479b546f-26gvd\" (UID: \"d07c8ea0-3502-4e0f-8f2c-157365147b2e\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd" Jul 22 18:22:51.864617 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.864598 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d07c8ea0-3502-4e0f-8f2c-157365147b2e-metrics-cert\") pod \"lws-controller-manager-7b479b546f-26gvd\" (UID: \"d07c8ea0-3502-4e0f-8f2c-157365147b2e\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd" Jul 22 18:22:51.864702 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.864651 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d07c8ea0-3502-4e0f-8f2c-157365147b2e-cert\") pod \"lws-controller-manager-7b479b546f-26gvd\" (UID: \"d07c8ea0-3502-4e0f-8f2c-157365147b2e\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd" Jul 22 18:22:51.874717 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.874690 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljsqd\" (UniqueName: \"kubernetes.io/projected/d07c8ea0-3502-4e0f-8f2c-157365147b2e-kube-api-access-ljsqd\") pod \"lws-controller-manager-7b479b546f-26gvd\" (UID: \"d07c8ea0-3502-4e0f-8f2c-157365147b2e\") " pod="openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd" Jul 22 18:22:51.979592 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:51.979489 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd" Jul 22 18:22:52.016885 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.016848 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225"] Jul 22 18:22:52.025117 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.025082 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.028721 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.028521 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 22 18:22:52.029188 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.029166 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-pzlnt\"" Jul 22 18:22:52.029953 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.029559 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 22 18:22:52.029953 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.029570 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 22 18:22:52.052840 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.049632 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225"] Jul 22 18:22:52.065343 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.064234 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:52.155604 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.155577 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd"] Jul 22 18:22:52.158009 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:22:52.157978 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd07c8ea0_3502_4e0f_8f2c_157365147b2e.slice/crio-2b910fb6b3d6163288444d847aa9ecb7ae9d41a58e7d860fddfd7d79281afb0c WatchSource:0}: Error finding container 2b910fb6b3d6163288444d847aa9ecb7ae9d41a58e7d860fddfd7d79281afb0c: Status 404 returned error can't find the container with id 2b910fb6b3d6163288444d847aa9ecb7ae9d41a58e7d860fddfd7d79281afb0c Jul 22 18:22:52.165545 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.165523 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6d42110-5189-4edb-b028-491740b40f60-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.165679 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.165597 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6d42110-5189-4edb-b028-491740b40f60-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.165679 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.165629 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6d42110-5189-4edb-b028-491740b40f60-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.165776 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.165688 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6d42110-5189-4edb-b028-491740b40f60-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.165776 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.165714 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tntm5\" (UniqueName: \"kubernetes.io/projected/d6d42110-5189-4edb-b028-491740b40f60-kube-api-access-tntm5\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.165776 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.165758 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6d42110-5189-4edb-b028-491740b40f60-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.165896 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.165780 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6d42110-5189-4edb-b028-491740b40f60-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.165896 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.165860 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6d42110-5189-4edb-b028-491740b40f60-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.165966 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.165916 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6d42110-5189-4edb-b028-491740b40f60-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.266844 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.266806 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6d42110-5189-4edb-b028-491740b40f60-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.267051 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.266849 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6d42110-5189-4edb-b028-491740b40f60-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.267051 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.266983 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6d42110-5189-4edb-b028-491740b40f60-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.267051 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.267017 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6d42110-5189-4edb-b028-491740b40f60-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.267051 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.267044 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6d42110-5189-4edb-b028-491740b40f60-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.267744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.267295 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6d42110-5189-4edb-b028-491740b40f60-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.267744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.267323 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6d42110-5189-4edb-b028-491740b40f60-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.267744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.267353 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6d42110-5189-4edb-b028-491740b40f60-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.267744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.267371 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tntm5\" (UniqueName: \"kubernetes.io/projected/d6d42110-5189-4edb-b028-491740b40f60-kube-api-access-tntm5\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.267744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.267391 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6d42110-5189-4edb-b028-491740b40f60-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.267744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.267439 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6d42110-5189-4edb-b028-491740b40f60-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.267744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.267480 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6d42110-5189-4edb-b028-491740b40f60-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.267744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.267627 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6d42110-5189-4edb-b028-491740b40f60-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.267744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.267689 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6d42110-5189-4edb-b028-491740b40f60-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.269582 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.269562 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6d42110-5189-4edb-b028-491740b40f60-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.270016 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.269994 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6d42110-5189-4edb-b028-491740b40f60-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.282261 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.282234 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6d42110-5189-4edb-b028-491740b40f60-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.283370 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.283348 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tntm5\" (UniqueName: \"kubernetes.io/projected/d6d42110-5189-4edb-b028-491740b40f60-kube-api-access-tntm5\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4vw225\" (UID: \"d6d42110-5189-4edb-b028-491740b40f60\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.344883 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.344850 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:52.489663 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.489640 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225"] Jul 22 18:22:52.491933 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:22:52.491904 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6d42110_5189_4edb_b028_491740b40f60.slice/crio-0ca8e2fa7d4ede5d5d07e57cb0a6a1759a3747355401aadeb78b1723901313bc WatchSource:0}: Error finding container 0ca8e2fa7d4ede5d5d07e57cb0a6a1759a3747355401aadeb78b1723901313bc: Status 404 returned error can't find the container with id 0ca8e2fa7d4ede5d5d07e57cb0a6a1759a3747355401aadeb78b1723901313bc Jul 22 18:22:52.498184 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.498160 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg"] Jul 22 18:22:52.502512 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.502495 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.504904 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.504886 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 22 18:22:52.505284 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.505247 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-rq6tx\"" Jul 22 18:22:52.505284 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.505247 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 22 18:22:52.505564 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.505383 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 22 18:22:52.508647 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.508623 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" event={"ID":"d6d42110-5189-4edb-b028-491740b40f60","Type":"ContainerStarted","Data":"0ca8e2fa7d4ede5d5d07e57cb0a6a1759a3747355401aadeb78b1723901313bc"} Jul 22 18:22:52.509971 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.509945 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd" event={"ID":"d07c8ea0-3502-4e0f-8f2c-157365147b2e","Type":"ContainerStarted","Data":"2b910fb6b3d6163288444d847aa9ecb7ae9d41a58e7d860fddfd7d79281afb0c"} Jul 22 18:22:52.516841 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.516816 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg"] Jul 22 18:22:52.571215 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.571135 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ce810eb-85b2-4431-856b-5a2f9f8d0da1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-t66pg\" (UID: \"7ce810eb-85b2-4431-856b-5a2f9f8d0da1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.571215 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.571175 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7ce810eb-85b2-4431-856b-5a2f9f8d0da1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-t66pg\" (UID: \"7ce810eb-85b2-4431-856b-5a2f9f8d0da1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.571215 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.571198 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7ce810eb-85b2-4431-856b-5a2f9f8d0da1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-t66pg\" (UID: \"7ce810eb-85b2-4431-856b-5a2f9f8d0da1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.571433 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.571289 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7ce810eb-85b2-4431-856b-5a2f9f8d0da1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-t66pg\" (UID: \"7ce810eb-85b2-4431-856b-5a2f9f8d0da1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.571433 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.571312 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7ce810eb-85b2-4431-856b-5a2f9f8d0da1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-t66pg\" (UID: \"7ce810eb-85b2-4431-856b-5a2f9f8d0da1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.571433 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.571343 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpfpl\" (UniqueName: \"kubernetes.io/projected/7ce810eb-85b2-4431-856b-5a2f9f8d0da1-kube-api-access-kpfpl\") pod \"istiod-openshift-gateway-94bb8fbfd-t66pg\" (UID: \"7ce810eb-85b2-4431-856b-5a2f9f8d0da1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.571433 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.571386 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ce810eb-85b2-4431-856b-5a2f9f8d0da1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-t66pg\" (UID: \"7ce810eb-85b2-4431-856b-5a2f9f8d0da1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.672384 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.672349 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7ce810eb-85b2-4431-856b-5a2f9f8d0da1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-t66pg\" (UID: \"7ce810eb-85b2-4431-856b-5a2f9f8d0da1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.672384 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.672388 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7ce810eb-85b2-4431-856b-5a2f9f8d0da1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-t66pg\" (UID: \"7ce810eb-85b2-4431-856b-5a2f9f8d0da1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.672638 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.672459 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpfpl\" (UniqueName: \"kubernetes.io/projected/7ce810eb-85b2-4431-856b-5a2f9f8d0da1-kube-api-access-kpfpl\") pod \"istiod-openshift-gateway-94bb8fbfd-t66pg\" (UID: \"7ce810eb-85b2-4431-856b-5a2f9f8d0da1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.672638 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.672487 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ce810eb-85b2-4431-856b-5a2f9f8d0da1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-t66pg\" (UID: \"7ce810eb-85b2-4431-856b-5a2f9f8d0da1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.672638 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.672542 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ce810eb-85b2-4431-856b-5a2f9f8d0da1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-t66pg\" (UID: \"7ce810eb-85b2-4431-856b-5a2f9f8d0da1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.672638 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.672579 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7ce810eb-85b2-4431-856b-5a2f9f8d0da1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-t66pg\" (UID: \"7ce810eb-85b2-4431-856b-5a2f9f8d0da1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.672638 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.672599 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7ce810eb-85b2-4431-856b-5a2f9f8d0da1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-t66pg\" (UID: \"7ce810eb-85b2-4431-856b-5a2f9f8d0da1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.673514 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.673479 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/7ce810eb-85b2-4431-856b-5a2f9f8d0da1-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-t66pg\" (UID: \"7ce810eb-85b2-4431-856b-5a2f9f8d0da1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.675058 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.675029 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/7ce810eb-85b2-4431-856b-5a2f9f8d0da1-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-t66pg\" (UID: \"7ce810eb-85b2-4431-856b-5a2f9f8d0da1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.675173 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.675091 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ce810eb-85b2-4431-856b-5a2f9f8d0da1-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-t66pg\" (UID: \"7ce810eb-85b2-4431-856b-5a2f9f8d0da1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.675173 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.675115 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7ce810eb-85b2-4431-856b-5a2f9f8d0da1-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-t66pg\" (UID: \"7ce810eb-85b2-4431-856b-5a2f9f8d0da1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.675173 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.675137 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/7ce810eb-85b2-4431-856b-5a2f9f8d0da1-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-t66pg\" (UID: \"7ce810eb-85b2-4431-856b-5a2f9f8d0da1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.681395 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.681374 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ce810eb-85b2-4431-856b-5a2f9f8d0da1-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-t66pg\" (UID: \"7ce810eb-85b2-4431-856b-5a2f9f8d0da1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.681395 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.681387 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpfpl\" (UniqueName: \"kubernetes.io/projected/7ce810eb-85b2-4431-856b-5a2f9f8d0da1-kube-api-access-kpfpl\") pod \"istiod-openshift-gateway-94bb8fbfd-t66pg\" (UID: \"7ce810eb-85b2-4431-856b-5a2f9f8d0da1\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.750286 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.750251 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:52.813581 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.813549 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:52.863243 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.863212 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:52.947666 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:52.947638 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg"] Jul 22 18:22:52.949619 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:22:52.949590 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ce810eb_85b2_4431_856b_5a2f9f8d0da1.slice/crio-e2b41f21d6e1334639fa687f89f2747720843bbf0a060d05f70b1e6041b7c1ca WatchSource:0}: Error finding container e2b41f21d6e1334639fa687f89f2747720843bbf0a060d05f70b1e6041b7c1ca: Status 404 returned error can't find the container with id e2b41f21d6e1334639fa687f89f2747720843bbf0a060d05f70b1e6041b7c1ca Jul 22 18:22:53.533091 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:53.533045 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" event={"ID":"7ce810eb-85b2-4431-856b-5a2f9f8d0da1","Type":"ContainerStarted","Data":"e2b41f21d6e1334639fa687f89f2747720843bbf0a060d05f70b1e6041b7c1ca"} Jul 22 18:22:54.078848 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:54.078747 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:54.184779 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:54.184740 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:55.000265 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:55.000230 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:55.099548 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:55.099276 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:55.284885 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:55.284798 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:55.384342 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:55.384294 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:55.481630 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:55.481595 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:55.588549 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:55.588463 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:57.603167 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:57.603137 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:57.644598 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:57.644551 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:22:57.644723 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:57.644650 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:22:57.644723 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:57.644692 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:22:57.646622 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:57.646590 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:22:57.646735 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:57.646649 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:22:57.705028 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:57.704999 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:58.564377 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:58.564337 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" event={"ID":"d6d42110-5189-4edb-b028-491740b40f60","Type":"ContainerStarted","Data":"5a09f2aba9a4a33a8cab530e885a8b748976fd8b47155edf8a37300ce76043ff"} Jul 22 18:22:58.565854 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:58.565833 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd" event={"ID":"d07c8ea0-3502-4e0f-8f2c-157365147b2e","Type":"ContainerStarted","Data":"3a15b6391c078d8025bd55455affc7302b589ca10d0ef8a30d5f59f8962152ce"} Jul 22 18:22:58.565993 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:58.565928 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd" Jul 22 18:22:58.567290 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:58.567269 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" event={"ID":"7ce810eb-85b2-4431-856b-5a2f9f8d0da1","Type":"ContainerStarted","Data":"330672cbc5da63c48c971754add8cc581b0d8b856ac1e4aa2bee5917cbcbcf1b"} Jul 22 18:22:58.567442 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:58.567431 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:58.569166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:58.569148 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" Jul 22 18:22:58.602301 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:58.602246 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" podStartSLOduration=2.451994421 podStartE2EDuration="7.602229618s" totalImagesPullingTime="5.150235197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:22:58.602135853 +0000 UTC m=+534.527030885" watchObservedRunningTime="2026-07-22 18:22:58.602229618 +0000 UTC m=+534.527124635" Jul 22 18:22:58.628185 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:58.628132 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-t66pg" podStartSLOduration=1.9335785109999999 podStartE2EDuration="6.628117474s" totalImagesPullingTime="4.694538963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:22:58.626443594 +0000 UTC m=+534.551338610" watchObservedRunningTime="2026-07-22 18:22:58.628117474 +0000 UTC m=+534.553012491" Jul 22 18:22:58.648583 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:58.648524 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd" podStartSLOduration=2.168220183 podStartE2EDuration="7.648502895s" totalImagesPullingTime="5.480282712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:22:58.647560007 +0000 UTC m=+534.572455025" watchObservedRunningTime="2026-07-22 18:22:58.648502895 +0000 UTC m=+534.573397913" Jul 22 18:22:59.345947 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:59.345910 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:59.350542 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:59.350516 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:59.559059 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:59.559025 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:22:59.571649 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:59.571617 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:59.572357 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:59.572339 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4vw225" Jul 22 18:22:59.660477 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:22:59.660385 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:23:09.573889 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:23:09.573859 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7b479b546f-26gvd" Jul 22 18:23:11.129189 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:23:11.129151 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:23:11.184055 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:23:11.184020 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:23:44.321465 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:23:44.321398 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:23:44.478988 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:23:44.478944 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:23:44.587883 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:23:44.587780 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:23:52.253285 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:23:52.253250 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:05.262939 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:05.262910 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:24:05.265729 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:05.265707 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:24:07.032226 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:07.032188 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:07.095921 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:07.095871 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:13.048942 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:13.048904 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:16.834711 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:16.834670 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:17.613645 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:17.613610 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:17.714445 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:17.714392 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:17.831713 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:17.831682 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:18.046456 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:18.046410 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:18.443249 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:18.443151 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:19.545602 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:19.545572 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:19.649014 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:19.648975 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:21.104535 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:21.104503 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:21.204341 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:21.204306 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:23.614450 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:23.614403 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:25.207640 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:25.207531 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:26.893472 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:26.893441 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:26.997935 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:26.997900 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:28.075464 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:28.075404 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:28.404580 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:28.404491 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:36.136843 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:36.136814 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:36.253866 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:36.253818 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:38.575180 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:38.575149 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:38.676116 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:38.676082 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:43.688721 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:43.688688 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:43.790199 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:43.790166 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:47.098672 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:47.098627 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:47.202739 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:47.202709 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:55.798588 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:55.798540 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:55.870123 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:55.870081 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:58.236930 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:58.236888 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:24:59.088847 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:24:59.088813 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:03.628498 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:03.628465 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:03.708016 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:03.707954 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:07.012821 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:07.012763 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:07.074715 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:07.074684 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:12.264506 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.264469 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp"] Jul 22 18:25:12.268452 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.268432 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.271792 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.271775 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-7pghf\"" Jul 22 18:25:12.281487 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.281454 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp"] Jul 22 18:25:12.330369 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.330335 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cec98bb9-2357-4f68-9076-ecd5351e84ff-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.330369 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.330372 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cec98bb9-2357-4f68-9076-ecd5351e84ff-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.330645 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.330395 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cec98bb9-2357-4f68-9076-ecd5351e84ff-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.330645 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.330549 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cec98bb9-2357-4f68-9076-ecd5351e84ff-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.330645 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.330606 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cec98bb9-2357-4f68-9076-ecd5351e84ff-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.330785 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.330656 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhrt6\" (UniqueName: \"kubernetes.io/projected/cec98bb9-2357-4f68-9076-ecd5351e84ff-kube-api-access-lhrt6\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.330785 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.330697 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cec98bb9-2357-4f68-9076-ecd5351e84ff-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.330869 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.330786 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cec98bb9-2357-4f68-9076-ecd5351e84ff-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.330869 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.330817 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cec98bb9-2357-4f68-9076-ecd5351e84ff-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.341112 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.341086 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:12.431677 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.431645 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cec98bb9-2357-4f68-9076-ecd5351e84ff-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.431881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.431690 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cec98bb9-2357-4f68-9076-ecd5351e84ff-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.431881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.431707 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cec98bb9-2357-4f68-9076-ecd5351e84ff-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.431881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.431738 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cec98bb9-2357-4f68-9076-ecd5351e84ff-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.431881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.431792 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cec98bb9-2357-4f68-9076-ecd5351e84ff-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.431881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.431844 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cec98bb9-2357-4f68-9076-ecd5351e84ff-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.432151 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.431909 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cec98bb9-2357-4f68-9076-ecd5351e84ff-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.432151 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.431963 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cec98bb9-2357-4f68-9076-ecd5351e84ff-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.432151 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.432016 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhrt6\" (UniqueName: \"kubernetes.io/projected/cec98bb9-2357-4f68-9076-ecd5351e84ff-kube-api-access-lhrt6\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.432151 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.432115 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cec98bb9-2357-4f68-9076-ecd5351e84ff-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.432326 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.432209 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cec98bb9-2357-4f68-9076-ecd5351e84ff-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.432326 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.432231 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cec98bb9-2357-4f68-9076-ecd5351e84ff-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.432448 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.432379 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cec98bb9-2357-4f68-9076-ecd5351e84ff-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.432883 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.432855 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cec98bb9-2357-4f68-9076-ecd5351e84ff-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.434345 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.434318 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cec98bb9-2357-4f68-9076-ecd5351e84ff-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.434595 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.434578 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cec98bb9-2357-4f68-9076-ecd5351e84ff-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.440693 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.440671 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cec98bb9-2357-4f68-9076-ecd5351e84ff-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.440805 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.440787 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhrt6\" (UniqueName: \"kubernetes.io/projected/cec98bb9-2357-4f68-9076-ecd5351e84ff-kube-api-access-lhrt6\") pod \"maas-default-gateway-openshift-default-56654dcf7-x8hfp\" (UID: \"cec98bb9-2357-4f68-9076-ecd5351e84ff\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.580606 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.580518 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:12.606057 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.606021 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:12.717576 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.717554 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp"] Jul 22 18:25:12.719780 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:25:12.719756 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcec98bb9_2357_4f68_9076_ecd5351e84ff.slice/crio-0c156eab67b03a9f6b1bfb2428e06e7879685d9c4cf55aca8ed007cea54481fc WatchSource:0}: Error finding container 0c156eab67b03a9f6b1bfb2428e06e7879685d9c4cf55aca8ed007cea54481fc: Status 404 returned error can't find the container with id 0c156eab67b03a9f6b1bfb2428e06e7879685d9c4cf55aca8ed007cea54481fc Jul 22 18:25:12.721815 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.721782 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:25:12.721917 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.721850 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:25:12.721917 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:12.721878 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:25:13.141242 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:13.141198 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" event={"ID":"cec98bb9-2357-4f68-9076-ecd5351e84ff","Type":"ContainerStarted","Data":"b250417e021668d25d7514986f2a85615cd617fdaf225b30e7f3eac65fbe2ce1"} Jul 22 18:25:13.141442 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:13.141266 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" event={"ID":"cec98bb9-2357-4f68-9076-ecd5351e84ff","Type":"ContainerStarted","Data":"0c156eab67b03a9f6b1bfb2428e06e7879685d9c4cf55aca8ed007cea54481fc"} Jul 22 18:25:13.176277 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:13.176230 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" podStartSLOduration=1.176217027 podStartE2EDuration="1.176217027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:25:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:25:13.175546615 +0000 UTC m=+669.100441645" watchObservedRunningTime="2026-07-22 18:25:13.176217027 +0000 UTC m=+669.101112045" Jul 22 18:25:13.580939 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:13.580906 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:13.585559 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:13.585535 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:14.146302 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:14.146267 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:14.147140 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:14.147122 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:25:14.238825 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:14.238795 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:14.337037 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:14.337001 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:15.006659 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:15.006619 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:15.104268 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:15.104238 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:17.953667 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:17.953632 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:18.053973 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:18.053946 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:18.981407 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:18.981375 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:19.036022 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:19.035992 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:23.408026 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:23.407984 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:24.074535 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:24.074504 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:25.822680 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:25.822644 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:25.892429 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:25.892393 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:34.589501 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:34.589460 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:35.446920 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:35.446884 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:35.601508 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:35.601467 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:35.967642 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:35.967610 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:49.277586 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:49.277538 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:49.783274 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:49.783239 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:55.836456 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:55.836352 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b8fc888dd-tlczf"] Jul 22 18:25:55.839974 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:55.839956 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8fc888dd-tlczf" Jul 22 18:25:55.842695 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:55.842671 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 22 18:25:55.842812 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:55.842702 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 22 18:25:55.842812 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:55.842737 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bk8qz\"" Jul 22 18:25:55.850975 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:55.850949 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b8fc888dd-tlczf"] Jul 22 18:25:55.904560 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:55.904529 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02d1fe9a-d56e-4686-b1ba-f05251038271-webhook-cert\") pod \"maas-controller-5b8fc888dd-tlczf\" (UID: \"02d1fe9a-d56e-4686-b1ba-f05251038271\") " pod="opendatahub/maas-controller-5b8fc888dd-tlczf" Jul 22 18:25:55.904753 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:55.904600 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb46g\" (UniqueName: \"kubernetes.io/projected/02d1fe9a-d56e-4686-b1ba-f05251038271-kube-api-access-cb46g\") pod \"maas-controller-5b8fc888dd-tlczf\" (UID: \"02d1fe9a-d56e-4686-b1ba-f05251038271\") " pod="opendatahub/maas-controller-5b8fc888dd-tlczf" Jul 22 18:25:56.005112 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:56.005080 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02d1fe9a-d56e-4686-b1ba-f05251038271-webhook-cert\") pod \"maas-controller-5b8fc888dd-tlczf\" (UID: \"02d1fe9a-d56e-4686-b1ba-f05251038271\") " pod="opendatahub/maas-controller-5b8fc888dd-tlczf" Jul 22 18:25:56.005294 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:56.005139 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb46g\" (UniqueName: \"kubernetes.io/projected/02d1fe9a-d56e-4686-b1ba-f05251038271-kube-api-access-cb46g\") pod \"maas-controller-5b8fc888dd-tlczf\" (UID: \"02d1fe9a-d56e-4686-b1ba-f05251038271\") " pod="opendatahub/maas-controller-5b8fc888dd-tlczf" Jul 22 18:25:56.007703 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:56.007679 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02d1fe9a-d56e-4686-b1ba-f05251038271-webhook-cert\") pod \"maas-controller-5b8fc888dd-tlczf\" (UID: \"02d1fe9a-d56e-4686-b1ba-f05251038271\") " pod="opendatahub/maas-controller-5b8fc888dd-tlczf" Jul 22 18:25:56.019447 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:56.016965 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-ddf6698b6-lqznn"] Jul 22 18:25:56.022196 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:56.022167 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb46g\" (UniqueName: \"kubernetes.io/projected/02d1fe9a-d56e-4686-b1ba-f05251038271-kube-api-access-cb46g\") pod \"maas-controller-5b8fc888dd-tlczf\" (UID: \"02d1fe9a-d56e-4686-b1ba-f05251038271\") " pod="opendatahub/maas-controller-5b8fc888dd-tlczf" Jul 22 18:25:56.022727 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:56.022700 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ddf6698b6-lqznn" Jul 22 18:25:56.031346 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:56.031322 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ddf6698b6-lqznn"] Jul 22 18:25:56.106697 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:56.106613 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/522104ed-3bfd-485e-b758-82d121d1e655-webhook-cert\") pod \"maas-controller-ddf6698b6-lqznn\" (UID: \"522104ed-3bfd-485e-b758-82d121d1e655\") " pod="opendatahub/maas-controller-ddf6698b6-lqznn" Jul 22 18:25:56.106697 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:56.106654 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5qb8\" (UniqueName: \"kubernetes.io/projected/522104ed-3bfd-485e-b758-82d121d1e655-kube-api-access-c5qb8\") pod \"maas-controller-ddf6698b6-lqznn\" (UID: \"522104ed-3bfd-485e-b758-82d121d1e655\") " pod="opendatahub/maas-controller-ddf6698b6-lqznn" Jul 22 18:25:56.152359 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:56.152335 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8fc888dd-tlczf" Jul 22 18:25:56.208216 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:56.208162 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/522104ed-3bfd-485e-b758-82d121d1e655-webhook-cert\") pod \"maas-controller-ddf6698b6-lqznn\" (UID: \"522104ed-3bfd-485e-b758-82d121d1e655\") " pod="opendatahub/maas-controller-ddf6698b6-lqznn" Jul 22 18:25:56.208302 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:56.208223 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5qb8\" (UniqueName: \"kubernetes.io/projected/522104ed-3bfd-485e-b758-82d121d1e655-kube-api-access-c5qb8\") pod \"maas-controller-ddf6698b6-lqznn\" (UID: \"522104ed-3bfd-485e-b758-82d121d1e655\") " pod="opendatahub/maas-controller-ddf6698b6-lqznn" Jul 22 18:25:56.211063 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:56.211040 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/522104ed-3bfd-485e-b758-82d121d1e655-webhook-cert\") pod \"maas-controller-ddf6698b6-lqznn\" (UID: \"522104ed-3bfd-485e-b758-82d121d1e655\") " pod="opendatahub/maas-controller-ddf6698b6-lqznn" Jul 22 18:25:56.218132 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:56.218107 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5qb8\" (UniqueName: \"kubernetes.io/projected/522104ed-3bfd-485e-b758-82d121d1e655-kube-api-access-c5qb8\") pod \"maas-controller-ddf6698b6-lqznn\" (UID: \"522104ed-3bfd-485e-b758-82d121d1e655\") " pod="opendatahub/maas-controller-ddf6698b6-lqznn" Jul 22 18:25:56.302836 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:56.302811 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b8fc888dd-tlczf"] Jul 22 18:25:56.304354 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:25:56.304328 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02d1fe9a_d56e_4686_b1ba_f05251038271.slice/crio-9e284a79fbcb5fa546bfa961ad98e68fe22cc1ad7c5c836ef2a82b791b0215c9 WatchSource:0}: Error finding container 9e284a79fbcb5fa546bfa961ad98e68fe22cc1ad7c5c836ef2a82b791b0215c9: Status 404 returned error can't find the container with id 9e284a79fbcb5fa546bfa961ad98e68fe22cc1ad7c5c836ef2a82b791b0215c9 Jul 22 18:25:56.305580 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:56.305565 2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 22 18:25:56.331921 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:56.331892 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8fc888dd-tlczf" event={"ID":"02d1fe9a-d56e-4686-b1ba-f05251038271","Type":"ContainerStarted","Data":"9e284a79fbcb5fa546bfa961ad98e68fe22cc1ad7c5c836ef2a82b791b0215c9"} Jul 22 18:25:56.341167 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:56.341145 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ddf6698b6-lqznn" Jul 22 18:25:56.470673 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:56.470617 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ddf6698b6-lqznn"] Jul 22 18:25:56.472857 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:25:56.472831 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod522104ed_3bfd_485e_b758_82d121d1e655.slice/crio-ecf677bf9eb4da07e7f415eaac9e197ca13901906e1e1e22f0e67cac051b1f64 WatchSource:0}: Error finding container ecf677bf9eb4da07e7f415eaac9e197ca13901906e1e1e22f0e67cac051b1f64: Status 404 returned error can't find the container with id ecf677bf9eb4da07e7f415eaac9e197ca13901906e1e1e22f0e67cac051b1f64 Jul 22 18:25:57.341763 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:57.341719 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ddf6698b6-lqznn" event={"ID":"522104ed-3bfd-485e-b758-82d121d1e655","Type":"ContainerStarted","Data":"ecf677bf9eb4da07e7f415eaac9e197ca13901906e1e1e22f0e67cac051b1f64"} Jul 22 18:25:57.435549 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:57.435447 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:57.501806 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:57.501733 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:59.201690 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:59.201662 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:59.301079 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:59.300999 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:25:59.352710 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:59.352664 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ddf6698b6-lqznn" event={"ID":"522104ed-3bfd-485e-b758-82d121d1e655","Type":"ContainerStarted","Data":"9ff3079cce7fa44d4aa78cf957bf448b43638b8294bfec4ae6dfd7f9d1d8820b"} Jul 22 18:25:59.352917 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:59.352729 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-ddf6698b6-lqznn" Jul 22 18:25:59.354147 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:59.354121 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8fc888dd-tlczf" event={"ID":"02d1fe9a-d56e-4686-b1ba-f05251038271","Type":"ContainerStarted","Data":"47bc2b41572d30690416c19c706013d8eb0fbc2d84a61db6981eb1e82cbc851d"} Jul 22 18:25:59.354266 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:59.354222 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b8fc888dd-tlczf" Jul 22 18:25:59.402985 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:59.402929 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-ddf6698b6-lqznn" podStartSLOduration=1.851979679 podStartE2EDuration="4.402911026s" totalImagesPullingTime="2.550931347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:25:59.377093663 +0000 UTC m=+715.301988684" watchObservedRunningTime="2026-07-22 18:25:59.402911026 +0000 UTC m=+715.327806046" Jul 22 18:25:59.403239 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:25:59.403220 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b8fc888dd-tlczf" podStartSLOduration=1.690832237 podStartE2EDuration="4.403215306s" totalImagesPullingTime="2.712383069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:25:59.401161596 +0000 UTC m=+715.326056616" watchObservedRunningTime="2026-07-22 18:25:59.403215306 +0000 UTC m=+715.328110324" Jul 22 18:26:10.359990 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:10.359962 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-ddf6698b6-lqznn" Jul 22 18:26:10.360490 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:10.360027 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b8fc888dd-tlczf" Jul 22 18:26:10.425579 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:10.425549 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b8fc888dd-tlczf"] Jul 22 18:26:10.425746 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:10.425719 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5b8fc888dd-tlczf" podUID="02d1fe9a-d56e-4686-b1ba-f05251038271" containerName="manager" containerID="cri-o://47bc2b41572d30690416c19c706013d8eb0fbc2d84a61db6981eb1e82cbc851d" gracePeriod=30 Jul 22 18:26:10.673544 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:10.673523 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8fc888dd-tlczf" Jul 22 18:26:10.751475 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:10.751444 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02d1fe9a-d56e-4686-b1ba-f05251038271-webhook-cert\") pod \"02d1fe9a-d56e-4686-b1ba-f05251038271\" (UID: \"02d1fe9a-d56e-4686-b1ba-f05251038271\") " Jul 22 18:26:10.751646 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:10.751531 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb46g\" (UniqueName: \"kubernetes.io/projected/02d1fe9a-d56e-4686-b1ba-f05251038271-kube-api-access-cb46g\") pod \"02d1fe9a-d56e-4686-b1ba-f05251038271\" (UID: \"02d1fe9a-d56e-4686-b1ba-f05251038271\") " Jul 22 18:26:10.753781 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:10.753747 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02d1fe9a-d56e-4686-b1ba-f05251038271-kube-api-access-cb46g" (OuterVolumeSpecName: "kube-api-access-cb46g") pod "02d1fe9a-d56e-4686-b1ba-f05251038271" (UID: "02d1fe9a-d56e-4686-b1ba-f05251038271"). InnerVolumeSpecName "kube-api-access-cb46g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:26:10.753781 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:10.753763 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02d1fe9a-d56e-4686-b1ba-f05251038271-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "02d1fe9a-d56e-4686-b1ba-f05251038271" (UID: "02d1fe9a-d56e-4686-b1ba-f05251038271"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:26:10.852582 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:10.852544 2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/02d1fe9a-d56e-4686-b1ba-f05251038271-webhook-cert\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:26:10.852582 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:10.852575 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb46g\" (UniqueName: \"kubernetes.io/projected/02d1fe9a-d56e-4686-b1ba-f05251038271-kube-api-access-cb46g\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:26:11.409391 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:11.409357 2554 generic.go:356] "Generic (PLEG): container finished" podID="02d1fe9a-d56e-4686-b1ba-f05251038271" containerID="47bc2b41572d30690416c19c706013d8eb0fbc2d84a61db6981eb1e82cbc851d" exitCode=0 Jul 22 18:26:11.409814 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:11.409402 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8fc888dd-tlczf" Jul 22 18:26:11.409814 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:11.409453 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8fc888dd-tlczf" event={"ID":"02d1fe9a-d56e-4686-b1ba-f05251038271","Type":"ContainerDied","Data":"47bc2b41572d30690416c19c706013d8eb0fbc2d84a61db6981eb1e82cbc851d"} Jul 22 18:26:11.409814 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:11.409521 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8fc888dd-tlczf" event={"ID":"02d1fe9a-d56e-4686-b1ba-f05251038271","Type":"ContainerDied","Data":"9e284a79fbcb5fa546bfa961ad98e68fe22cc1ad7c5c836ef2a82b791b0215c9"} Jul 22 18:26:11.409814 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:11.409545 2554 scope.go:117] "RemoveContainer" containerID="47bc2b41572d30690416c19c706013d8eb0fbc2d84a61db6981eb1e82cbc851d" Jul 22 18:26:11.418360 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:11.418345 2554 scope.go:117] "RemoveContainer" containerID="47bc2b41572d30690416c19c706013d8eb0fbc2d84a61db6981eb1e82cbc851d" Jul 22 18:26:11.418697 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:26:11.418675 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47bc2b41572d30690416c19c706013d8eb0fbc2d84a61db6981eb1e82cbc851d\": container with ID starting with 47bc2b41572d30690416c19c706013d8eb0fbc2d84a61db6981eb1e82cbc851d not found: ID does not exist" containerID="47bc2b41572d30690416c19c706013d8eb0fbc2d84a61db6981eb1e82cbc851d" Jul 22 18:26:11.418757 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:11.418707 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47bc2b41572d30690416c19c706013d8eb0fbc2d84a61db6981eb1e82cbc851d"} err="failed to get container status \"47bc2b41572d30690416c19c706013d8eb0fbc2d84a61db6981eb1e82cbc851d\": rpc error: code = NotFound desc = could not find container \"47bc2b41572d30690416c19c706013d8eb0fbc2d84a61db6981eb1e82cbc851d\": container with ID starting with 47bc2b41572d30690416c19c706013d8eb0fbc2d84a61db6981eb1e82cbc851d not found: ID does not exist" Jul 22 18:26:11.430605 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:11.430573 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b8fc888dd-tlczf"] Jul 22 18:26:11.435632 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:11.435599 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5b8fc888dd-tlczf"] Jul 22 18:26:12.547047 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:12.547013 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02d1fe9a-d56e-4686-b1ba-f05251038271" path="/var/lib/kubelet/pods/02d1fe9a-d56e-4686-b1ba-f05251038271/volumes" Jul 22 18:26:31.400311 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.400274 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-858f867677-dqb67"] Jul 22 18:26:31.400876 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.400861 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02d1fe9a-d56e-4686-b1ba-f05251038271" containerName="manager" Jul 22 18:26:31.400920 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.400879 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="02d1fe9a-d56e-4686-b1ba-f05251038271" containerName="manager" Jul 22 18:26:31.400971 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.400961 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="02d1fe9a-d56e-4686-b1ba-f05251038271" containerName="manager" Jul 22 18:26:31.404300 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.404284 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-858f867677-dqb67" Jul 22 18:26:31.407077 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.407052 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 22 18:26:31.407209 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.407090 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 22 18:26:31.407209 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.407107 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 22 18:26:31.408119 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.408103 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-wl92n\"" Jul 22 18:26:31.418083 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.417706 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-858f867677-dqb67"] Jul 22 18:26:31.443662 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.443631 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae587d03-5bb6-4d06-84ee-ee332e19e074-openshift-service-ca\") pod \"maas-api-858f867677-dqb67\" (UID: \"ae587d03-5bb6-4d06-84ee-ee332e19e074\") " pod="odh-ai-gateway-infra/maas-api-858f867677-dqb67" Jul 22 18:26:31.443662 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.443659 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w2t5\" (UniqueName: \"kubernetes.io/projected/ae587d03-5bb6-4d06-84ee-ee332e19e074-kube-api-access-7w2t5\") pod \"maas-api-858f867677-dqb67\" (UID: \"ae587d03-5bb6-4d06-84ee-ee332e19e074\") " pod="odh-ai-gateway-infra/maas-api-858f867677-dqb67" Jul 22 18:26:31.443859 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.443732 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae587d03-5bb6-4d06-84ee-ee332e19e074-maas-api-tls\") pod \"maas-api-858f867677-dqb67\" (UID: \"ae587d03-5bb6-4d06-84ee-ee332e19e074\") " pod="odh-ai-gateway-infra/maas-api-858f867677-dqb67" Jul 22 18:26:31.544568 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.544528 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae587d03-5bb6-4d06-84ee-ee332e19e074-openshift-service-ca\") pod \"maas-api-858f867677-dqb67\" (UID: \"ae587d03-5bb6-4d06-84ee-ee332e19e074\") " pod="odh-ai-gateway-infra/maas-api-858f867677-dqb67" Jul 22 18:26:31.544568 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.544567 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w2t5\" (UniqueName: \"kubernetes.io/projected/ae587d03-5bb6-4d06-84ee-ee332e19e074-kube-api-access-7w2t5\") pod \"maas-api-858f867677-dqb67\" (UID: \"ae587d03-5bb6-4d06-84ee-ee332e19e074\") " pod="odh-ai-gateway-infra/maas-api-858f867677-dqb67" Jul 22 18:26:31.544777 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.544614 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae587d03-5bb6-4d06-84ee-ee332e19e074-maas-api-tls\") pod \"maas-api-858f867677-dqb67\" (UID: \"ae587d03-5bb6-4d06-84ee-ee332e19e074\") " pod="odh-ai-gateway-infra/maas-api-858f867677-dqb67" Jul 22 18:26:31.544777 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:26:31.544731 2554 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jul 22 18:26:31.544856 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:26:31.544795 2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae587d03-5bb6-4d06-84ee-ee332e19e074-maas-api-tls podName:ae587d03-5bb6-4d06-84ee-ee332e19e074 nodeName:}" failed. No retries permitted until 2026-07-22 18:26:32.044780106 +0000 UTC m=+747.969675103 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ae587d03-5bb6-4d06-84ee-ee332e19e074-maas-api-tls") pod "maas-api-858f867677-dqb67" (UID: "ae587d03-5bb6-4d06-84ee-ee332e19e074") : secret "maas-api-serving-cert" not found Jul 22 18:26:31.545171 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.545154 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae587d03-5bb6-4d06-84ee-ee332e19e074-openshift-service-ca\") pod \"maas-api-858f867677-dqb67\" (UID: \"ae587d03-5bb6-4d06-84ee-ee332e19e074\") " pod="odh-ai-gateway-infra/maas-api-858f867677-dqb67" Jul 22 18:26:31.565136 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.565095 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w2t5\" (UniqueName: \"kubernetes.io/projected/ae587d03-5bb6-4d06-84ee-ee332e19e074-kube-api-access-7w2t5\") pod \"maas-api-858f867677-dqb67\" (UID: \"ae587d03-5bb6-4d06-84ee-ee332e19e074\") " pod="odh-ai-gateway-infra/maas-api-858f867677-dqb67" Jul 22 18:26:31.990781 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.990747 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-k6k55"] Jul 22 18:26:31.994350 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.994330 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-k6k55" Jul 22 18:26:31.997877 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.997856 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-dx9kz\"" Jul 22 18:26:31.998024 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:31.998007 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 22 18:26:32.005512 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.005485 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-k6k55"] Jul 22 18:26:32.007746 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.007728 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-h4b9f"] Jul 22 18:26:32.011224 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.011207 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-h4b9f" Jul 22 18:26:32.026603 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.026547 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-h4b9f"] Jul 22 18:26:32.050030 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.049993 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15e0a02c-b9f1-4936-a0ce-5dc70b6456bf-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-k6k55\" (UID: \"15e0a02c-b9f1-4936-a0ce-5dc70b6456bf\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-k6k55" Jul 22 18:26:32.050226 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.050048 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae587d03-5bb6-4d06-84ee-ee332e19e074-maas-api-tls\") pod \"maas-api-858f867677-dqb67\" (UID: \"ae587d03-5bb6-4d06-84ee-ee332e19e074\") " pod="odh-ai-gateway-infra/maas-api-858f867677-dqb67" Jul 22 18:26:32.050226 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.050150 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09b19d25-b11e-434f-8d32-d50167d2285d-plugins-config-volume\") pod \"payload-processing-5bf47cd988-h4b9f\" (UID: \"09b19d25-b11e-434f-8d32-d50167d2285d\") " pod="openshift-ingress/payload-processing-5bf47cd988-h4b9f" Jul 22 18:26:32.050226 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.050206 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzxkc\" (UniqueName: \"kubernetes.io/projected/15e0a02c-b9f1-4936-a0ce-5dc70b6456bf-kube-api-access-wzxkc\") pod \"payload-pre-processing-7677b774bb-k6k55\" (UID: \"15e0a02c-b9f1-4936-a0ce-5dc70b6456bf\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-k6k55" Jul 22 18:26:32.050345 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.050229 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxctj\" (UniqueName: \"kubernetes.io/projected/09b19d25-b11e-434f-8d32-d50167d2285d-kube-api-access-hxctj\") pod \"payload-processing-5bf47cd988-h4b9f\" (UID: \"09b19d25-b11e-434f-8d32-d50167d2285d\") " pod="openshift-ingress/payload-processing-5bf47cd988-h4b9f" Jul 22 18:26:32.052781 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.052757 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ae587d03-5bb6-4d06-84ee-ee332e19e074-maas-api-tls\") pod \"maas-api-858f867677-dqb67\" (UID: \"ae587d03-5bb6-4d06-84ee-ee332e19e074\") " pod="odh-ai-gateway-infra/maas-api-858f867677-dqb67" Jul 22 18:26:32.141222 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.141193 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:26:32.151389 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.151362 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15e0a02c-b9f1-4936-a0ce-5dc70b6456bf-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-k6k55\" (UID: \"15e0a02c-b9f1-4936-a0ce-5dc70b6456bf\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-k6k55" Jul 22 18:26:32.151552 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.151458 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09b19d25-b11e-434f-8d32-d50167d2285d-plugins-config-volume\") pod \"payload-processing-5bf47cd988-h4b9f\" (UID: \"09b19d25-b11e-434f-8d32-d50167d2285d\") " pod="openshift-ingress/payload-processing-5bf47cd988-h4b9f" Jul 22 18:26:32.151552 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.151493 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzxkc\" (UniqueName: \"kubernetes.io/projected/15e0a02c-b9f1-4936-a0ce-5dc70b6456bf-kube-api-access-wzxkc\") pod \"payload-pre-processing-7677b774bb-k6k55\" (UID: \"15e0a02c-b9f1-4936-a0ce-5dc70b6456bf\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-k6k55" Jul 22 18:26:32.151552 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.151510 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxctj\" (UniqueName: \"kubernetes.io/projected/09b19d25-b11e-434f-8d32-d50167d2285d-kube-api-access-hxctj\") pod \"payload-processing-5bf47cd988-h4b9f\" (UID: \"09b19d25-b11e-434f-8d32-d50167d2285d\") " pod="openshift-ingress/payload-processing-5bf47cd988-h4b9f" Jul 22 18:26:32.152410 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.152396 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15e0a02c-b9f1-4936-a0ce-5dc70b6456bf-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-k6k55\" (UID: \"15e0a02c-b9f1-4936-a0ce-5dc70b6456bf\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-k6k55" Jul 22 18:26:32.152630 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.152605 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09b19d25-b11e-434f-8d32-d50167d2285d-plugins-config-volume\") pod \"payload-processing-5bf47cd988-h4b9f\" (UID: \"09b19d25-b11e-434f-8d32-d50167d2285d\") " pod="openshift-ingress/payload-processing-5bf47cd988-h4b9f" Jul 22 18:26:32.161629 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.161605 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxctj\" (UniqueName: \"kubernetes.io/projected/09b19d25-b11e-434f-8d32-d50167d2285d-kube-api-access-hxctj\") pod \"payload-processing-5bf47cd988-h4b9f\" (UID: \"09b19d25-b11e-434f-8d32-d50167d2285d\") " pod="openshift-ingress/payload-processing-5bf47cd988-h4b9f" Jul 22 18:26:32.161821 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.161799 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzxkc\" (UniqueName: \"kubernetes.io/projected/15e0a02c-b9f1-4936-a0ce-5dc70b6456bf-kube-api-access-wzxkc\") pod \"payload-pre-processing-7677b774bb-k6k55\" (UID: \"15e0a02c-b9f1-4936-a0ce-5dc70b6456bf\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-k6k55" Jul 22 18:26:32.240593 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.240565 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:26:32.307030 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.306950 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-k6k55" Jul 22 18:26:32.319312 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.319273 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-858f867677-dqb67" Jul 22 18:26:32.320356 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.320337 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-h4b9f" Jul 22 18:26:32.478853 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.477474 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-k6k55"] Jul 22 18:26:32.714118 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.712987 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-h4b9f"] Jul 22 18:26:32.726275 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:32.725682 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-858f867677-dqb67"] Jul 22 18:26:32.736267 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:26:32.736243 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae587d03_5bb6_4d06_84ee_ee332e19e074.slice/crio-891f1a4188041919ab8c656afcfac9818117c71de66af1462f5495825f3e7ffc WatchSource:0}: Error finding container 891f1a4188041919ab8c656afcfac9818117c71de66af1462f5495825f3e7ffc: Status 404 returned error can't find the container with id 891f1a4188041919ab8c656afcfac9818117c71de66af1462f5495825f3e7ffc Jul 22 18:26:33.526731 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:33.526657 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-h4b9f" event={"ID":"09b19d25-b11e-434f-8d32-d50167d2285d","Type":"ContainerStarted","Data":"678c0bae41f72e5eb6c99a94f607b1de77a79193bb4ea48f91e8de04833aa9d9"} Jul 22 18:26:33.529003 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:33.528973 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-k6k55" event={"ID":"15e0a02c-b9f1-4936-a0ce-5dc70b6456bf","Type":"ContainerStarted","Data":"607cc421ad9f05b31e8ee992fb3cb83bf0dfaf10ea5137b5441ff7cd96fe1c5e"} Jul 22 18:26:33.534550 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:33.534521 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-858f867677-dqb67" event={"ID":"ae587d03-5bb6-4d06-84ee-ee332e19e074","Type":"ContainerStarted","Data":"891f1a4188041919ab8c656afcfac9818117c71de66af1462f5495825f3e7ffc"} Jul 22 18:26:36.551712 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:36.551676 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-h4b9f" event={"ID":"09b19d25-b11e-434f-8d32-d50167d2285d","Type":"ContainerStarted","Data":"220c90167dd6a7368c5f0d3d36df3a6df9becddff51892c5a5e6ecea0d045391"} Jul 22 18:26:36.552152 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:36.551808 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-h4b9f" Jul 22 18:26:36.553286 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:36.553263 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-k6k55" event={"ID":"15e0a02c-b9f1-4936-a0ce-5dc70b6456bf","Type":"ContainerStarted","Data":"afad8f6602c7f41e01b8ca60ae882dbdd05b993fb01ae1abc0df55781596f027"} Jul 22 18:26:36.553435 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:36.553312 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-k6k55" Jul 22 18:26:36.554699 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:36.554677 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-858f867677-dqb67" event={"ID":"ae587d03-5bb6-4d06-84ee-ee332e19e074","Type":"ContainerStarted","Data":"067b1203e119f563e45ff3b7548d469cd59d8edbc587adfa0b93f66fbf356ab7"} Jul 22 18:26:36.554834 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:36.554823 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-858f867677-dqb67" Jul 22 18:26:36.588496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:36.588435 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-h4b9f" podStartSLOduration=2.107632224 podStartE2EDuration="5.588394118s" totalImagesPullingTime="3.480761894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:26:36.570329648 +0000 UTC m=+752.495224669" watchObservedRunningTime="2026-07-22 18:26:36.588394118 +0000 UTC m=+752.513289143" Jul 22 18:26:36.606828 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:36.606783 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-858f867677-dqb67" podStartSLOduration=2.233238051 podStartE2EDuration="5.606767007s" totalImagesPullingTime="3.373528956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:26:36.591851554 +0000 UTC m=+752.516746574" watchObservedRunningTime="2026-07-22 18:26:36.606767007 +0000 UTC m=+752.531662026" Jul 22 18:26:36.606979 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:36.606861 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-k6k55" podStartSLOduration=1.929419685 podStartE2EDuration="5.606857837s" totalImagesPullingTime="3.677438152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:26:36.605787077 +0000 UTC m=+752.530682112" watchObservedRunningTime="2026-07-22 18:26:36.606857837 +0000 UTC m=+752.531752856" Jul 22 18:26:40.576613 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:40.576578 2554 generic.go:356] "Generic (PLEG): container finished" podID="cec98bb9-2357-4f68-9076-ecd5351e84ff" containerID="b250417e021668d25d7514986f2a85615cd617fdaf225b30e7f3eac65fbe2ce1" exitCode=0 Jul 22 18:26:40.577096 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:40.576644 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" event={"ID":"cec98bb9-2357-4f68-9076-ecd5351e84ff","Type":"ContainerDied","Data":"b250417e021668d25d7514986f2a85615cd617fdaf225b30e7f3eac65fbe2ce1"} Jul 22 18:26:40.577096 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:40.577042 2554 scope.go:117] "RemoveContainer" containerID="b250417e021668d25d7514986f2a85615cd617fdaf225b30e7f3eac65fbe2ce1" Jul 22 18:26:40.578127 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:40.578099 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:26:40.578225 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:40.578181 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:26:40.578286 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:40.578229 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:26:41.586515 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:41.586465 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" event={"ID":"cec98bb9-2357-4f68-9076-ecd5351e84ff","Type":"ContainerStarted","Data":"43606811a5a0e78eca2d64baa7a7bb829234554afeb1819e15562f92850df145"} Jul 22 18:26:42.568472 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:42.568434 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-858f867677-dqb67" Jul 22 18:26:42.581567 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:42.581538 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:26:42.583098 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:42.582806 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-x8hfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 22 18:26:42.583098 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:42.582857 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" podUID="cec98bb9-2357-4f68-9076-ecd5351e84ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 22 18:26:43.556673 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:43.556642 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:26:43.581709 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:43.581670 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-x8hfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 22 18:26:43.581905 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:43.581753 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" podUID="cec98bb9-2357-4f68-9076-ecd5351e84ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 22 18:26:43.654963 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:43.654918 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:26:44.147182 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:44.147145 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:26:44.581496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:44.581449 2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-x8hfp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" start-of-body= Jul 22 18:26:44.582012 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:44.581527 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" podUID="cec98bb9-2357-4f68-9076-ecd5351e84ff" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.27:15021/healthz/ready\": dial tcp 10.133.0.27:15021: connect: connection refused" Jul 22 18:26:45.585194 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:45.585162 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:26:45.586060 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:45.586042 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-x8hfp" Jul 22 18:26:47.562890 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:47.562863 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-h4b9f" Jul 22 18:26:47.563386 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:47.562938 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-k6k55" Jul 22 18:26:47.630349 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:47.630303 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:26:57.312772 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:26:57.312736 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:27:04.180985 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:04.180947 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:27:09.586225 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.586192 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw"] Jul 22 18:27:09.591871 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.591849 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:09.594731 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.594707 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 22 18:27:09.594731 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.594721 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 22 18:27:09.594928 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.594817 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6vrkz\"" Jul 22 18:27:09.596006 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.595992 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 22 18:27:09.601330 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.601311 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw"] Jul 22 18:27:09.611685 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.611653 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:27:09.642880 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.642847 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03c0d9f6-960c-46bd-b6fd-88c778fd9041-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw\" (UID: \"03c0d9f6-960c-46bd-b6fd-88c778fd9041\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:09.642880 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.642878 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03c0d9f6-960c-46bd-b6fd-88c778fd9041-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw\" (UID: \"03c0d9f6-960c-46bd-b6fd-88c778fd9041\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:09.643073 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.642907 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03c0d9f6-960c-46bd-b6fd-88c778fd9041-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw\" (UID: \"03c0d9f6-960c-46bd-b6fd-88c778fd9041\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:09.643073 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.642930 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03c0d9f6-960c-46bd-b6fd-88c778fd9041-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw\" (UID: \"03c0d9f6-960c-46bd-b6fd-88c778fd9041\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:09.643073 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.642986 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4786\" (UniqueName: \"kubernetes.io/projected/03c0d9f6-960c-46bd-b6fd-88c778fd9041-kube-api-access-r4786\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw\" (UID: \"03c0d9f6-960c-46bd-b6fd-88c778fd9041\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:09.643073 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.643036 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03c0d9f6-960c-46bd-b6fd-88c778fd9041-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw\" (UID: \"03c0d9f6-960c-46bd-b6fd-88c778fd9041\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:09.744539 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.744507 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03c0d9f6-960c-46bd-b6fd-88c778fd9041-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw\" (UID: \"03c0d9f6-960c-46bd-b6fd-88c778fd9041\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:09.744539 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.744542 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03c0d9f6-960c-46bd-b6fd-88c778fd9041-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw\" (UID: \"03c0d9f6-960c-46bd-b6fd-88c778fd9041\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:09.744766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.744579 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4786\" (UniqueName: \"kubernetes.io/projected/03c0d9f6-960c-46bd-b6fd-88c778fd9041-kube-api-access-r4786\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw\" (UID: \"03c0d9f6-960c-46bd-b6fd-88c778fd9041\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:09.744766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.744630 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03c0d9f6-960c-46bd-b6fd-88c778fd9041-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw\" (UID: \"03c0d9f6-960c-46bd-b6fd-88c778fd9041\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:09.744766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.744731 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03c0d9f6-960c-46bd-b6fd-88c778fd9041-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw\" (UID: \"03c0d9f6-960c-46bd-b6fd-88c778fd9041\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:09.744766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.744757 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03c0d9f6-960c-46bd-b6fd-88c778fd9041-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw\" (UID: \"03c0d9f6-960c-46bd-b6fd-88c778fd9041\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:09.745014 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.744991 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03c0d9f6-960c-46bd-b6fd-88c778fd9041-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw\" (UID: \"03c0d9f6-960c-46bd-b6fd-88c778fd9041\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:09.745086 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.745029 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03c0d9f6-960c-46bd-b6fd-88c778fd9041-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw\" (UID: \"03c0d9f6-960c-46bd-b6fd-88c778fd9041\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:09.745145 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.745091 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03c0d9f6-960c-46bd-b6fd-88c778fd9041-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw\" (UID: \"03c0d9f6-960c-46bd-b6fd-88c778fd9041\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:09.747076 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.747057 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03c0d9f6-960c-46bd-b6fd-88c778fd9041-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw\" (UID: \"03c0d9f6-960c-46bd-b6fd-88c778fd9041\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:09.747239 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.747223 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03c0d9f6-960c-46bd-b6fd-88c778fd9041-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw\" (UID: \"03c0d9f6-960c-46bd-b6fd-88c778fd9041\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:09.752140 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.752116 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4786\" (UniqueName: \"kubernetes.io/projected/03c0d9f6-960c-46bd-b6fd-88c778fd9041-kube-api-access-r4786\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw\" (UID: \"03c0d9f6-960c-46bd-b6fd-88c778fd9041\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:09.904011 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:09.903920 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:10.037743 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:10.037719 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw"] Jul 22 18:27:10.040226 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:27:10.040200 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c0d9f6_960c_46bd_b6fd_88c778fd9041.slice/crio-4d6ea8bd2d7feebfb4ec38952896f6506f216a7dbf43cba85a0da61b1027edf2 WatchSource:0}: Error finding container 4d6ea8bd2d7feebfb4ec38952896f6506f216a7dbf43cba85a0da61b1027edf2: Status 404 returned error can't find the container with id 4d6ea8bd2d7feebfb4ec38952896f6506f216a7dbf43cba85a0da61b1027edf2 Jul 22 18:27:10.727766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:10.727728 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" event={"ID":"03c0d9f6-960c-46bd-b6fd-88c778fd9041","Type":"ContainerStarted","Data":"4d6ea8bd2d7feebfb4ec38952896f6506f216a7dbf43cba85a0da61b1027edf2"} Jul 22 18:27:11.733829 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:11.733791 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" event={"ID":"03c0d9f6-960c-46bd-b6fd-88c778fd9041","Type":"ContainerStarted","Data":"0bd8d840b88907a69efeea98894bd6487c8252c7d92e2f7789c7fa6273ef8b57"} Jul 22 18:27:11.753773 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:11.753722 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" podStartSLOduration=1.667877938 podStartE2EDuration="2.753705536s" totalImagesPullingTime="1.085827598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:27:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:27:11.751585287 +0000 UTC m=+787.676480307" watchObservedRunningTime="2026-07-22 18:27:11.753705536 +0000 UTC m=+787.678600554" Jul 22 18:27:17.571852 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.571814 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx"] Jul 22 18:27:17.575615 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.575594 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:17.578494 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.578469 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 22 18:27:17.587034 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.587011 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx"] Jul 22 18:27:17.605684 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.605660 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:27:17.725820 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.725784 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c87a2c62-ff2d-4d6d-bd11-614c8268b774-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqxtx\" (UID: \"c87a2c62-ff2d-4d6d-bd11-614c8268b774\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:17.725996 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.725848 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c87a2c62-ff2d-4d6d-bd11-614c8268b774-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqxtx\" (UID: \"c87a2c62-ff2d-4d6d-bd11-614c8268b774\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:17.725996 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.725897 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkmd9\" (UniqueName: \"kubernetes.io/projected/c87a2c62-ff2d-4d6d-bd11-614c8268b774-kube-api-access-wkmd9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqxtx\" (UID: \"c87a2c62-ff2d-4d6d-bd11-614c8268b774\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:17.725996 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.725975 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c87a2c62-ff2d-4d6d-bd11-614c8268b774-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqxtx\" (UID: \"c87a2c62-ff2d-4d6d-bd11-614c8268b774\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:17.726106 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.725996 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c87a2c62-ff2d-4d6d-bd11-614c8268b774-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqxtx\" (UID: \"c87a2c62-ff2d-4d6d-bd11-614c8268b774\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:17.726106 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.726063 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c87a2c62-ff2d-4d6d-bd11-614c8268b774-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqxtx\" (UID: \"c87a2c62-ff2d-4d6d-bd11-614c8268b774\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:17.826909 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.826815 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c87a2c62-ff2d-4d6d-bd11-614c8268b774-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqxtx\" (UID: \"c87a2c62-ff2d-4d6d-bd11-614c8268b774\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:17.826909 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.826885 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c87a2c62-ff2d-4d6d-bd11-614c8268b774-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqxtx\" (UID: \"c87a2c62-ff2d-4d6d-bd11-614c8268b774\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:17.826909 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.826908 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkmd9\" (UniqueName: \"kubernetes.io/projected/c87a2c62-ff2d-4d6d-bd11-614c8268b774-kube-api-access-wkmd9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqxtx\" (UID: \"c87a2c62-ff2d-4d6d-bd11-614c8268b774\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:17.827207 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.826933 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c87a2c62-ff2d-4d6d-bd11-614c8268b774-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqxtx\" (UID: \"c87a2c62-ff2d-4d6d-bd11-614c8268b774\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:17.827207 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.826954 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c87a2c62-ff2d-4d6d-bd11-614c8268b774-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqxtx\" (UID: \"c87a2c62-ff2d-4d6d-bd11-614c8268b774\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:17.827207 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.826985 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c87a2c62-ff2d-4d6d-bd11-614c8268b774-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqxtx\" (UID: \"c87a2c62-ff2d-4d6d-bd11-614c8268b774\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:17.827358 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.827295 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c87a2c62-ff2d-4d6d-bd11-614c8268b774-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqxtx\" (UID: \"c87a2c62-ff2d-4d6d-bd11-614c8268b774\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:17.827358 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.827306 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c87a2c62-ff2d-4d6d-bd11-614c8268b774-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqxtx\" (UID: \"c87a2c62-ff2d-4d6d-bd11-614c8268b774\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:17.827475 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.827374 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c87a2c62-ff2d-4d6d-bd11-614c8268b774-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqxtx\" (UID: \"c87a2c62-ff2d-4d6d-bd11-614c8268b774\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:17.829328 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.829307 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c87a2c62-ff2d-4d6d-bd11-614c8268b774-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqxtx\" (UID: \"c87a2c62-ff2d-4d6d-bd11-614c8268b774\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:17.829608 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.829590 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c87a2c62-ff2d-4d6d-bd11-614c8268b774-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqxtx\" (UID: \"c87a2c62-ff2d-4d6d-bd11-614c8268b774\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:17.835893 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.835873 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkmd9\" (UniqueName: \"kubernetes.io/projected/c87a2c62-ff2d-4d6d-bd11-614c8268b774-kube-api-access-wkmd9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rqxtx\" (UID: \"c87a2c62-ff2d-4d6d-bd11-614c8268b774\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:17.886477 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:17.886410 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:18.034082 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:18.034056 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx"] Jul 22 18:27:18.036300 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:27:18.036262 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc87a2c62_ff2d_4d6d_bd11_614c8268b774.slice/crio-de6ddef1c0c6ed5b153b49c96b507955e95845f48017b8bbefe9da93ad6033b2 WatchSource:0}: Error finding container de6ddef1c0c6ed5b153b49c96b507955e95845f48017b8bbefe9da93ad6033b2: Status 404 returned error can't find the container with id de6ddef1c0c6ed5b153b49c96b507955e95845f48017b8bbefe9da93ad6033b2 Jul 22 18:27:18.769148 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:18.769112 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" event={"ID":"c87a2c62-ff2d-4d6d-bd11-614c8268b774","Type":"ContainerStarted","Data":"f00fb916c5a51d580720f38f6052a744c8acfaf15c6193267c6b3237b76abe9e"} Jul 22 18:27:18.769565 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:18.769169 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" event={"ID":"c87a2c62-ff2d-4d6d-bd11-614c8268b774","Type":"ContainerStarted","Data":"de6ddef1c0c6ed5b153b49c96b507955e95845f48017b8bbefe9da93ad6033b2"} Jul 22 18:27:18.796907 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:18.787237 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" podStartSLOduration=1.5860964530000001 podStartE2EDuration="1.787218911s" totalImagesPullingTime="201.122458ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:27:18.786014875 +0000 UTC m=+794.710909894" watchObservedRunningTime="2026-07-22 18:27:18.787218911 +0000 UTC m=+794.712113930" Jul 22 18:27:19.904290 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:19.904246 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:19.904716 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:19.904390 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:19.917048 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:19.917026 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:20.789878 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:20.789847 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw" Jul 22 18:27:27.733218 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:27.733134 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:27:27.886962 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:27.886922 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:27.887138 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:27.886990 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:27.899640 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:27.899618 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:28.829211 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:28.829176 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rqxtx" Jul 22 18:27:48.179293 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:27:48.179258 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:28:15.825655 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:28:15.825620 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:28:21.468888 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:28:21.468848 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:28:21.572054 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:28:21.572018 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:28:22.494751 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:28:22.494721 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:28:22.593368 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:28:22.593336 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:29:05.291386 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:05.291360 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:29:05.295501 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:05.295479 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:29:08.927995 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:08.927962 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ddf6698b6-lqznn"] Jul 22 18:29:08.928506 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:08.928183 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-ddf6698b6-lqznn" podUID="522104ed-3bfd-485e-b758-82d121d1e655" containerName="manager" containerID="cri-o://9ff3079cce7fa44d4aa78cf957bf448b43638b8294bfec4ae6dfd7f9d1d8820b" gracePeriod=30 Jul 22 18:29:09.180842 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:09.180790 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ddf6698b6-lqznn" Jul 22 18:29:09.285039 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:09.284999 2554 generic.go:356] "Generic (PLEG): container finished" podID="522104ed-3bfd-485e-b758-82d121d1e655" containerID="9ff3079cce7fa44d4aa78cf957bf448b43638b8294bfec4ae6dfd7f9d1d8820b" exitCode=0 Jul 22 18:29:09.285241 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:09.285049 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ddf6698b6-lqznn" Jul 22 18:29:09.285241 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:09.285044 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ddf6698b6-lqznn" event={"ID":"522104ed-3bfd-485e-b758-82d121d1e655","Type":"ContainerDied","Data":"9ff3079cce7fa44d4aa78cf957bf448b43638b8294bfec4ae6dfd7f9d1d8820b"} Jul 22 18:29:09.285241 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:09.285161 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ddf6698b6-lqznn" event={"ID":"522104ed-3bfd-485e-b758-82d121d1e655","Type":"ContainerDied","Data":"ecf677bf9eb4da07e7f415eaac9e197ca13901906e1e1e22f0e67cac051b1f64"} Jul 22 18:29:09.285241 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:09.285184 2554 scope.go:117] "RemoveContainer" containerID="9ff3079cce7fa44d4aa78cf957bf448b43638b8294bfec4ae6dfd7f9d1d8820b" Jul 22 18:29:09.293660 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:09.293642 2554 scope.go:117] "RemoveContainer" containerID="9ff3079cce7fa44d4aa78cf957bf448b43638b8294bfec4ae6dfd7f9d1d8820b" Jul 22 18:29:09.293907 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:29:09.293887 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ff3079cce7fa44d4aa78cf957bf448b43638b8294bfec4ae6dfd7f9d1d8820b\": container with ID starting with 9ff3079cce7fa44d4aa78cf957bf448b43638b8294bfec4ae6dfd7f9d1d8820b not found: ID does not exist" containerID="9ff3079cce7fa44d4aa78cf957bf448b43638b8294bfec4ae6dfd7f9d1d8820b" Jul 22 18:29:09.293953 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:09.293918 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ff3079cce7fa44d4aa78cf957bf448b43638b8294bfec4ae6dfd7f9d1d8820b"} err="failed to get container status \"9ff3079cce7fa44d4aa78cf957bf448b43638b8294bfec4ae6dfd7f9d1d8820b\": rpc error: code = NotFound desc = could not find container \"9ff3079cce7fa44d4aa78cf957bf448b43638b8294bfec4ae6dfd7f9d1d8820b\": container with ID starting with 9ff3079cce7fa44d4aa78cf957bf448b43638b8294bfec4ae6dfd7f9d1d8820b not found: ID does not exist" Jul 22 18:29:09.305234 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:09.305213 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5qb8\" (UniqueName: \"kubernetes.io/projected/522104ed-3bfd-485e-b758-82d121d1e655-kube-api-access-c5qb8\") pod \"522104ed-3bfd-485e-b758-82d121d1e655\" (UID: \"522104ed-3bfd-485e-b758-82d121d1e655\") " Jul 22 18:29:09.305342 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:09.305328 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/522104ed-3bfd-485e-b758-82d121d1e655-webhook-cert\") pod \"522104ed-3bfd-485e-b758-82d121d1e655\" (UID: \"522104ed-3bfd-485e-b758-82d121d1e655\") " Jul 22 18:29:09.307524 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:09.307498 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/522104ed-3bfd-485e-b758-82d121d1e655-kube-api-access-c5qb8" (OuterVolumeSpecName: "kube-api-access-c5qb8") pod "522104ed-3bfd-485e-b758-82d121d1e655" (UID: "522104ed-3bfd-485e-b758-82d121d1e655"). InnerVolumeSpecName "kube-api-access-c5qb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:29:09.307524 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:09.307508 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/522104ed-3bfd-485e-b758-82d121d1e655-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "522104ed-3bfd-485e-b758-82d121d1e655" (UID: "522104ed-3bfd-485e-b758-82d121d1e655"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:29:09.406328 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:09.406300 2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/522104ed-3bfd-485e-b758-82d121d1e655-webhook-cert\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:29:09.406328 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:09.406327 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5qb8\" (UniqueName: \"kubernetes.io/projected/522104ed-3bfd-485e-b758-82d121d1e655-kube-api-access-c5qb8\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:29:09.606860 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:09.606831 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ddf6698b6-lqznn"] Jul 22 18:29:09.610917 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:09.610890 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-ddf6698b6-lqznn"] Jul 22 18:29:10.547431 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:10.547380 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="522104ed-3bfd-485e-b758-82d121d1e655" path="/var/lib/kubelet/pods/522104ed-3bfd-485e-b758-82d121d1e655/volumes" Jul 22 18:29:58.745293 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:29:58.745258 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:30:10.437167 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:10.437125 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-ddf6698b6-p6q59"] Jul 22 18:30:10.437609 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:10.437593 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="522104ed-3bfd-485e-b758-82d121d1e655" containerName="manager" Jul 22 18:30:10.437609 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:10.437610 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="522104ed-3bfd-485e-b758-82d121d1e655" containerName="manager" Jul 22 18:30:10.437684 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:10.437671 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="522104ed-3bfd-485e-b758-82d121d1e655" containerName="manager" Jul 22 18:30:10.441773 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:10.441754 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ddf6698b6-p6q59" Jul 22 18:30:10.444406 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:10.444382 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bk8qz\"" Jul 22 18:30:10.444551 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:10.444385 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 22 18:30:10.445371 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:10.445355 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 22 18:30:10.449318 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:10.449278 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ddf6698b6-p6q59"] Jul 22 18:30:10.496281 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:10.496241 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6rkp\" (UniqueName: \"kubernetes.io/projected/82378191-6fe9-414d-917d-30cd93f73e1b-kube-api-access-s6rkp\") pod \"maas-controller-ddf6698b6-p6q59\" (UID: \"82378191-6fe9-414d-917d-30cd93f73e1b\") " pod="opendatahub/maas-controller-ddf6698b6-p6q59" Jul 22 18:30:10.496464 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:10.496288 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82378191-6fe9-414d-917d-30cd93f73e1b-webhook-cert\") pod \"maas-controller-ddf6698b6-p6q59\" (UID: \"82378191-6fe9-414d-917d-30cd93f73e1b\") " pod="opendatahub/maas-controller-ddf6698b6-p6q59" Jul 22 18:30:10.597468 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:10.597412 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82378191-6fe9-414d-917d-30cd93f73e1b-webhook-cert\") pod \"maas-controller-ddf6698b6-p6q59\" (UID: \"82378191-6fe9-414d-917d-30cd93f73e1b\") " pod="opendatahub/maas-controller-ddf6698b6-p6q59" Jul 22 18:30:10.597682 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:10.597577 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6rkp\" (UniqueName: \"kubernetes.io/projected/82378191-6fe9-414d-917d-30cd93f73e1b-kube-api-access-s6rkp\") pod \"maas-controller-ddf6698b6-p6q59\" (UID: \"82378191-6fe9-414d-917d-30cd93f73e1b\") " pod="opendatahub/maas-controller-ddf6698b6-p6q59" Jul 22 18:30:10.600017 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:10.599994 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82378191-6fe9-414d-917d-30cd93f73e1b-webhook-cert\") pod \"maas-controller-ddf6698b6-p6q59\" (UID: \"82378191-6fe9-414d-917d-30cd93f73e1b\") " pod="opendatahub/maas-controller-ddf6698b6-p6q59" Jul 22 18:30:10.606870 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:10.606845 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6rkp\" (UniqueName: \"kubernetes.io/projected/82378191-6fe9-414d-917d-30cd93f73e1b-kube-api-access-s6rkp\") pod \"maas-controller-ddf6698b6-p6q59\" (UID: \"82378191-6fe9-414d-917d-30cd93f73e1b\") " pod="opendatahub/maas-controller-ddf6698b6-p6q59" Jul 22 18:30:10.753575 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:10.753545 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ddf6698b6-p6q59" Jul 22 18:30:11.099670 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:11.099596 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ddf6698b6-p6q59"] Jul 22 18:30:11.105358 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:30:11.105333 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82378191_6fe9_414d_917d_30cd93f73e1b.slice/crio-cb223c97457721085280c7de478367280cc4aeb271be4a092f9dc4496a166771 WatchSource:0}: Error finding container cb223c97457721085280c7de478367280cc4aeb271be4a092f9dc4496a166771: Status 404 returned error can't find the container with id cb223c97457721085280c7de478367280cc4aeb271be4a092f9dc4496a166771 Jul 22 18:30:11.583227 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:11.583197 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ddf6698b6-p6q59" event={"ID":"82378191-6fe9-414d-917d-30cd93f73e1b","Type":"ContainerStarted","Data":"cb223c97457721085280c7de478367280cc4aeb271be4a092f9dc4496a166771"} Jul 22 18:30:14.597972 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:14.597939 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ddf6698b6-p6q59" event={"ID":"82378191-6fe9-414d-917d-30cd93f73e1b","Type":"ContainerStarted","Data":"4959d8b2906be13a2655ef03b9ce13fda4ff2bbabe4db7487beda22f6a8d4024"} Jul 22 18:30:14.598356 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:14.598035 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-ddf6698b6-p6q59" Jul 22 18:30:14.617541 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:14.617473 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-ddf6698b6-p6q59" podStartSLOduration=1.5466235099999999 podStartE2EDuration="4.617455158s" totalImagesPullingTime="3.070831648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:30:14.615276404 +0000 UTC m=+970.540171423" watchObservedRunningTime="2026-07-22 18:30:14.617455158 +0000 UTC m=+970.542350176" Jul 22 18:30:25.606267 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:25.606183 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-ddf6698b6-p6q59" Jul 22 18:30:30.156929 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:30.156890 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:30:30.283349 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:30.283316 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ddf6698b6-p6q59"] Jul 22 18:30:30.283571 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:30.283546 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-ddf6698b6-p6q59" podUID="82378191-6fe9-414d-917d-30cd93f73e1b" containerName="manager" containerID="cri-o://4959d8b2906be13a2655ef03b9ce13fda4ff2bbabe4db7487beda22f6a8d4024" gracePeriod=30 Jul 22 18:30:30.531829 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:30.531807 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ddf6698b6-p6q59" Jul 22 18:30:30.595034 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:30.595007 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6rkp\" (UniqueName: \"kubernetes.io/projected/82378191-6fe9-414d-917d-30cd93f73e1b-kube-api-access-s6rkp\") pod \"82378191-6fe9-414d-917d-30cd93f73e1b\" (UID: \"82378191-6fe9-414d-917d-30cd93f73e1b\") " Jul 22 18:30:30.595218 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:30.595053 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82378191-6fe9-414d-917d-30cd93f73e1b-webhook-cert\") pod \"82378191-6fe9-414d-917d-30cd93f73e1b\" (UID: \"82378191-6fe9-414d-917d-30cd93f73e1b\") " Jul 22 18:30:30.597305 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:30.597273 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82378191-6fe9-414d-917d-30cd93f73e1b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "82378191-6fe9-414d-917d-30cd93f73e1b" (UID: "82378191-6fe9-414d-917d-30cd93f73e1b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 22 18:30:30.597454 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:30.597315 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82378191-6fe9-414d-917d-30cd93f73e1b-kube-api-access-s6rkp" (OuterVolumeSpecName: "kube-api-access-s6rkp") pod "82378191-6fe9-414d-917d-30cd93f73e1b" (UID: "82378191-6fe9-414d-917d-30cd93f73e1b"). InnerVolumeSpecName "kube-api-access-s6rkp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:30:30.672744 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:30.672710 2554 generic.go:356] "Generic (PLEG): container finished" podID="82378191-6fe9-414d-917d-30cd93f73e1b" containerID="4959d8b2906be13a2655ef03b9ce13fda4ff2bbabe4db7487beda22f6a8d4024" exitCode=0 Jul 22 18:30:30.672921 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:30.672760 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ddf6698b6-p6q59" Jul 22 18:30:30.672921 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:30.672790 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ddf6698b6-p6q59" event={"ID":"82378191-6fe9-414d-917d-30cd93f73e1b","Type":"ContainerDied","Data":"4959d8b2906be13a2655ef03b9ce13fda4ff2bbabe4db7487beda22f6a8d4024"} Jul 22 18:30:30.672921 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:30.672844 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ddf6698b6-p6q59" event={"ID":"82378191-6fe9-414d-917d-30cd93f73e1b","Type":"ContainerDied","Data":"cb223c97457721085280c7de478367280cc4aeb271be4a092f9dc4496a166771"} Jul 22 18:30:30.672921 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:30.672873 2554 scope.go:117] "RemoveContainer" containerID="4959d8b2906be13a2655ef03b9ce13fda4ff2bbabe4db7487beda22f6a8d4024" Jul 22 18:30:30.682599 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:30.682565 2554 scope.go:117] "RemoveContainer" containerID="4959d8b2906be13a2655ef03b9ce13fda4ff2bbabe4db7487beda22f6a8d4024" Jul 22 18:30:30.682858 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:30:30.682840 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4959d8b2906be13a2655ef03b9ce13fda4ff2bbabe4db7487beda22f6a8d4024\": container with ID starting with 4959d8b2906be13a2655ef03b9ce13fda4ff2bbabe4db7487beda22f6a8d4024 not found: ID does not exist" containerID="4959d8b2906be13a2655ef03b9ce13fda4ff2bbabe4db7487beda22f6a8d4024" Jul 22 18:30:30.682899 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:30.682869 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4959d8b2906be13a2655ef03b9ce13fda4ff2bbabe4db7487beda22f6a8d4024"} err="failed to get container status \"4959d8b2906be13a2655ef03b9ce13fda4ff2bbabe4db7487beda22f6a8d4024\": rpc error: code = NotFound desc = could not find container \"4959d8b2906be13a2655ef03b9ce13fda4ff2bbabe4db7487beda22f6a8d4024\": container with ID starting with 4959d8b2906be13a2655ef03b9ce13fda4ff2bbabe4db7487beda22f6a8d4024 not found: ID does not exist" Jul 22 18:30:30.694179 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:30.694156 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-ddf6698b6-p6q59"] Jul 22 18:30:30.696591 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:30.696573 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6rkp\" (UniqueName: \"kubernetes.io/projected/82378191-6fe9-414d-917d-30cd93f73e1b-kube-api-access-s6rkp\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:30:30.696648 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:30.696594 2554 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/82378191-6fe9-414d-917d-30cd93f73e1b-webhook-cert\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:30:30.699730 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:30.699710 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-ddf6698b6-p6q59"] Jul 22 18:30:31.410156 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:31.410121 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:30:31.527731 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:31.527700 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-ddf6698b6-vhvv9"] Jul 22 18:30:31.528098 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:31.528086 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82378191-6fe9-414d-917d-30cd93f73e1b" containerName="manager" Jul 22 18:30:31.528142 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:31.528100 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="82378191-6fe9-414d-917d-30cd93f73e1b" containerName="manager" Jul 22 18:30:31.528177 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:31.528165 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="82378191-6fe9-414d-917d-30cd93f73e1b" containerName="manager" Jul 22 18:30:31.532540 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:31.532520 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ddf6698b6-vhvv9" Jul 22 18:30:31.536049 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:31.536029 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 22 18:30:31.536195 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:31.536032 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-bk8qz\"" Jul 22 18:30:31.536195 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:31.536035 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 22 18:30:31.540994 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:31.540976 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ddf6698b6-vhvv9"] Jul 22 18:30:31.604119 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:31.604087 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a268b6e6-64a1-47fe-913f-c566857cba04-webhook-cert\") pod \"maas-controller-ddf6698b6-vhvv9\" (UID: \"a268b6e6-64a1-47fe-913f-c566857cba04\") " pod="opendatahub/maas-controller-ddf6698b6-vhvv9" Jul 22 18:30:31.604292 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:31.604153 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjn24\" (UniqueName: \"kubernetes.io/projected/a268b6e6-64a1-47fe-913f-c566857cba04-kube-api-access-tjn24\") pod \"maas-controller-ddf6698b6-vhvv9\" (UID: \"a268b6e6-64a1-47fe-913f-c566857cba04\") " pod="opendatahub/maas-controller-ddf6698b6-vhvv9" Jul 22 18:30:31.705259 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:31.705157 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a268b6e6-64a1-47fe-913f-c566857cba04-webhook-cert\") pod \"maas-controller-ddf6698b6-vhvv9\" (UID: \"a268b6e6-64a1-47fe-913f-c566857cba04\") " pod="opendatahub/maas-controller-ddf6698b6-vhvv9" Jul 22 18:30:31.705259 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:31.705257 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjn24\" (UniqueName: \"kubernetes.io/projected/a268b6e6-64a1-47fe-913f-c566857cba04-kube-api-access-tjn24\") pod \"maas-controller-ddf6698b6-vhvv9\" (UID: \"a268b6e6-64a1-47fe-913f-c566857cba04\") " pod="opendatahub/maas-controller-ddf6698b6-vhvv9" Jul 22 18:30:31.707908 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:31.707874 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a268b6e6-64a1-47fe-913f-c566857cba04-webhook-cert\") pod \"maas-controller-ddf6698b6-vhvv9\" (UID: \"a268b6e6-64a1-47fe-913f-c566857cba04\") " pod="opendatahub/maas-controller-ddf6698b6-vhvv9" Jul 22 18:30:31.714459 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:31.714412 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjn24\" (UniqueName: \"kubernetes.io/projected/a268b6e6-64a1-47fe-913f-c566857cba04-kube-api-access-tjn24\") pod \"maas-controller-ddf6698b6-vhvv9\" (UID: \"a268b6e6-64a1-47fe-913f-c566857cba04\") " pod="opendatahub/maas-controller-ddf6698b6-vhvv9" Jul 22 18:30:31.843858 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:31.843823 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-ddf6698b6-vhvv9" Jul 22 18:30:31.984718 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:31.984689 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-ddf6698b6-vhvv9"] Jul 22 18:30:31.987196 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:30:31.987164 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda268b6e6_64a1_47fe_913f_c566857cba04.slice/crio-881d3277b791fd0babb6d30e1b5db820284d76cedc9c28d6d3bd9f2610e7d991 WatchSource:0}: Error finding container 881d3277b791fd0babb6d30e1b5db820284d76cedc9c28d6d3bd9f2610e7d991: Status 404 returned error can't find the container with id 881d3277b791fd0babb6d30e1b5db820284d76cedc9c28d6d3bd9f2610e7d991 Jul 22 18:30:32.547395 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:32.547315 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82378191-6fe9-414d-917d-30cd93f73e1b" path="/var/lib/kubelet/pods/82378191-6fe9-414d-917d-30cd93f73e1b/volumes" Jul 22 18:30:32.690231 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:32.690198 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ddf6698b6-vhvv9" event={"ID":"a268b6e6-64a1-47fe-913f-c566857cba04","Type":"ContainerStarted","Data":"effb1a2a8d44e1596e21a19c0ef5675469eb93d865111c920cb961f7b2e9ed0a"} Jul 22 18:30:32.690472 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:32.690246 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-ddf6698b6-vhvv9" event={"ID":"a268b6e6-64a1-47fe-913f-c566857cba04","Type":"ContainerStarted","Data":"881d3277b791fd0babb6d30e1b5db820284d76cedc9c28d6d3bd9f2610e7d991"} Jul 22 18:30:32.690472 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:32.690297 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-ddf6698b6-vhvv9" Jul 22 18:30:32.709370 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:32.709319 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-ddf6698b6-vhvv9" podStartSLOduration=1.413403186 podStartE2EDuration="1.709302632s" totalImagesPullingTime="295.899446ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:30:32.706839362 +0000 UTC m=+988.631734380" watchObservedRunningTime="2026-07-22 18:30:32.709302632 +0000 UTC m=+988.634197650" Jul 22 18:30:43.696583 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:30:43.696552 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-ddf6698b6-vhvv9" Jul 22 18:31:12.158791 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:31:12.158751 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:31:12.212140 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:31:12.212108 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:31:15.304397 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:31:15.304366 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:31:15.399198 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:31:15.399158 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:31:15.552665 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:31:15.552628 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:31:21.613996 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:31:21.613958 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:31:21.720850 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:31:21.720814 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:31:21.813801 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:31:21.813737 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:31:21.981967 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:31:21.981882 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:31:27.917167 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:31:27.917129 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:31:27.984136 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:31:27.984102 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:31:48.895144 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:31:48.895111 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:32:36.297040 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:32:36.297002 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:32:55.228357 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:32:55.228320 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:34:05.319036 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:34:05.319005 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:34:05.325443 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:34:05.325400 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:37:21.981606 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:37:21.981560 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:38:03.897490 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:38:03.897375 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:38:10.682681 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:38:10.682641 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:39:05.348146 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:39:05.348114 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:39:05.354591 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:39:05.354562 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:39:09.625673 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:39:09.625635 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:39:24.647632 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:39:24.647601 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:39:25.027959 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:39:25.027931 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:39:35.389307 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:39:35.389256 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:39:36.293092 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:39:36.293058 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:39:46.870518 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:39:46.870464 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:39:48.298759 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:39:48.298716 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:40:30.335477 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:40:30.335438 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:40:30.436398 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:40:30.436359 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:43:01.821410 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:01.821349 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:43:25.397801 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:25.397767 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:43:28.389658 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:28.389616 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:43:28.488040 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:28.488007 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:43:28.820619 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:28.820588 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:43:32.277262 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:32.277229 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:43:32.334600 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:32.334566 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:43:34.649498 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:34.649464 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:43:35.166701 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.166667 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh"] Jul 22 18:43:35.170119 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.170100 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.172849 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.172825 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-357ba574-openshift-default-dockercfg-kz7mw\"" Jul 22 18:43:35.191885 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.191860 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh"] Jul 22 18:43:35.335474 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.335404 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-token\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.335474 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.335476 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-workload-socket\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.335723 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.335545 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-envoy\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.335723 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.335577 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-data\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.335723 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.335623 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j7p5\" (UniqueName: \"kubernetes.io/projected/502f5c65-38fb-4c38-93c8-543178ca4a06-kube-api-access-7j7p5\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.335723 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.335695 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-workload-certs\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.335856 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.335742 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-credential-socket\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.335856 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.335816 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/502f5c65-38fb-4c38-93c8-543178ca4a06-istiod-ca-cert\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.335924 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.335893 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-podinfo\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.437179 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.437082 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-podinfo\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.437179 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.437143 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-token\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.437179 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.437163 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-workload-socket\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.437179 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.437183 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-envoy\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.437588 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.437200 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-data\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.437588 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.437227 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j7p5\" (UniqueName: \"kubernetes.io/projected/502f5c65-38fb-4c38-93c8-543178ca4a06-kube-api-access-7j7p5\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.437588 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.437253 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-workload-certs\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.437588 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.437397 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-credential-socket\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.437588 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.437496 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/502f5c65-38fb-4c38-93c8-543178ca4a06-istiod-ca-cert\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.437833 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.437718 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-workload-certs\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.437833 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.437762 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-workload-socket\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.437916 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.437898 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-data\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.437961 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.437903 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-credential-socket\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.438220 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.438201 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/502f5c65-38fb-4c38-93c8-543178ca4a06-istiod-ca-cert\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.439878 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.439861 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-envoy\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.440197 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.440176 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-podinfo\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.446889 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.446862 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-token\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.446990 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.446958 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j7p5\" (UniqueName: \"kubernetes.io/projected/502f5c65-38fb-4c38-93c8-543178ca4a06-kube-api-access-7j7p5\") pod \"e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.480902 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.480863 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:35.627391 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.627368 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh"] Jul 22 18:43:35.629506 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:43:35.629479 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod502f5c65_38fb_4c38_93c8_543178ca4a06.slice/crio-3def729537b61b151ec5565c1d8492acbfa190f1111cd867a4a44e46a31ae02d WatchSource:0}: Error finding container 3def729537b61b151ec5565c1d8492acbfa190f1111cd867a4a44e46a31ae02d: Status 404 returned error can't find the container with id 3def729537b61b151ec5565c1d8492acbfa190f1111cd867a4a44e46a31ae02d Jul 22 18:43:35.632148 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.632116 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:43:35.632211 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.632184 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:43:35.632247 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:35.632210 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:43:36.365344 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:36.365310 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" event={"ID":"502f5c65-38fb-4c38-93c8-543178ca4a06","Type":"ContainerStarted","Data":"ec2478af089471bfce490766f266d4b0d1f231e856048085ed70f2205013d00f"} Jul 22 18:43:36.365767 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:36.365365 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" event={"ID":"502f5c65-38fb-4c38-93c8-543178ca4a06","Type":"ContainerStarted","Data":"3def729537b61b151ec5565c1d8492acbfa190f1111cd867a4a44e46a31ae02d"} Jul 22 18:43:36.392136 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:36.392080 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" podStartSLOduration=1.392065498 podStartE2EDuration="1.392065498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:43:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:43:36.39012461 +0000 UTC m=+1772.315019624" watchObservedRunningTime="2026-07-22 18:43:36.392065498 +0000 UTC m=+1772.316960515" Jul 22 18:43:36.481501 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:36.481462 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:36.486875 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:36.486848 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:36.539236 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:36.539200 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:43:36.637711 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:36.637622 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:43:37.370897 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:37.370872 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:37.371863 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:37.371844 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:37.739935 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:37.739899 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:43:37.836808 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:37.836777 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:43:37.980995 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:37.980959 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:43:38.232167 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:38.232081 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:43:38.477920 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:38.477892 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:43:38.577379 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:38.577345 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:43:51.441485 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:51.441453 2554 generic.go:356] "Generic (PLEG): container finished" podID="502f5c65-38fb-4c38-93c8-543178ca4a06" containerID="ec2478af089471bfce490766f266d4b0d1f231e856048085ed70f2205013d00f" exitCode=0 Jul 22 18:43:51.441898 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:51.441499 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" event={"ID":"502f5c65-38fb-4c38-93c8-543178ca4a06","Type":"ContainerDied","Data":"ec2478af089471bfce490766f266d4b0d1f231e856048085ed70f2205013d00f"} Jul 22 18:43:51.441898 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:51.441893 2554 scope.go:117] "RemoveContainer" containerID="ec2478af089471bfce490766f266d4b0d1f231e856048085ed70f2205013d00f" Jul 22 18:43:51.442897 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:51.442870 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:43:51.442955 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:51.442937 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:43:51.442990 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:51.442966 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:43:52.371202 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:52.371144 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:52.448389 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:52.448356 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" event={"ID":"502f5c65-38fb-4c38-93c8-543178ca4a06","Type":"ContainerStarted","Data":"b4018445c005ed2262b2c748851775ec3a87511db63393edc2da28f0d764207f"} Jul 22 18:43:52.481464 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:52.481427 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:52.482891 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:52.482855 2554 patch_prober.go:28] interesting pod/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 22 18:43:52.483076 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:52.482938 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" podUID="502f5c65-38fb-4c38-93c8-543178ca4a06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 22 18:43:53.482310 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:53.482269 2554 patch_prober.go:28] interesting pod/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 22 18:43:53.482971 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:53.482938 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" podUID="502f5c65-38fb-4c38-93c8-543178ca4a06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 22 18:43:54.482286 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:54.482248 2554 patch_prober.go:28] interesting pod/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 22 18:43:54.482570 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:54.482540 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" podUID="502f5c65-38fb-4c38-93c8-543178ca4a06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 22 18:43:55.481844 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:55.481312 2554 patch_prober.go:28] interesting pod/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" start-of-body= Jul 22 18:43:55.481844 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:55.481376 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" podUID="502f5c65-38fb-4c38-93c8-543178ca4a06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.37:15021/healthz/ready\": dial tcp 10.133.0.37:15021: connect: connection refused" Jul 22 18:43:56.485565 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:56.485527 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:56.486048 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:56.485918 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:43:56.486653 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:43:56.486633 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:44:05.377834 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:05.377805 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:44:05.383876 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:05.383855 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:44:13.942697 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:13.942660 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:44:18.466348 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:18.466311 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:44:18.620279 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:18.620241 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh"] Jul 22 18:44:18.620565 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:18.620516 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" podUID="502f5c65-38fb-4c38-93c8-543178ca4a06" containerName="istio-proxy" containerID="cri-o://b4018445c005ed2262b2c748851775ec3a87511db63393edc2da28f0d764207f" gracePeriod=30 Jul 22 18:44:18.637766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:18.637737 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:44:18.944186 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:18.944146 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:44:19.167051 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.167008 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:44:19.265761 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.265729 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:44:19.367901 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.367848 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:44:19.651649 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.651558 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42"] Jul 22 18:44:19.655355 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.655334 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.658133 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.658114 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-e37eed10-gw-openshift-default-dockercfg-d78pk\"" Jul 22 18:44:19.666940 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.666912 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42"] Jul 22 18:44:19.682343 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.682306 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-workload-socket\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.682532 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.682349 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-podinfo\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.682532 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.682376 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-envoy\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.682532 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.682482 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istiod-ca-cert\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.682648 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.682536 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-data\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.682648 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.682608 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9t6p\" (UniqueName: \"kubernetes.io/projected/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-kube-api-access-b9t6p\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.682648 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.682635 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-token\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.682791 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.682655 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-credential-socket\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.682846 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.682797 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-workload-certs\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.698200 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.698170 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:44:19.784394 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.784361 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-workload-certs\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.784584 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.784450 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-workload-socket\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.784584 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.784481 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-podinfo\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.784584 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.784505 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-envoy\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.784746 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.784628 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istiod-ca-cert\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.784746 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.784678 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-data\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.784746 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.784721 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9t6p\" (UniqueName: \"kubernetes.io/projected/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-kube-api-access-b9t6p\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.784906 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.784751 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-token\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.784906 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.784780 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-credential-socket\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.785013 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.784900 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-workload-certs\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.785108 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.785083 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-data\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.785434 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.785369 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istiod-ca-cert\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.785599 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.785503 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-workload-socket\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.785663 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.785628 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-credential-socket\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.787046 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.787021 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-envoy\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.787344 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.787324 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-podinfo\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.793777 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.793752 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-token\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.793996 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.793977 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9t6p\" (UniqueName: \"kubernetes.io/projected/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-kube-api-access-b9t6p\") pod \"e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:19.968888 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:19.968792 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:20.117619 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:20.117593 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42"] Jul 22 18:44:20.120162 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:44:20.120132 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1dfed5_e355_4762_b4a3_d8ec6b9b5a2f.slice/crio-7e1fc1c8c1877b108d071571dfcf11e5a2de921c49b760ccfc483d038d12a89b WatchSource:0}: Error finding container 7e1fc1c8c1877b108d071571dfcf11e5a2de921c49b760ccfc483d038d12a89b: Status 404 returned error can't find the container with id 7e1fc1c8c1877b108d071571dfcf11e5a2de921c49b760ccfc483d038d12a89b Jul 22 18:44:20.122533 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:20.122505 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:44:20.122624 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:20.122565 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:44:20.122624 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:20.122596 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:44:20.391202 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:20.391163 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:44:20.581903 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:20.581869 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" event={"ID":"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f","Type":"ContainerStarted","Data":"2217b3d85587c30bc1b02260e1a44df9005493cc36657960e9f8400a97ddfe15"} Jul 22 18:44:20.582089 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:20.581928 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" event={"ID":"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f","Type":"ContainerStarted","Data":"7e1fc1c8c1877b108d071571dfcf11e5a2de921c49b760ccfc483d038d12a89b"} Jul 22 18:44:20.601451 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:20.601376 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" podStartSLOduration=1.601359625 podStartE2EDuration="1.601359625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:44:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:44:20.599298151 +0000 UTC m=+1816.524193180" watchObservedRunningTime="2026-07-22 18:44:20.601359625 +0000 UTC m=+1816.526254643" Jul 22 18:44:20.969088 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:20.969051 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:21.974787 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:21.974756 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:22.062777 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:22.062744 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:44:22.186442 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:22.186384 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:44:22.591767 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:22.591738 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:22.592834 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:22.592817 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:22.695753 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:22.695720 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:44:22.795801 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:22.795760 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:44:23.882730 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:23.882659 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:44:23.925657 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:23.925622 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-data\") pod \"502f5c65-38fb-4c38-93c8-543178ca4a06\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " Jul 22 18:44:23.925930 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:23.925696 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7j7p5\" (UniqueName: \"kubernetes.io/projected/502f5c65-38fb-4c38-93c8-543178ca4a06-kube-api-access-7j7p5\") pod \"502f5c65-38fb-4c38-93c8-543178ca4a06\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " Jul 22 18:44:23.925930 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:23.925755 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-envoy\") pod \"502f5c65-38fb-4c38-93c8-543178ca4a06\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " Jul 22 18:44:23.925930 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:23.925802 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-workload-certs\") pod \"502f5c65-38fb-4c38-93c8-543178ca4a06\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " Jul 22 18:44:23.925930 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:23.925834 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-podinfo\") pod \"502f5c65-38fb-4c38-93c8-543178ca4a06\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " Jul 22 18:44:23.925930 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:23.925906 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-workload-socket\") pod \"502f5c65-38fb-4c38-93c8-543178ca4a06\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " Jul 22 18:44:23.926190 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:23.925972 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-token\") pod \"502f5c65-38fb-4c38-93c8-543178ca4a06\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " Jul 22 18:44:23.926190 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:23.925994 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/502f5c65-38fb-4c38-93c8-543178ca4a06-istiod-ca-cert\") pod \"502f5c65-38fb-4c38-93c8-543178ca4a06\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " Jul 22 18:44:23.926190 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:23.926027 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-credential-socket\") pod \"502f5c65-38fb-4c38-93c8-543178ca4a06\" (UID: \"502f5c65-38fb-4c38-93c8-543178ca4a06\") " Jul 22 18:44:23.926336 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:23.926299 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "502f5c65-38fb-4c38-93c8-543178ca4a06" (UID: "502f5c65-38fb-4c38-93c8-543178ca4a06"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:44:23.926553 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:23.926520 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-workload-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:44:23.926678 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:23.926531 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "502f5c65-38fb-4c38-93c8-543178ca4a06" (UID: "502f5c65-38fb-4c38-93c8-543178ca4a06"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:44:23.926734 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:23.926670 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-data" (OuterVolumeSpecName: "istio-data") pod "502f5c65-38fb-4c38-93c8-543178ca4a06" (UID: "502f5c65-38fb-4c38-93c8-543178ca4a06"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:44:23.926734 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:23.926709 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "502f5c65-38fb-4c38-93c8-543178ca4a06" (UID: "502f5c65-38fb-4c38-93c8-543178ca4a06"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:44:23.926990 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:23.926955 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/502f5c65-38fb-4c38-93c8-543178ca4a06-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "502f5c65-38fb-4c38-93c8-543178ca4a06" (UID: "502f5c65-38fb-4c38-93c8-543178ca4a06"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:44:23.928453 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:23.928395 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "502f5c65-38fb-4c38-93c8-543178ca4a06" (UID: "502f5c65-38fb-4c38-93c8-543178ca4a06"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:44:23.928552 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:23.928452 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/502f5c65-38fb-4c38-93c8-543178ca4a06-kube-api-access-7j7p5" (OuterVolumeSpecName: "kube-api-access-7j7p5") pod "502f5c65-38fb-4c38-93c8-543178ca4a06" (UID: "502f5c65-38fb-4c38-93c8-543178ca4a06"). InnerVolumeSpecName "kube-api-access-7j7p5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:44:23.929093 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:23.929072 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "502f5c65-38fb-4c38-93c8-543178ca4a06" (UID: "502f5c65-38fb-4c38-93c8-543178ca4a06"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 18:44:23.929172 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:23.929098 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-token" (OuterVolumeSpecName: "istio-token") pod "502f5c65-38fb-4c38-93c8-543178ca4a06" (UID: "502f5c65-38fb-4c38-93c8-543178ca4a06"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:44:24.027606 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:24.027574 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-envoy\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:44:24.027606 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:24.027601 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-workload-certs\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:44:24.027606 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:24.027611 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-podinfo\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:44:24.027851 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:24.027618 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-token\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:44:24.027851 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:24.027625 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/502f5c65-38fb-4c38-93c8-543178ca4a06-istiod-ca-cert\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:44:24.027851 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:24.027633 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-credential-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:44:24.027851 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:24.027642 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/502f5c65-38fb-4c38-93c8-543178ca4a06-istio-data\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:44:24.027851 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:24.027650 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7j7p5\" (UniqueName: \"kubernetes.io/projected/502f5c65-38fb-4c38-93c8-543178ca4a06-kube-api-access-7j7p5\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:44:24.602993 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:24.602955 2554 generic.go:356] "Generic (PLEG): container finished" podID="502f5c65-38fb-4c38-93c8-543178ca4a06" containerID="b4018445c005ed2262b2c748851775ec3a87511db63393edc2da28f0d764207f" exitCode=0 Jul 22 18:44:24.603193 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:24.603008 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" Jul 22 18:44:24.603193 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:24.603033 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" event={"ID":"502f5c65-38fb-4c38-93c8-543178ca4a06","Type":"ContainerDied","Data":"b4018445c005ed2262b2c748851775ec3a87511db63393edc2da28f0d764207f"} Jul 22 18:44:24.603193 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:24.603088 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh" event={"ID":"502f5c65-38fb-4c38-93c8-543178ca4a06","Type":"ContainerDied","Data":"3def729537b61b151ec5565c1d8492acbfa190f1111cd867a4a44e46a31ae02d"} Jul 22 18:44:24.603193 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:24.603110 2554 scope.go:117] "RemoveContainer" containerID="b4018445c005ed2262b2c748851775ec3a87511db63393edc2da28f0d764207f" Jul 22 18:44:24.612212 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:24.612189 2554 scope.go:117] "RemoveContainer" containerID="ec2478af089471bfce490766f266d4b0d1f231e856048085ed70f2205013d00f" Jul 22 18:44:24.620857 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:24.620835 2554 scope.go:117] "RemoveContainer" containerID="b4018445c005ed2262b2c748851775ec3a87511db63393edc2da28f0d764207f" Jul 22 18:44:24.621145 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:44:24.621125 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4018445c005ed2262b2c748851775ec3a87511db63393edc2da28f0d764207f\": container with ID starting with b4018445c005ed2262b2c748851775ec3a87511db63393edc2da28f0d764207f not found: ID does not exist" containerID="b4018445c005ed2262b2c748851775ec3a87511db63393edc2da28f0d764207f" Jul 22 18:44:24.621211 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:24.621159 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4018445c005ed2262b2c748851775ec3a87511db63393edc2da28f0d764207f"} err="failed to get container status \"b4018445c005ed2262b2c748851775ec3a87511db63393edc2da28f0d764207f\": rpc error: code = NotFound desc = could not find container \"b4018445c005ed2262b2c748851775ec3a87511db63393edc2da28f0d764207f\": container with ID starting with b4018445c005ed2262b2c748851775ec3a87511db63393edc2da28f0d764207f not found: ID does not exist" Jul 22 18:44:24.621211 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:24.621177 2554 scope.go:117] "RemoveContainer" containerID="ec2478af089471bfce490766f266d4b0d1f231e856048085ed70f2205013d00f" Jul 22 18:44:24.621436 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:44:24.621388 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec2478af089471bfce490766f266d4b0d1f231e856048085ed70f2205013d00f\": container with ID starting with ec2478af089471bfce490766f266d4b0d1f231e856048085ed70f2205013d00f not found: ID does not exist" containerID="ec2478af089471bfce490766f266d4b0d1f231e856048085ed70f2205013d00f" Jul 22 18:44:24.621488 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:24.621437 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec2478af089471bfce490766f266d4b0d1f231e856048085ed70f2205013d00f"} err="failed to get container status \"ec2478af089471bfce490766f266d4b0d1f231e856048085ed70f2205013d00f\": rpc error: code = NotFound desc = could not find container \"ec2478af089471bfce490766f266d4b0d1f231e856048085ed70f2205013d00f\": container with ID starting with ec2478af089471bfce490766f266d4b0d1f231e856048085ed70f2205013d00f not found: ID does not exist" Jul 22 18:44:24.652228 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:24.652181 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh"] Jul 22 18:44:24.657535 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:24.657501 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-357ba574-openshift-default-5c66f6bf4c-zfwmh"] Jul 22 18:44:26.548161 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:26.548130 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="502f5c65-38fb-4c38-93c8-543178ca4a06" path="/var/lib/kubelet/pods/502f5c65-38fb-4c38-93c8-543178ca4a06/volumes" Jul 22 18:44:35.658704 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:35.658669 2554 generic.go:356] "Generic (PLEG): container finished" podID="ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" containerID="2217b3d85587c30bc1b02260e1a44df9005493cc36657960e9f8400a97ddfe15" exitCode=0 Jul 22 18:44:35.659162 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:35.658737 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" event={"ID":"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f","Type":"ContainerDied","Data":"2217b3d85587c30bc1b02260e1a44df9005493cc36657960e9f8400a97ddfe15"} Jul 22 18:44:35.659162 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:35.659144 2554 scope.go:117] "RemoveContainer" containerID="2217b3d85587c30bc1b02260e1a44df9005493cc36657960e9f8400a97ddfe15" Jul 22 18:44:35.660152 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:35.660125 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:44:35.660217 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:35.660195 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:44:35.660257 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:35.660230 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:44:36.665828 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:36.665788 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" event={"ID":"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f","Type":"ContainerStarted","Data":"fbcd4a1ba7313851881732370f8de3428f311a94d8e0cac56fb7adf4c9310146"} Jul 22 18:44:36.969538 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:36.969399 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:36.971324 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:36.971284 2554 patch_prober.go:28] interesting pod/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 22 18:44:36.971525 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:36.971365 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" podUID="ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 22 18:44:37.592229 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:37.592198 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:37.969570 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:37.969471 2554 patch_prober.go:28] interesting pod/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 22 18:44:37.970171 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:37.970138 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" podUID="ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 22 18:44:38.969990 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:38.969950 2554 patch_prober.go:28] interesting pod/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 22 18:44:38.970629 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:38.970594 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" podUID="ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 22 18:44:39.969784 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:39.969742 2554 patch_prober.go:28] interesting pod/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 22 18:44:39.970004 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:39.969816 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" podUID="ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 22 18:44:40.974047 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:40.974016 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:40.975349 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:40.975328 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:44:57.674653 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:44:57.674594 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:02.180626 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:02.180592 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:02.342164 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:02.342133 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42"] Jul 22 18:45:02.342398 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:02.342373 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" podUID="ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" containerName="istio-proxy" containerID="cri-o://fbcd4a1ba7313851881732370f8de3428f311a94d8e0cac56fb7adf4c9310146" gracePeriod=30 Jul 22 18:45:02.366100 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:02.366068 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:02.585644 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:02.585609 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:02.823351 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:02.823314 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:03.106047 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.106017 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p"] Jul 22 18:45:03.106457 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.106444 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="502f5c65-38fb-4c38-93c8-543178ca4a06" containerName="istio-proxy" Jul 22 18:45:03.106507 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.106459 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="502f5c65-38fb-4c38-93c8-543178ca4a06" containerName="istio-proxy" Jul 22 18:45:03.106507 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.106471 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="502f5c65-38fb-4c38-93c8-543178ca4a06" containerName="istio-proxy" Jul 22 18:45:03.106507 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.106477 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="502f5c65-38fb-4c38-93c8-543178ca4a06" containerName="istio-proxy" Jul 22 18:45:03.106606 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.106553 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="502f5c65-38fb-4c38-93c8-543178ca4a06" containerName="istio-proxy" Jul 22 18:45:03.106606 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.106566 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="502f5c65-38fb-4c38-93c8-543178ca4a06" containerName="istio-proxy" Jul 22 18:45:03.110067 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.110050 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.112704 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.112685 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-cc99fc0b-openshift-default-dockercfg-djxhl\"" Jul 22 18:45:03.120845 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.120818 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p"] Jul 22 18:45:03.128732 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.128710 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:03.217797 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.217758 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/478b2bfe-dec0-4910-a07d-b273f881784a-istio-podinfo\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.218314 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.217818 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-workload-certs\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.218314 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.217838 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/478b2bfe-dec0-4910-a07d-b273f881784a-istiod-ca-cert\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.218314 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.217941 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/478b2bfe-dec0-4910-a07d-b273f881784a-istio-token\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.218314 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.217984 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4wz4\" (UniqueName: \"kubernetes.io/projected/478b2bfe-dec0-4910-a07d-b273f881784a-kube-api-access-m4wz4\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.218314 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.218090 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-credential-socket\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.218314 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.218120 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-istio-data\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.218314 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.218186 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-workload-socket\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.218314 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.218211 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-istio-envoy\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.230036 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.230004 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:03.319288 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.319245 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-credential-socket\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.319288 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.319286 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-istio-data\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.319604 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.319317 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-workload-socket\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.319604 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.319334 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-istio-envoy\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.319604 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.319353 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/478b2bfe-dec0-4910-a07d-b273f881784a-istio-podinfo\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.319604 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.319400 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-workload-certs\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.319604 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.319453 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/478b2bfe-dec0-4910-a07d-b273f881784a-istiod-ca-cert\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.319604 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.319508 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/478b2bfe-dec0-4910-a07d-b273f881784a-istio-token\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.319604 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.319534 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4wz4\" (UniqueName: \"kubernetes.io/projected/478b2bfe-dec0-4910-a07d-b273f881784a-kube-api-access-m4wz4\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.319961 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.319742 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-workload-socket\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.319961 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.319825 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-istio-data\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.319961 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.319843 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-credential-socket\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.320291 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.320032 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-workload-certs\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.320734 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.320705 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/478b2bfe-dec0-4910-a07d-b273f881784a-istiod-ca-cert\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.321906 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.321886 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-istio-envoy\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.322160 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.322141 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/478b2bfe-dec0-4910-a07d-b273f881784a-istio-podinfo\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.327507 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.327485 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/478b2bfe-dec0-4910-a07d-b273f881784a-istio-token\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.327599 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.327544 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4wz4\" (UniqueName: \"kubernetes.io/projected/478b2bfe-dec0-4910-a07d-b273f881784a-kube-api-access-m4wz4\") pod \"e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.422324 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.422186 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:03.568725 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.568692 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p"] Jul 22 18:45:03.572635 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:45:03.572606 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod478b2bfe_dec0_4910_a07d_b273f881784a.slice/crio-6366c772fa95cf58e9b52c4e4d58401d2a93bf08c0541e0c6203398122de4cbb WatchSource:0}: Error finding container 6366c772fa95cf58e9b52c4e4d58401d2a93bf08c0541e0c6203398122de4cbb: Status 404 returned error can't find the container with id 6366c772fa95cf58e9b52c4e4d58401d2a93bf08c0541e0c6203398122de4cbb Jul 22 18:45:03.574932 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.574897 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:45:03.575014 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.574985 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:45:03.575061 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.575024 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:45:03.804737 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.804705 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" event={"ID":"478b2bfe-dec0-4910-a07d-b273f881784a","Type":"ContainerStarted","Data":"dcd3b208383fe7f3d01830d635c41815e9e8bda4ef91083fa0a43b95d35eb98d"} Jul 22 18:45:03.804917 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:03.804754 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" event={"ID":"478b2bfe-dec0-4910-a07d-b273f881784a","Type":"ContainerStarted","Data":"6366c772fa95cf58e9b52c4e4d58401d2a93bf08c0541e0c6203398122de4cbb"} Jul 22 18:45:04.422622 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:04.422586 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:04.427663 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:04.427641 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:04.449574 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:04.449527 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" podStartSLOduration=1.449510213 podStartE2EDuration="1.449510213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:45:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:45:03.826358116 +0000 UTC m=+1859.751253133" watchObservedRunningTime="2026-07-22 18:45:04.449510213 +0000 UTC m=+1860.374405231" Jul 22 18:45:04.809873 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:04.809846 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:04.810919 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:04.810902 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:05.241451 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:05.241397 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:05.409382 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:05.409333 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:05.843001 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:05.842961 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:05.982181 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:05.982134 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:06.082317 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:06.082283 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:07.590635 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.590612 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:45:07.669330 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.669233 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9t6p\" (UniqueName: \"kubernetes.io/projected/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-kube-api-access-b9t6p\") pod \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " Jul 22 18:45:07.669330 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.669316 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-envoy\") pod \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " Jul 22 18:45:07.669602 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.669346 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-credential-socket\") pod \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " Jul 22 18:45:07.669602 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.669387 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istiod-ca-cert\") pod \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " Jul 22 18:45:07.669602 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.669457 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-workload-socket\") pod \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " Jul 22 18:45:07.669602 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.669501 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-podinfo\") pod \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " Jul 22 18:45:07.669602 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.669535 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-workload-certs\") pod \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " Jul 22 18:45:07.669602 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.669589 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-token\") pod \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " Jul 22 18:45:07.669904 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.669646 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-data\") pod \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\" (UID: \"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f\") " Jul 22 18:45:07.669904 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.669738 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" (UID: "ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:45:07.669904 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.669886 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" (UID: "ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:45:07.670211 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.669911 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" (UID: "ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:45:07.670211 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.669967 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" (UID: "ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:45:07.671049 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.671023 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-data" (OuterVolumeSpecName: "istio-data") pod "ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" (UID: "ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:45:07.671503 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.671393 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-credential-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:45:07.671503 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.671442 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istiod-ca-cert\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:45:07.671503 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.671458 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-workload-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:45:07.671503 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.671468 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-workload-certs\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:45:07.671503 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.671479 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-data\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:45:07.671847 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.671828 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" (UID: "ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:45:07.672129 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.672107 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" (UID: "ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 18:45:07.672248 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.672233 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-token" (OuterVolumeSpecName: "istio-token") pod "ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" (UID: "ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:45:07.672305 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.672256 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-kube-api-access-b9t6p" (OuterVolumeSpecName: "kube-api-access-b9t6p") pod "ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" (UID: "ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f"). InnerVolumeSpecName "kube-api-access-b9t6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:45:07.772105 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.772053 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9t6p\" (UniqueName: \"kubernetes.io/projected/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-kube-api-access-b9t6p\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:45:07.772105 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.772098 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-envoy\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:45:07.772105 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.772110 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-podinfo\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:45:07.772358 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.772124 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f-istio-token\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:45:07.827593 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.827558 2554 generic.go:356] "Generic (PLEG): container finished" podID="ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" containerID="fbcd4a1ba7313851881732370f8de3428f311a94d8e0cac56fb7adf4c9310146" exitCode=0 Jul 22 18:45:07.827737 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.827607 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" Jul 22 18:45:07.827737 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.827634 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" event={"ID":"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f","Type":"ContainerDied","Data":"fbcd4a1ba7313851881732370f8de3428f311a94d8e0cac56fb7adf4c9310146"} Jul 22 18:45:07.827737 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.827683 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42" event={"ID":"ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f","Type":"ContainerDied","Data":"7e1fc1c8c1877b108d071571dfcf11e5a2de921c49b760ccfc483d038d12a89b"} Jul 22 18:45:07.827737 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.827706 2554 scope.go:117] "RemoveContainer" containerID="fbcd4a1ba7313851881732370f8de3428f311a94d8e0cac56fb7adf4c9310146" Jul 22 18:45:07.836819 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.836804 2554 scope.go:117] "RemoveContainer" containerID="2217b3d85587c30bc1b02260e1a44df9005493cc36657960e9f8400a97ddfe15" Jul 22 18:45:07.844646 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.844625 2554 scope.go:117] "RemoveContainer" containerID="fbcd4a1ba7313851881732370f8de3428f311a94d8e0cac56fb7adf4c9310146" Jul 22 18:45:07.844924 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:45:07.844907 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbcd4a1ba7313851881732370f8de3428f311a94d8e0cac56fb7adf4c9310146\": container with ID starting with fbcd4a1ba7313851881732370f8de3428f311a94d8e0cac56fb7adf4c9310146 not found: ID does not exist" containerID="fbcd4a1ba7313851881732370f8de3428f311a94d8e0cac56fb7adf4c9310146" Jul 22 18:45:07.844992 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.844933 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbcd4a1ba7313851881732370f8de3428f311a94d8e0cac56fb7adf4c9310146"} err="failed to get container status \"fbcd4a1ba7313851881732370f8de3428f311a94d8e0cac56fb7adf4c9310146\": rpc error: code = NotFound desc = could not find container \"fbcd4a1ba7313851881732370f8de3428f311a94d8e0cac56fb7adf4c9310146\": container with ID starting with fbcd4a1ba7313851881732370f8de3428f311a94d8e0cac56fb7adf4c9310146 not found: ID does not exist" Jul 22 18:45:07.844992 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.844949 2554 scope.go:117] "RemoveContainer" containerID="2217b3d85587c30bc1b02260e1a44df9005493cc36657960e9f8400a97ddfe15" Jul 22 18:45:07.845187 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:45:07.845168 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2217b3d85587c30bc1b02260e1a44df9005493cc36657960e9f8400a97ddfe15\": container with ID starting with 2217b3d85587c30bc1b02260e1a44df9005493cc36657960e9f8400a97ddfe15 not found: ID does not exist" containerID="2217b3d85587c30bc1b02260e1a44df9005493cc36657960e9f8400a97ddfe15" Jul 22 18:45:07.845236 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.845198 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2217b3d85587c30bc1b02260e1a44df9005493cc36657960e9f8400a97ddfe15"} err="failed to get container status \"2217b3d85587c30bc1b02260e1a44df9005493cc36657960e9f8400a97ddfe15\": rpc error: code = NotFound desc = could not find container \"2217b3d85587c30bc1b02260e1a44df9005493cc36657960e9f8400a97ddfe15\": container with ID starting with 2217b3d85587c30bc1b02260e1a44df9005493cc36657960e9f8400a97ddfe15 not found: ID does not exist" Jul 22 18:45:07.848606 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.848585 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42"] Jul 22 18:45:07.852214 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:07.852193 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-e37eed10-gw-openshift-default-75975459dc-76h42"] Jul 22 18:45:08.547062 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:08.547031 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" path="/var/lib/kubelet/pods/ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f/volumes" Jul 22 18:45:19.811215 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:19.811176 2554 patch_prober.go:28] interesting pod/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 22 18:45:19.811674 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:19.811252 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" podUID="478b2bfe-dec0-4910-a07d-b273f881784a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 22 18:45:19.888059 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:19.888025 2554 generic.go:356] "Generic (PLEG): container finished" podID="478b2bfe-dec0-4910-a07d-b273f881784a" containerID="dcd3b208383fe7f3d01830d635c41815e9e8bda4ef91083fa0a43b95d35eb98d" exitCode=0 Jul 22 18:45:19.888237 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:19.888098 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" event={"ID":"478b2bfe-dec0-4910-a07d-b273f881784a","Type":"ContainerDied","Data":"dcd3b208383fe7f3d01830d635c41815e9e8bda4ef91083fa0a43b95d35eb98d"} Jul 22 18:45:19.888540 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:19.888526 2554 scope.go:117] "RemoveContainer" containerID="dcd3b208383fe7f3d01830d635c41815e9e8bda4ef91083fa0a43b95d35eb98d" Jul 22 18:45:19.889489 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:19.889466 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:45:19.889552 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:19.889529 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:45:19.889588 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:19.889562 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:45:20.896048 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:20.896011 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" event={"ID":"478b2bfe-dec0-4910-a07d-b273f881784a","Type":"ContainerStarted","Data":"d6de76bf32a1d7db8de169d056b2dbe028fe384c9016884f29d9993bf37204ee"} Jul 22 18:45:21.423309 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:21.423275 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:21.423680 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:21.423551 2554 patch_prober.go:28] interesting pod/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 22 18:45:21.423796 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:21.423720 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" podUID="478b2bfe-dec0-4910-a07d-b273f881784a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 22 18:45:22.423431 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:22.423390 2554 patch_prober.go:28] interesting pod/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 22 18:45:22.423829 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:22.423480 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" podUID="478b2bfe-dec0-4910-a07d-b273f881784a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 22 18:45:23.423366 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:23.423329 2554 patch_prober.go:28] interesting pod/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 22 18:45:23.423632 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:23.423395 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" podUID="478b2bfe-dec0-4910-a07d-b273f881784a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 22 18:45:24.423218 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:24.423182 2554 patch_prober.go:28] interesting pod/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" start-of-body= Jul 22 18:45:24.423407 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:24.423242 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" podUID="478b2bfe-dec0-4910-a07d-b273f881784a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.39:15021/healthz/ready\": dial tcp 10.133.0.39:15021: connect: connection refused" Jul 22 18:45:25.426337 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:25.426253 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:25.426829 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:25.426727 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:25.427503 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:25.427483 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:34.840688 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:34.840651 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:41.791509 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:41.791475 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:46.320158 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:46.320124 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:47.535499 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:47.535468 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p"] Jul 22 18:45:47.535934 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:47.535678 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" podUID="478b2bfe-dec0-4910-a07d-b273f881784a" containerName="istio-proxy" containerID="cri-o://d6de76bf32a1d7db8de169d056b2dbe028fe384c9016884f29d9993bf37204ee" gracePeriod=30 Jul 22 18:45:47.550441 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:47.550385 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:47.807469 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:47.807360 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:48.020037 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.020006 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:48.326642 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.326609 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t"] Jul 22 18:45:48.327051 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.327033 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" containerName="istio-proxy" Jul 22 18:45:48.327135 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.327054 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" containerName="istio-proxy" Jul 22 18:45:48.327199 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.327186 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" containerName="istio-proxy" Jul 22 18:45:48.327255 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.327204 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" containerName="istio-proxy" Jul 22 18:45:48.330198 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.330181 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.332717 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.332699 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-95d099d7-openshift-default-dockercfg-xfd2t\"" Jul 22 18:45:48.343646 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.343621 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t"] Jul 22 18:45:48.351012 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.350984 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:48.478449 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.478384 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-workload-certs\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.478449 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.478430 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-data\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.478449 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.478455 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-workload-socket\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.478700 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.478516 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-token\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.478700 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.478572 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-envoy\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.478700 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.478638 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f865b096-3181-40a6-abfb-46cd6be3fa9e-istiod-ca-cert\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.478700 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.478656 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrjwx\" (UniqueName: \"kubernetes.io/projected/f865b096-3181-40a6-abfb-46cd6be3fa9e-kube-api-access-xrjwx\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.478832 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.478711 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-credential-socket\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.478832 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.478733 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-podinfo\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.579560 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.579487 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-credential-socket\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.579560 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.579534 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-podinfo\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.580076 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.579579 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-workload-certs\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.580076 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.579601 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-data\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.580076 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.579624 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-workload-socket\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.580076 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.579648 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-token\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.580076 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.579687 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-envoy\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.580076 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.579751 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f865b096-3181-40a6-abfb-46cd6be3fa9e-istiod-ca-cert\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.580076 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.579776 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrjwx\" (UniqueName: \"kubernetes.io/projected/f865b096-3181-40a6-abfb-46cd6be3fa9e-kube-api-access-xrjwx\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.580076 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.580011 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-workload-certs\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.580076 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.580049 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-workload-socket\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.580471 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.580129 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-credential-socket\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.580471 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.580166 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-data\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.580568 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.580506 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f865b096-3181-40a6-abfb-46cd6be3fa9e-istiod-ca-cert\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.582008 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.581989 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-envoy\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.582129 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.582091 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-podinfo\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.592190 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.592165 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrjwx\" (UniqueName: \"kubernetes.io/projected/f865b096-3181-40a6-abfb-46cd6be3fa9e-kube-api-access-xrjwx\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.592910 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.592856 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:48.593027 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.592939 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-token\") pod \"e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.643913 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.643874 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:48.787748 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.787722 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t"] Jul 22 18:45:48.789264 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:45:48.789243 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf865b096_3181_40a6_abfb_46cd6be3fa9e.slice/crio-44fe9105738721a6c9168f4226b3fb78da6bbafd5972d837f9b45f733d297333 WatchSource:0}: Error finding container 44fe9105738721a6c9168f4226b3fb78da6bbafd5972d837f9b45f733d297333: Status 404 returned error can't find the container with id 44fe9105738721a6c9168f4226b3fb78da6bbafd5972d837f9b45f733d297333 Jul 22 18:45:48.791485 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.791452 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:45:48.791583 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.791528 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:45:48.791583 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:48.791571 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:45:49.037100 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:49.037066 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" event={"ID":"f865b096-3181-40a6-abfb-46cd6be3fa9e","Type":"ContainerStarted","Data":"de2f2932f74b5bf1f78ac23bd13892d72d3eb3c6eddf3b61b6a256120a450b76"} Jul 22 18:45:49.037294 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:49.037121 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" event={"ID":"f865b096-3181-40a6-abfb-46cd6be3fa9e","Type":"ContainerStarted","Data":"44fe9105738721a6c9168f4226b3fb78da6bbafd5972d837f9b45f733d297333"} Jul 22 18:45:49.077522 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:49.077471 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" podStartSLOduration=1.077453558 podStartE2EDuration="1.077453558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:45:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:45:49.07547367 +0000 UTC m=+1905.000368688" watchObservedRunningTime="2026-07-22 18:45:49.077453558 +0000 UTC m=+1905.002348572" Jul 22 18:45:49.644499 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:49.644460 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:49.649636 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:49.649610 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:50.042179 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:50.042153 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:50.043513 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:50.043498 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:45:50.440221 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:50.440139 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:50.545270 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:50.545235 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:50.640278 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:50.640211 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:50.867387 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:50.867329 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:52.784286 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.784257 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:52.915176 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.915090 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:52.924233 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.924208 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-credential-socket\") pod \"478b2bfe-dec0-4910-a07d-b273f881784a\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " Jul 22 18:45:52.924354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.924250 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/478b2bfe-dec0-4910-a07d-b273f881784a-istio-token\") pod \"478b2bfe-dec0-4910-a07d-b273f881784a\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " Jul 22 18:45:52.924354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.924278 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-istio-data\") pod \"478b2bfe-dec0-4910-a07d-b273f881784a\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " Jul 22 18:45:52.924354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.924349 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-workload-socket\") pod \"478b2bfe-dec0-4910-a07d-b273f881784a\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " Jul 22 18:45:52.924549 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.924375 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-workload-certs\") pod \"478b2bfe-dec0-4910-a07d-b273f881784a\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " Jul 22 18:45:52.924549 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.924403 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-istio-envoy\") pod \"478b2bfe-dec0-4910-a07d-b273f881784a\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " Jul 22 18:45:52.924549 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.924463 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/478b2bfe-dec0-4910-a07d-b273f881784a-istio-podinfo\") pod \"478b2bfe-dec0-4910-a07d-b273f881784a\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " Jul 22 18:45:52.924549 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.924519 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4wz4\" (UniqueName: \"kubernetes.io/projected/478b2bfe-dec0-4910-a07d-b273f881784a-kube-api-access-m4wz4\") pod \"478b2bfe-dec0-4910-a07d-b273f881784a\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " Jul 22 18:45:52.924549 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.924522 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "478b2bfe-dec0-4910-a07d-b273f881784a" (UID: "478b2bfe-dec0-4910-a07d-b273f881784a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:45:52.924800 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.924588 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/478b2bfe-dec0-4910-a07d-b273f881784a-istiod-ca-cert\") pod \"478b2bfe-dec0-4910-a07d-b273f881784a\" (UID: \"478b2bfe-dec0-4910-a07d-b273f881784a\") " Jul 22 18:45:52.924800 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.924723 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "478b2bfe-dec0-4910-a07d-b273f881784a" (UID: "478b2bfe-dec0-4910-a07d-b273f881784a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:45:52.924800 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.924735 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "478b2bfe-dec0-4910-a07d-b273f881784a" (UID: "478b2bfe-dec0-4910-a07d-b273f881784a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:45:52.925053 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.925034 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/478b2bfe-dec0-4910-a07d-b273f881784a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "478b2bfe-dec0-4910-a07d-b273f881784a" (UID: "478b2bfe-dec0-4910-a07d-b273f881784a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:45:52.925280 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.925259 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-credential-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:45:52.925334 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.925287 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-workload-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:45:52.925334 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.925302 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-workload-certs\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:45:52.925552 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.925528 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-istio-data" (OuterVolumeSpecName: "istio-data") pod "478b2bfe-dec0-4910-a07d-b273f881784a" (UID: "478b2bfe-dec0-4910-a07d-b273f881784a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:45:52.926661 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.926640 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/478b2bfe-dec0-4910-a07d-b273f881784a-istio-token" (OuterVolumeSpecName: "istio-token") pod "478b2bfe-dec0-4910-a07d-b273f881784a" (UID: "478b2bfe-dec0-4910-a07d-b273f881784a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:45:52.926767 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.926721 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "478b2bfe-dec0-4910-a07d-b273f881784a" (UID: "478b2bfe-dec0-4910-a07d-b273f881784a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:45:52.927250 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.927231 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/478b2bfe-dec0-4910-a07d-b273f881784a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "478b2bfe-dec0-4910-a07d-b273f881784a" (UID: "478b2bfe-dec0-4910-a07d-b273f881784a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 18:45:52.927317 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:52.927251 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/478b2bfe-dec0-4910-a07d-b273f881784a-kube-api-access-m4wz4" (OuterVolumeSpecName: "kube-api-access-m4wz4") pod "478b2bfe-dec0-4910-a07d-b273f881784a" (UID: "478b2bfe-dec0-4910-a07d-b273f881784a"). InnerVolumeSpecName "kube-api-access-m4wz4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:45:53.026716 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:53.026684 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/478b2bfe-dec0-4910-a07d-b273f881784a-istio-token\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:45:53.026716 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:53.026712 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-istio-data\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:45:53.026716 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:53.026721 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/478b2bfe-dec0-4910-a07d-b273f881784a-istio-envoy\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:45:53.026716 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:53.026728 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/478b2bfe-dec0-4910-a07d-b273f881784a-istio-podinfo\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:45:53.026997 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:53.026736 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4wz4\" (UniqueName: \"kubernetes.io/projected/478b2bfe-dec0-4910-a07d-b273f881784a-kube-api-access-m4wz4\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:45:53.026997 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:53.026747 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/478b2bfe-dec0-4910-a07d-b273f881784a-istiod-ca-cert\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:45:53.058046 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:53.058006 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:53.059161 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:53.059136 2554 generic.go:356] "Generic (PLEG): container finished" podID="478b2bfe-dec0-4910-a07d-b273f881784a" containerID="d6de76bf32a1d7db8de169d056b2dbe028fe384c9016884f29d9993bf37204ee" exitCode=0 Jul 22 18:45:53.059261 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:53.059187 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" Jul 22 18:45:53.059261 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:53.059202 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" event={"ID":"478b2bfe-dec0-4910-a07d-b273f881784a","Type":"ContainerDied","Data":"d6de76bf32a1d7db8de169d056b2dbe028fe384c9016884f29d9993bf37204ee"} Jul 22 18:45:53.059261 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:53.059245 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p" event={"ID":"478b2bfe-dec0-4910-a07d-b273f881784a","Type":"ContainerDied","Data":"6366c772fa95cf58e9b52c4e4d58401d2a93bf08c0541e0c6203398122de4cbb"} Jul 22 18:45:53.059363 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:53.059266 2554 scope.go:117] "RemoveContainer" containerID="d6de76bf32a1d7db8de169d056b2dbe028fe384c9016884f29d9993bf37204ee" Jul 22 18:45:53.068999 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:53.068982 2554 scope.go:117] "RemoveContainer" containerID="dcd3b208383fe7f3d01830d635c41815e9e8bda4ef91083fa0a43b95d35eb98d" Jul 22 18:45:53.077643 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:53.077621 2554 scope.go:117] "RemoveContainer" containerID="d6de76bf32a1d7db8de169d056b2dbe028fe384c9016884f29d9993bf37204ee" Jul 22 18:45:53.077944 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:45:53.077923 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6de76bf32a1d7db8de169d056b2dbe028fe384c9016884f29d9993bf37204ee\": container with ID starting with d6de76bf32a1d7db8de169d056b2dbe028fe384c9016884f29d9993bf37204ee not found: ID does not exist" containerID="d6de76bf32a1d7db8de169d056b2dbe028fe384c9016884f29d9993bf37204ee" Jul 22 18:45:53.078036 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:53.077952 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6de76bf32a1d7db8de169d056b2dbe028fe384c9016884f29d9993bf37204ee"} err="failed to get container status \"d6de76bf32a1d7db8de169d056b2dbe028fe384c9016884f29d9993bf37204ee\": rpc error: code = NotFound desc = could not find container \"d6de76bf32a1d7db8de169d056b2dbe028fe384c9016884f29d9993bf37204ee\": container with ID starting with d6de76bf32a1d7db8de169d056b2dbe028fe384c9016884f29d9993bf37204ee not found: ID does not exist" Jul 22 18:45:53.078036 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:53.077972 2554 scope.go:117] "RemoveContainer" containerID="dcd3b208383fe7f3d01830d635c41815e9e8bda4ef91083fa0a43b95d35eb98d" Jul 22 18:45:53.078241 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:45:53.078225 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcd3b208383fe7f3d01830d635c41815e9e8bda4ef91083fa0a43b95d35eb98d\": container with ID starting with dcd3b208383fe7f3d01830d635c41815e9e8bda4ef91083fa0a43b95d35eb98d not found: ID does not exist" containerID="dcd3b208383fe7f3d01830d635c41815e9e8bda4ef91083fa0a43b95d35eb98d" Jul 22 18:45:53.078305 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:53.078251 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcd3b208383fe7f3d01830d635c41815e9e8bda4ef91083fa0a43b95d35eb98d"} err="failed to get container status \"dcd3b208383fe7f3d01830d635c41815e9e8bda4ef91083fa0a43b95d35eb98d\": rpc error: code = NotFound desc = could not find container \"dcd3b208383fe7f3d01830d635c41815e9e8bda4ef91083fa0a43b95d35eb98d\": container with ID starting with dcd3b208383fe7f3d01830d635c41815e9e8bda4ef91083fa0a43b95d35eb98d not found: ID does not exist" Jul 22 18:45:53.081208 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:53.081184 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p"] Jul 22 18:45:53.087357 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:53.087335 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-cc99fc0b-openshift-default-7b777fc765-qkg9p"] Jul 22 18:45:53.164076 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:53.164036 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:53.265102 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:53.265073 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:45:54.546737 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:45:54.546706 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="478b2bfe-dec0-4910-a07d-b273f881784a" path="/var/lib/kubelet/pods/478b2bfe-dec0-4910-a07d-b273f881784a/volumes" Jul 22 18:46:04.121703 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:04.121672 2554 generic.go:356] "Generic (PLEG): container finished" podID="f865b096-3181-40a6-abfb-46cd6be3fa9e" containerID="de2f2932f74b5bf1f78ac23bd13892d72d3eb3c6eddf3b61b6a256120a450b76" exitCode=0 Jul 22 18:46:04.122124 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:04.121728 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" event={"ID":"f865b096-3181-40a6-abfb-46cd6be3fa9e","Type":"ContainerDied","Data":"de2f2932f74b5bf1f78ac23bd13892d72d3eb3c6eddf3b61b6a256120a450b76"} Jul 22 18:46:04.122124 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:04.122102 2554 scope.go:117] "RemoveContainer" containerID="de2f2932f74b5bf1f78ac23bd13892d72d3eb3c6eddf3b61b6a256120a450b76" Jul 22 18:46:04.123078 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:04.123052 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:46:04.123133 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:04.123122 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:46:04.123168 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:04.123153 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:46:05.042596 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:05.042555 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:46:05.128981 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:05.128946 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" event={"ID":"f865b096-3181-40a6-abfb-46cd6be3fa9e","Type":"ContainerStarted","Data":"825450cf3f66656913ca090067d3442cb899b92f80761a8ffc80fcdbf366f76c"} Jul 22 18:46:05.644630 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:05.644597 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:46:05.645857 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:05.645832 2554 patch_prober.go:28] interesting pod/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 22 18:46:05.645977 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:05.645889 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" podUID="f865b096-3181-40a6-abfb-46cd6be3fa9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 22 18:46:06.645164 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:06.645121 2554 patch_prober.go:28] interesting pod/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 22 18:46:06.645605 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:06.645197 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" podUID="f865b096-3181-40a6-abfb-46cd6be3fa9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 22 18:46:07.644791 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:07.644752 2554 patch_prober.go:28] interesting pod/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 22 18:46:07.644985 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:07.644826 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" podUID="f865b096-3181-40a6-abfb-46cd6be3fa9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 22 18:46:08.645261 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:08.645220 2554 patch_prober.go:28] interesting pod/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" start-of-body= Jul 22 18:46:08.645820 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:08.645284 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" podUID="f865b096-3181-40a6-abfb-46cd6be3fa9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.40:15021/healthz/ready\": dial tcp 10.133.0.40:15021: connect: connection refused" Jul 22 18:46:09.648179 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:09.648149 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:46:09.648630 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:09.648411 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:46:09.649134 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:09.649119 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:46:11.986380 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:11.986347 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:46:12.084713 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:12.084680 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:46:25.983266 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:25.983224 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:46:30.469137 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:30.469106 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:46:30.606815 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:30.606778 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t"] Jul 22 18:46:30.607100 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:30.607042 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" podUID="f865b096-3181-40a6-abfb-46cd6be3fa9e" containerName="istio-proxy" containerID="cri-o://825450cf3f66656913ca090067d3442cb899b92f80761a8ffc80fcdbf366f76c" gracePeriod=30 Jul 22 18:46:30.631019 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:30.630992 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:46:30.863350 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:30.863316 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:46:31.386205 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:31.386174 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:46:31.483945 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:31.483908 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:46:31.584847 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:31.584788 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:46:33.001211 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:33.001170 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:46:35.867930 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:35.867862 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:46:36.046627 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.046598 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f865b096-3181-40a6-abfb-46cd6be3fa9e-istiod-ca-cert\") pod \"f865b096-3181-40a6-abfb-46cd6be3fa9e\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " Jul 22 18:46:36.046821 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.046638 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-data\") pod \"f865b096-3181-40a6-abfb-46cd6be3fa9e\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " Jul 22 18:46:36.046821 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.046663 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-podinfo\") pod \"f865b096-3181-40a6-abfb-46cd6be3fa9e\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " Jul 22 18:46:36.046821 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.046747 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-workload-certs\") pod \"f865b096-3181-40a6-abfb-46cd6be3fa9e\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " Jul 22 18:46:36.046821 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.046777 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-envoy\") pod \"f865b096-3181-40a6-abfb-46cd6be3fa9e\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " Jul 22 18:46:36.046821 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.046815 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-workload-socket\") pod \"f865b096-3181-40a6-abfb-46cd6be3fa9e\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " Jul 22 18:46:36.047117 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.046839 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-credential-socket\") pod \"f865b096-3181-40a6-abfb-46cd6be3fa9e\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " Jul 22 18:46:36.047117 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.046926 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-token\") pod \"f865b096-3181-40a6-abfb-46cd6be3fa9e\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " Jul 22 18:46:36.047117 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.046977 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrjwx\" (UniqueName: \"kubernetes.io/projected/f865b096-3181-40a6-abfb-46cd6be3fa9e-kube-api-access-xrjwx\") pod \"f865b096-3181-40a6-abfb-46cd6be3fa9e\" (UID: \"f865b096-3181-40a6-abfb-46cd6be3fa9e\") " Jul 22 18:46:36.047117 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.047005 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f865b096-3181-40a6-abfb-46cd6be3fa9e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f865b096-3181-40a6-abfb-46cd6be3fa9e" (UID: "f865b096-3181-40a6-abfb-46cd6be3fa9e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:46:36.047334 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.047156 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f865b096-3181-40a6-abfb-46cd6be3fa9e" (UID: "f865b096-3181-40a6-abfb-46cd6be3fa9e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:46:36.047334 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.047293 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f865b096-3181-40a6-abfb-46cd6be3fa9e-istiod-ca-cert\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:46:36.047473 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.047338 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-workload-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:46:36.047601 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.047567 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f865b096-3181-40a6-abfb-46cd6be3fa9e" (UID: "f865b096-3181-40a6-abfb-46cd6be3fa9e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:46:36.047747 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.047618 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-data" (OuterVolumeSpecName: "istio-data") pod "f865b096-3181-40a6-abfb-46cd6be3fa9e" (UID: "f865b096-3181-40a6-abfb-46cd6be3fa9e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:46:36.047908 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.047827 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f865b096-3181-40a6-abfb-46cd6be3fa9e" (UID: "f865b096-3181-40a6-abfb-46cd6be3fa9e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:46:36.049400 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.049359 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-token" (OuterVolumeSpecName: "istio-token") pod "f865b096-3181-40a6-abfb-46cd6be3fa9e" (UID: "f865b096-3181-40a6-abfb-46cd6be3fa9e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:46:36.049400 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.049365 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f865b096-3181-40a6-abfb-46cd6be3fa9e" (UID: "f865b096-3181-40a6-abfb-46cd6be3fa9e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 18:46:36.049944 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.049921 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f865b096-3181-40a6-abfb-46cd6be3fa9e" (UID: "f865b096-3181-40a6-abfb-46cd6be3fa9e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:46:36.050034 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.049945 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f865b096-3181-40a6-abfb-46cd6be3fa9e-kube-api-access-xrjwx" (OuterVolumeSpecName: "kube-api-access-xrjwx") pod "f865b096-3181-40a6-abfb-46cd6be3fa9e" (UID: "f865b096-3181-40a6-abfb-46cd6be3fa9e"). InnerVolumeSpecName "kube-api-access-xrjwx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:46:36.148143 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.148062 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-token\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:46:36.148143 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.148090 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrjwx\" (UniqueName: \"kubernetes.io/projected/f865b096-3181-40a6-abfb-46cd6be3fa9e-kube-api-access-xrjwx\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:46:36.148143 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.148100 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-data\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:46:36.148143 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.148108 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-podinfo\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:46:36.148143 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.148116 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-workload-certs\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:46:36.148143 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.148126 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-istio-envoy\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:46:36.148143 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.148139 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f865b096-3181-40a6-abfb-46cd6be3fa9e-credential-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:46:36.288509 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.288478 2554 generic.go:356] "Generic (PLEG): container finished" podID="f865b096-3181-40a6-abfb-46cd6be3fa9e" containerID="825450cf3f66656913ca090067d3442cb899b92f80761a8ffc80fcdbf366f76c" exitCode=0 Jul 22 18:46:36.288689 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.288529 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" Jul 22 18:46:36.288689 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.288557 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" event={"ID":"f865b096-3181-40a6-abfb-46cd6be3fa9e","Type":"ContainerDied","Data":"825450cf3f66656913ca090067d3442cb899b92f80761a8ffc80fcdbf366f76c"} Jul 22 18:46:36.288689 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.288617 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t" event={"ID":"f865b096-3181-40a6-abfb-46cd6be3fa9e","Type":"ContainerDied","Data":"44fe9105738721a6c9168f4226b3fb78da6bbafd5972d837f9b45f733d297333"} Jul 22 18:46:36.288689 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.288640 2554 scope.go:117] "RemoveContainer" containerID="825450cf3f66656913ca090067d3442cb899b92f80761a8ffc80fcdbf366f76c" Jul 22 18:46:36.303788 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.303768 2554 scope.go:117] "RemoveContainer" containerID="de2f2932f74b5bf1f78ac23bd13892d72d3eb3c6eddf3b61b6a256120a450b76" Jul 22 18:46:36.313216 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.313194 2554 scope.go:117] "RemoveContainer" containerID="825450cf3f66656913ca090067d3442cb899b92f80761a8ffc80fcdbf366f76c" Jul 22 18:46:36.313758 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:46:36.313636 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"825450cf3f66656913ca090067d3442cb899b92f80761a8ffc80fcdbf366f76c\": container with ID starting with 825450cf3f66656913ca090067d3442cb899b92f80761a8ffc80fcdbf366f76c not found: ID does not exist" containerID="825450cf3f66656913ca090067d3442cb899b92f80761a8ffc80fcdbf366f76c" Jul 22 18:46:36.313758 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.313705 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"825450cf3f66656913ca090067d3442cb899b92f80761a8ffc80fcdbf366f76c"} err="failed to get container status \"825450cf3f66656913ca090067d3442cb899b92f80761a8ffc80fcdbf366f76c\": rpc error: code = NotFound desc = could not find container \"825450cf3f66656913ca090067d3442cb899b92f80761a8ffc80fcdbf366f76c\": container with ID starting with 825450cf3f66656913ca090067d3442cb899b92f80761a8ffc80fcdbf366f76c not found: ID does not exist" Jul 22 18:46:36.314116 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.313757 2554 scope.go:117] "RemoveContainer" containerID="de2f2932f74b5bf1f78ac23bd13892d72d3eb3c6eddf3b61b6a256120a450b76" Jul 22 18:46:36.314613 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:46:36.314392 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de2f2932f74b5bf1f78ac23bd13892d72d3eb3c6eddf3b61b6a256120a450b76\": container with ID starting with de2f2932f74b5bf1f78ac23bd13892d72d3eb3c6eddf3b61b6a256120a450b76 not found: ID does not exist" containerID="de2f2932f74b5bf1f78ac23bd13892d72d3eb3c6eddf3b61b6a256120a450b76" Jul 22 18:46:36.314613 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.314536 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de2f2932f74b5bf1f78ac23bd13892d72d3eb3c6eddf3b61b6a256120a450b76"} err="failed to get container status \"de2f2932f74b5bf1f78ac23bd13892d72d3eb3c6eddf3b61b6a256120a450b76\": rpc error: code = NotFound desc = could not find container \"de2f2932f74b5bf1f78ac23bd13892d72d3eb3c6eddf3b61b6a256120a450b76\": container with ID starting with de2f2932f74b5bf1f78ac23bd13892d72d3eb3c6eddf3b61b6a256120a450b76 not found: ID does not exist" Jul 22 18:46:36.315279 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.315262 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t"] Jul 22 18:46:36.316952 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.316933 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-95d099d7-openshift-default-9d94bcdb7-d5j2t"] Jul 22 18:46:36.548455 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:36.548404 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f865b096-3181-40a6-abfb-46cd6be3fa9e" path="/var/lib/kubelet/pods/f865b096-3181-40a6-abfb-46cd6be3fa9e/volumes" Jul 22 18:46:39.061128 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:39.061083 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:46:39.167668 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:39.167635 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:46:39.286848 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:39.286806 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:46:39.389127 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:39.389031 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:46:39.769957 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:39.769909 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:46:40.270203 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:40.270162 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:46:40.374305 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:46:40.374260 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:47:05.787330 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:47:05.787286 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:47:12.235144 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:47:12.235097 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:47:12.337138 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:47:12.337087 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:47:12.436581 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:47:12.436553 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:47:28.367067 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:47:28.367002 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:47:34.281035 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:47:34.280998 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:47:34.357485 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:47:34.357450 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:47:34.473775 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:47:34.473741 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:47:34.606769 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:47:34.606688 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:47:45.058004 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:47:45.057967 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:47:45.888354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:47:45.888317 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:47:54.680386 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:47:54.680346 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:47:54.784589 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:47:54.784556 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:47:55.099935 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:47:55.099902 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:01.089188 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:01.089153 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:01.190731 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:01.190698 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:01.799335 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:01.799304 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:08.381212 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:08.381174 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:08.947686 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:08.947642 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf"] Jul 22 18:48:08.948182 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:08.948166 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" containerName="istio-proxy" Jul 22 18:48:08.948263 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:08.948184 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce1dfed5-e355-4762-b4a3-d8ec6b9b5a2f" containerName="istio-proxy" Jul 22 18:48:08.948263 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:08.948203 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="478b2bfe-dec0-4910-a07d-b273f881784a" containerName="istio-proxy" Jul 22 18:48:08.948263 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:08.948212 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="478b2bfe-dec0-4910-a07d-b273f881784a" containerName="istio-proxy" Jul 22 18:48:08.948263 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:08.948227 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f865b096-3181-40a6-abfb-46cd6be3fa9e" containerName="istio-proxy" Jul 22 18:48:08.948263 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:08.948235 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f865b096-3181-40a6-abfb-46cd6be3fa9e" containerName="istio-proxy" Jul 22 18:48:08.948263 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:08.948253 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="478b2bfe-dec0-4910-a07d-b273f881784a" containerName="istio-proxy" Jul 22 18:48:08.948263 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:08.948261 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="478b2bfe-dec0-4910-a07d-b273f881784a" containerName="istio-proxy" Jul 22 18:48:08.948504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:08.948355 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f865b096-3181-40a6-abfb-46cd6be3fa9e" containerName="istio-proxy" Jul 22 18:48:08.948504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:08.948367 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f865b096-3181-40a6-abfb-46cd6be3fa9e" containerName="istio-proxy" Jul 22 18:48:08.948504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:08.948375 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="478b2bfe-dec0-4910-a07d-b273f881784a" containerName="istio-proxy" Jul 22 18:48:08.948504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:08.948386 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="478b2bfe-dec0-4910-a07d-b273f881784a" containerName="istio-proxy" Jul 22 18:48:08.951834 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:08.951816 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:08.954775 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:08.954752 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-d85e8a51-openshift-default-dockercfg-28fgn\"" Jul 22 18:48:08.987553 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:08.987522 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf"] Jul 22 18:48:09.042210 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.042176 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-workload-certs\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.042210 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.042220 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-credential-socket\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.042551 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.042243 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-istio-data\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.042551 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.042356 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tdrd\" (UniqueName: \"kubernetes.io/projected/971fa9d4-682f-4b13-9b4a-357c66234502-kube-api-access-5tdrd\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.042551 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.042468 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/971fa9d4-682f-4b13-9b4a-357c66234502-istio-podinfo\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.042551 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.042506 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-workload-socket\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.042551 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.042540 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-istio-envoy\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.042763 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.042561 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/971fa9d4-682f-4b13-9b4a-357c66234502-istio-token\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.042763 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.042599 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/971fa9d4-682f-4b13-9b4a-357c66234502-istiod-ca-cert\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.143484 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.143448 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-workload-certs\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.143671 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.143492 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-credential-socket\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.143671 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.143527 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-istio-data\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.143671 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.143576 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tdrd\" (UniqueName: \"kubernetes.io/projected/971fa9d4-682f-4b13-9b4a-357c66234502-kube-api-access-5tdrd\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.143671 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.143619 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/971fa9d4-682f-4b13-9b4a-357c66234502-istio-podinfo\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.143671 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.143643 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-workload-socket\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.143671 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.143672 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-istio-envoy\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.143997 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.143691 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/971fa9d4-682f-4b13-9b4a-357c66234502-istio-token\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.143997 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.143709 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/971fa9d4-682f-4b13-9b4a-357c66234502-istiod-ca-cert\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.143997 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.143942 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-credential-socket\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.144171 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.144010 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-istio-data\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.144171 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.144124 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-workload-certs\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.144267 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.144194 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-workload-socket\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.144521 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.144440 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/971fa9d4-682f-4b13-9b4a-357c66234502-istiod-ca-cert\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.146201 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.146179 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-istio-envoy\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.146387 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.146366 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/971fa9d4-682f-4b13-9b4a-357c66234502-istio-podinfo\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.153222 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.153193 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/971fa9d4-682f-4b13-9b4a-357c66234502-istio-token\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.153328 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.153311 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tdrd\" (UniqueName: \"kubernetes.io/projected/971fa9d4-682f-4b13-9b4a-357c66234502-kube-api-access-5tdrd\") pod \"e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.262995 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.262964 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:09.412330 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.412306 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf"] Jul 22 18:48:09.415360 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:48:09.415331 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod971fa9d4_682f_4b13_9b4a_357c66234502.slice/crio-110dfcf4e0d6c117b4c05e5539698a64a24f5585b702f3c4f0bf85258c232e69 WatchSource:0}: Error finding container 110dfcf4e0d6c117b4c05e5539698a64a24f5585b702f3c4f0bf85258c232e69: Status 404 returned error can't find the container with id 110dfcf4e0d6c117b4c05e5539698a64a24f5585b702f3c4f0bf85258c232e69 Jul 22 18:48:09.417861 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.417834 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:48:09.417934 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.417917 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:48:09.417978 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.417949 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:48:09.657091 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.657009 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:09.723691 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.723650 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" event={"ID":"971fa9d4-682f-4b13-9b4a-357c66234502","Type":"ContainerStarted","Data":"3d7bb3230efea3433f076edf73629836b92a3a62ac431ac0d0fec3b1217b31b6"} Jul 22 18:48:09.723862 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.723706 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" event={"ID":"971fa9d4-682f-4b13-9b4a-357c66234502","Type":"ContainerStarted","Data":"110dfcf4e0d6c117b4c05e5539698a64a24f5585b702f3c4f0bf85258c232e69"} Jul 22 18:48:09.745768 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:09.745718 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" podStartSLOduration=1.7457025320000001 podStartE2EDuration="1.745702532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:48:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:48:09.743176101 +0000 UTC m=+2045.668071113" watchObservedRunningTime="2026-07-22 18:48:09.745702532 +0000 UTC m=+2045.670597550" Jul 22 18:48:10.264094 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:10.264059 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:10.268968 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:10.268944 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:10.728395 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:10.728299 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:10.729225 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:10.729207 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:11.768098 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:11.768063 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:11.865559 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:11.865527 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:11.987683 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:11.987652 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:12.240323 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:12.240277 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:12.697967 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:12.697868 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:12.797582 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:12.797551 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:16.175587 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:16.175546 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:16.855654 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:16.855623 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:16.954992 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:16.954952 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:17.327334 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:17.327303 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:23.075617 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:23.075580 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:23.174757 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:23.174714 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:25.729535 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:25.729412 2554 patch_prober.go:28] interesting pod/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 22 18:48:25.729934 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:25.729531 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" podUID="971fa9d4-682f-4b13-9b4a-357c66234502" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 22 18:48:25.812275 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:25.812240 2554 generic.go:356] "Generic (PLEG): container finished" podID="971fa9d4-682f-4b13-9b4a-357c66234502" containerID="3d7bb3230efea3433f076edf73629836b92a3a62ac431ac0d0fec3b1217b31b6" exitCode=0 Jul 22 18:48:25.812487 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:25.812310 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" event={"ID":"971fa9d4-682f-4b13-9b4a-357c66234502","Type":"ContainerDied","Data":"3d7bb3230efea3433f076edf73629836b92a3a62ac431ac0d0fec3b1217b31b6"} Jul 22 18:48:25.812735 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:25.812722 2554 scope.go:117] "RemoveContainer" containerID="3d7bb3230efea3433f076edf73629836b92a3a62ac431ac0d0fec3b1217b31b6" Jul 22 18:48:25.813721 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:25.813693 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:48:25.813836 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:25.813776 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:48:25.813836 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:25.813824 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:48:26.818742 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:26.818707 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" event={"ID":"971fa9d4-682f-4b13-9b4a-357c66234502","Type":"ContainerStarted","Data":"b64f82fd9a20323154a45787289f97235c97d6a425b0d4675ea2965d2080d1dd"} Jul 22 18:48:27.263606 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:27.263573 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:27.263845 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:27.263823 2554 patch_prober.go:28] interesting pod/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 22 18:48:27.263895 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:27.263870 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" podUID="971fa9d4-682f-4b13-9b4a-357c66234502" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 22 18:48:28.263624 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:28.263585 2554 patch_prober.go:28] interesting pod/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 22 18:48:28.264057 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:28.263641 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" podUID="971fa9d4-682f-4b13-9b4a-357c66234502" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 22 18:48:29.264367 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:29.264332 2554 patch_prober.go:28] interesting pod/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 22 18:48:29.264937 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:29.264387 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" podUID="971fa9d4-682f-4b13-9b4a-357c66234502" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 22 18:48:30.263600 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:30.263563 2554 patch_prober.go:28] interesting pod/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body= Jul 22 18:48:30.263768 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:30.263617 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" podUID="971fa9d4-682f-4b13-9b4a-357c66234502" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" Jul 22 18:48:31.267598 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:31.267566 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:31.268100 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:31.267965 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:31.268741 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:31.268721 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:34.145089 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:34.145046 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:38.501681 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:38.501646 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:38.895431 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:38.895319 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:44.781720 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:44.781686 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:44.841608 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:44.841573 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:45.037509 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:45.037432 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf"] Jul 22 18:48:45.037660 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:45.037640 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" podUID="971fa9d4-682f-4b13-9b4a-357c66234502" containerName="istio-proxy" containerID="cri-o://b64f82fd9a20323154a45787289f97235c97d6a425b0d4675ea2965d2080d1dd" gracePeriod=30 Jul 22 18:48:45.057126 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:45.057097 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:45.280975 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:45.280947 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:45.398663 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:45.398577 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:45.499387 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:45.499350 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:45.628298 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:45.628257 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:46.270444 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:46.270375 2554 patch_prober.go:28] interesting pod/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 22 18:48:46.270911 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:46.270456 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" podUID="971fa9d4-682f-4b13-9b4a-357c66234502" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 18:48:50.302118 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.302046 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:50.356514 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.356479 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-workload-socket\") pod \"971fa9d4-682f-4b13-9b4a-357c66234502\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " Jul 22 18:48:50.356715 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.356551 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/971fa9d4-682f-4b13-9b4a-357c66234502-istiod-ca-cert\") pod \"971fa9d4-682f-4b13-9b4a-357c66234502\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " Jul 22 18:48:50.356715 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.356576 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/971fa9d4-682f-4b13-9b4a-357c66234502-istio-podinfo\") pod \"971fa9d4-682f-4b13-9b4a-357c66234502\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " Jul 22 18:48:50.356715 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.356629 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/971fa9d4-682f-4b13-9b4a-357c66234502-istio-token\") pod \"971fa9d4-682f-4b13-9b4a-357c66234502\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " Jul 22 18:48:50.356715 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.356659 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-workload-certs\") pod \"971fa9d4-682f-4b13-9b4a-357c66234502\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " Jul 22 18:48:50.356715 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.356681 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-istio-envoy\") pod \"971fa9d4-682f-4b13-9b4a-357c66234502\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " Jul 22 18:48:50.357026 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.356718 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-credential-socket\") pod \"971fa9d4-682f-4b13-9b4a-357c66234502\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " Jul 22 18:48:50.357026 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.356780 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "971fa9d4-682f-4b13-9b4a-357c66234502" (UID: "971fa9d4-682f-4b13-9b4a-357c66234502"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:48:50.357026 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.356876 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-istio-data\") pod \"971fa9d4-682f-4b13-9b4a-357c66234502\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " Jul 22 18:48:50.357026 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.356927 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tdrd\" (UniqueName: \"kubernetes.io/projected/971fa9d4-682f-4b13-9b4a-357c66234502-kube-api-access-5tdrd\") pod \"971fa9d4-682f-4b13-9b4a-357c66234502\" (UID: \"971fa9d4-682f-4b13-9b4a-357c66234502\") " Jul 22 18:48:50.357248 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.357024 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/971fa9d4-682f-4b13-9b4a-357c66234502-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "971fa9d4-682f-4b13-9b4a-357c66234502" (UID: "971fa9d4-682f-4b13-9b4a-357c66234502"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:48:50.357248 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.357024 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "971fa9d4-682f-4b13-9b4a-357c66234502" (UID: "971fa9d4-682f-4b13-9b4a-357c66234502"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:48:50.357462 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.357358 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-workload-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:48:50.357462 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.357381 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/971fa9d4-682f-4b13-9b4a-357c66234502-istiod-ca-cert\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:48:50.357462 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.357393 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-workload-certs\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:48:50.357462 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.357452 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "971fa9d4-682f-4b13-9b4a-357c66234502" (UID: "971fa9d4-682f-4b13-9b4a-357c66234502"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:48:50.357893 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.357868 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-istio-data" (OuterVolumeSpecName: "istio-data") pod "971fa9d4-682f-4b13-9b4a-357c66234502" (UID: "971fa9d4-682f-4b13-9b4a-357c66234502"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:48:50.359137 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.359104 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "971fa9d4-682f-4b13-9b4a-357c66234502" (UID: "971fa9d4-682f-4b13-9b4a-357c66234502"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:48:50.359379 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.359359 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/971fa9d4-682f-4b13-9b4a-357c66234502-kube-api-access-5tdrd" (OuterVolumeSpecName: "kube-api-access-5tdrd") pod "971fa9d4-682f-4b13-9b4a-357c66234502" (UID: "971fa9d4-682f-4b13-9b4a-357c66234502"). InnerVolumeSpecName "kube-api-access-5tdrd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:48:50.359562 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.359542 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/971fa9d4-682f-4b13-9b4a-357c66234502-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "971fa9d4-682f-4b13-9b4a-357c66234502" (UID: "971fa9d4-682f-4b13-9b4a-357c66234502"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 18:48:50.359562 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.359554 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/971fa9d4-682f-4b13-9b4a-357c66234502-istio-token" (OuterVolumeSpecName: "istio-token") pod "971fa9d4-682f-4b13-9b4a-357c66234502" (UID: "971fa9d4-682f-4b13-9b4a-357c66234502"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:48:50.458117 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.458081 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/971fa9d4-682f-4b13-9b4a-357c66234502-istio-podinfo\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:48:50.458117 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.458114 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/971fa9d4-682f-4b13-9b4a-357c66234502-istio-token\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:48:50.458117 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.458122 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-istio-envoy\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:48:50.458365 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.458129 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-credential-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:48:50.458365 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.458138 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/971fa9d4-682f-4b13-9b4a-357c66234502-istio-data\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:48:50.458365 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.458147 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tdrd\" (UniqueName: \"kubernetes.io/projected/971fa9d4-682f-4b13-9b4a-357c66234502-kube-api-access-5tdrd\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:48:50.932635 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.932543 2554 generic.go:356] "Generic (PLEG): container finished" podID="971fa9d4-682f-4b13-9b4a-357c66234502" containerID="b64f82fd9a20323154a45787289f97235c97d6a425b0d4675ea2965d2080d1dd" exitCode=0 Jul 22 18:48:50.932635 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.932599 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" Jul 22 18:48:50.932826 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.932627 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" event={"ID":"971fa9d4-682f-4b13-9b4a-357c66234502","Type":"ContainerDied","Data":"b64f82fd9a20323154a45787289f97235c97d6a425b0d4675ea2965d2080d1dd"} Jul 22 18:48:50.932826 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.932688 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf" event={"ID":"971fa9d4-682f-4b13-9b4a-357c66234502","Type":"ContainerDied","Data":"110dfcf4e0d6c117b4c05e5539698a64a24f5585b702f3c4f0bf85258c232e69"} Jul 22 18:48:50.932826 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.932710 2554 scope.go:117] "RemoveContainer" containerID="b64f82fd9a20323154a45787289f97235c97d6a425b0d4675ea2965d2080d1dd" Jul 22 18:48:50.941707 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.941687 2554 scope.go:117] "RemoveContainer" containerID="3d7bb3230efea3433f076edf73629836b92a3a62ac431ac0d0fec3b1217b31b6" Jul 22 18:48:50.950593 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.950572 2554 scope.go:117] "RemoveContainer" containerID="b64f82fd9a20323154a45787289f97235c97d6a425b0d4675ea2965d2080d1dd" Jul 22 18:48:50.950897 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:48:50.950874 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b64f82fd9a20323154a45787289f97235c97d6a425b0d4675ea2965d2080d1dd\": container with ID starting with b64f82fd9a20323154a45787289f97235c97d6a425b0d4675ea2965d2080d1dd not found: ID does not exist" containerID="b64f82fd9a20323154a45787289f97235c97d6a425b0d4675ea2965d2080d1dd" Jul 22 18:48:50.950961 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.950909 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b64f82fd9a20323154a45787289f97235c97d6a425b0d4675ea2965d2080d1dd"} err="failed to get container status \"b64f82fd9a20323154a45787289f97235c97d6a425b0d4675ea2965d2080d1dd\": rpc error: code = NotFound desc = could not find container \"b64f82fd9a20323154a45787289f97235c97d6a425b0d4675ea2965d2080d1dd\": container with ID starting with b64f82fd9a20323154a45787289f97235c97d6a425b0d4675ea2965d2080d1dd not found: ID does not exist" Jul 22 18:48:50.950961 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.950934 2554 scope.go:117] "RemoveContainer" containerID="3d7bb3230efea3433f076edf73629836b92a3a62ac431ac0d0fec3b1217b31b6" Jul 22 18:48:50.951084 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.951070 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf"] Jul 22 18:48:50.951216 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:48:50.951200 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d7bb3230efea3433f076edf73629836b92a3a62ac431ac0d0fec3b1217b31b6\": container with ID starting with 3d7bb3230efea3433f076edf73629836b92a3a62ac431ac0d0fec3b1217b31b6 not found: ID does not exist" containerID="3d7bb3230efea3433f076edf73629836b92a3a62ac431ac0d0fec3b1217b31b6" Jul 22 18:48:50.951261 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.951222 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d7bb3230efea3433f076edf73629836b92a3a62ac431ac0d0fec3b1217b31b6"} err="failed to get container status \"3d7bb3230efea3433f076edf73629836b92a3a62ac431ac0d0fec3b1217b31b6\": rpc error: code = NotFound desc = could not find container \"3d7bb3230efea3433f076edf73629836b92a3a62ac431ac0d0fec3b1217b31b6\": container with ID starting with 3d7bb3230efea3433f076edf73629836b92a3a62ac431ac0d0fec3b1217b31b6 not found: ID does not exist" Jul 22 18:48:50.954826 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:50.954804 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-d85e8a51-openshift-default-5584849f67-w46zf"] Jul 22 18:48:51.530131 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:51.530098 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:52.547736 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:52.547705 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="971fa9d4-682f-4b13-9b4a-357c66234502" path="/var/lib/kubelet/pods/971fa9d4-682f-4b13-9b4a-357c66234502/volumes" Jul 22 18:48:53.774442 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:53.774364 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:53.880363 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:53.880308 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:57.777514 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:57.777477 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:48:57.886241 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:48:57.886214 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:49:04.674729 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:04.674688 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:49:04.963688 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:04.963581 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f"] Jul 22 18:49:04.964141 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:04.964116 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f865b096-3181-40a6-abfb-46cd6be3fa9e" containerName="istio-proxy" Jul 22 18:49:04.964141 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:04.964142 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f865b096-3181-40a6-abfb-46cd6be3fa9e" containerName="istio-proxy" Jul 22 18:49:04.964321 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:04.964184 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="971fa9d4-682f-4b13-9b4a-357c66234502" containerName="istio-proxy" Jul 22 18:49:04.964321 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:04.964194 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="971fa9d4-682f-4b13-9b4a-357c66234502" containerName="istio-proxy" Jul 22 18:49:04.964321 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:04.964210 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="971fa9d4-682f-4b13-9b4a-357c66234502" containerName="istio-proxy" Jul 22 18:49:04.964321 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:04.964219 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="971fa9d4-682f-4b13-9b4a-357c66234502" containerName="istio-proxy" Jul 22 18:49:04.964563 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:04.964347 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="971fa9d4-682f-4b13-9b4a-357c66234502" containerName="istio-proxy" Jul 22 18:49:04.964563 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:04.964361 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="971fa9d4-682f-4b13-9b4a-357c66234502" containerName="istio-proxy" Jul 22 18:49:04.969191 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:04.969171 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:04.971691 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:04.971671 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f02c5841-openshift-default-dockercfg-7f2fj\"" Jul 22 18:49:04.981229 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:04.981204 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f"] Jul 22 18:49:04.998390 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:04.998351 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:49:05.106916 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.106872 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-credential-socket\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.107101 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.106956 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-workload-socket\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.107101 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.106989 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-data\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.107101 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.107066 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istiod-ca-cert\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.107211 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.107116 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-workload-certs\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.107211 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.107134 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-envoy\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.107211 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.107152 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxzsn\" (UniqueName: \"kubernetes.io/projected/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-kube-api-access-wxzsn\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.107211 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.107184 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-token\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.107382 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.107229 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-podinfo\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.208213 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.208175 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-workload-socket\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.208406 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.208218 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-data\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.208406 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.208271 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istiod-ca-cert\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.208406 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.208313 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-workload-certs\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.208406 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.208333 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-envoy\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.208406 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.208358 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxzsn\" (UniqueName: \"kubernetes.io/projected/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-kube-api-access-wxzsn\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.208406 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.208399 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-token\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.208797 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.208543 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-podinfo\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.208797 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.208639 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-credential-socket\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.208797 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.208697 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-workload-socket\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.208915 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.208817 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-workload-certs\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.208970 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.208925 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-data\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.209031 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.208987 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-credential-socket\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.209294 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.209271 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istiod-ca-cert\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.210771 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.210743 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-envoy\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.211003 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.210987 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-podinfo\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.216853 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.216735 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-token\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.217315 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.217265 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxzsn\" (UniqueName: \"kubernetes.io/projected/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-kube-api-access-wxzsn\") pod \"e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.261324 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.261297 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:49:05.281782 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.281759 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:05.421180 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.421145 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:49:05.426108 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.426063 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:49:05.432029 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.432009 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f"] Jul 22 18:49:05.434101 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:49:05.434078 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4330fc1_dfdf_48cd_9b23_d03a4182bb2e.slice/crio-6dc4971a21d251e82373fb73e51f00751a31ecbe1694598c276ed719fdee415d WatchSource:0}: Error finding container 6dc4971a21d251e82373fb73e51f00751a31ecbe1694598c276ed719fdee415d: Status 404 returned error can't find the container with id 6dc4971a21d251e82373fb73e51f00751a31ecbe1694598c276ed719fdee415d Jul 22 18:49:05.436121 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.436092 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:49:05.436196 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.436152 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:49:05.436196 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:05.436178 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:49:06.008867 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:06.008825 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" event={"ID":"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e","Type":"ContainerStarted","Data":"8495d23df499cb3e173c007d910b7086bfe3129a148bf5d4cbdddd5a9901e356"} Jul 22 18:49:06.009265 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:06.008886 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" event={"ID":"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e","Type":"ContainerStarted","Data":"6dc4971a21d251e82373fb73e51f00751a31ecbe1694598c276ed719fdee415d"} Jul 22 18:49:06.033731 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:06.033672 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" podStartSLOduration=2.0336547 podStartE2EDuration="2.0336547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:49:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:49:06.03090968 +0000 UTC m=+2101.955804698" watchObservedRunningTime="2026-07-22 18:49:06.0336547 +0000 UTC m=+2101.958549718" Jul 22 18:49:06.282889 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:06.282797 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:06.288584 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:06.288552 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:07.014264 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:07.014234 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:07.015376 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:07.015355 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:08.019455 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:08.019390 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:49:08.123994 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:08.123949 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:49:08.228486 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:08.228451 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:49:08.544659 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:08.544631 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:49:08.691356 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:08.691329 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:49:08.791309 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:08.791268 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:49:12.519397 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:12.519360 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:49:21.081673 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:21.081637 2554 generic.go:356] "Generic (PLEG): container finished" podID="f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" containerID="8495d23df499cb3e173c007d910b7086bfe3129a148bf5d4cbdddd5a9901e356" exitCode=0 Jul 22 18:49:21.082098 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:21.081696 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" event={"ID":"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e","Type":"ContainerDied","Data":"8495d23df499cb3e173c007d910b7086bfe3129a148bf5d4cbdddd5a9901e356"} Jul 22 18:49:21.082098 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:21.082068 2554 scope.go:117] "RemoveContainer" containerID="8495d23df499cb3e173c007d910b7086bfe3129a148bf5d4cbdddd5a9901e356" Jul 22 18:49:21.083064 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:21.083035 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:49:21.083164 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:21.083100 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:49:21.083164 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:21.083131 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:49:22.014758 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:22.014724 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:22.091279 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:22.091232 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" event={"ID":"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e","Type":"ContainerStarted","Data":"95df2d8501edef14b8be8e82cd85a8bfb4dbf040edcc77028e4959c034f5ce9b"} Jul 22 18:49:22.284486 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:22.284362 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:22.284676 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:22.284523 2554 patch_prober.go:28] interesting pod/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 22 18:49:22.284676 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:22.284568 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" podUID="f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 22 18:49:22.536750 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:22.536662 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:49:23.283189 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:23.283146 2554 patch_prober.go:28] interesting pod/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 22 18:49:23.283837 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:23.283234 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" podUID="f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 22 18:49:24.282430 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:24.282364 2554 patch_prober.go:28] interesting pod/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 22 18:49:24.282646 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:24.282456 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" podUID="f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 22 18:49:25.282379 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:25.282331 2554 patch_prober.go:28] interesting pod/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 22 18:49:25.282865 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:25.282401 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" podUID="f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 22 18:49:26.307799 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:26.307770 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:26.308180 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:26.308057 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:26.308861 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:26.308845 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:49:56.273107 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:49:56.273016 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:50:00.906166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:50:00.906121 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:50:03.257290 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:50:03.257260 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:50:08.322704 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:50:08.322664 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:50:13.743976 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:50:13.743940 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:50:44.751972 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:50:44.751923 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:50:45.690136 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:50:45.690104 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:50:51.855114 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:50:51.855079 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:50:54.202591 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:50:54.202551 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:50:54.299629 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:50:54.299597 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:50:57.389623 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:50:57.389569 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:50:57.451090 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:50:57.451058 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:50:57.658962 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:50:57.658875 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f"] Jul 22 18:50:57.659119 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:50:57.659088 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" podUID="f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" containerName="istio-proxy" containerID="cri-o://95df2d8501edef14b8be8e82cd85a8bfb4dbf040edcc77028e4959c034f5ce9b" gracePeriod=30 Jul 22 18:50:57.678250 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:50:57.678209 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:50:57.909170 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:50:57.909063 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:50:58.968424 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:50:58.968394 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:50:59.067021 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:50:59.066982 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:50:59.163269 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:50:59.163236 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:50:59.874365 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:50:59.874332 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:50:59.981354 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:50:59.981315 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:00.074163 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:00.074134 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:01.449793 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:01.449753 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:02.912539 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.912512 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:51:02.996610 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.996584 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-data\") pod \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " Jul 22 18:51:02.996771 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.996618 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxzsn\" (UniqueName: \"kubernetes.io/projected/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-kube-api-access-wxzsn\") pod \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " Jul 22 18:51:02.996771 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.996649 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-credential-socket\") pod \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " Jul 22 18:51:02.996771 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.996672 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-workload-socket\") pod \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " Jul 22 18:51:02.996771 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.996720 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-podinfo\") pod \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " Jul 22 18:51:02.996771 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.996758 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-token\") pod \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " Jul 22 18:51:02.997038 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.996809 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-workload-certs\") pod \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " Jul 22 18:51:02.997038 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.996861 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-envoy\") pod \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " Jul 22 18:51:02.997038 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.996917 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istiod-ca-cert\") pod \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\" (UID: \"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e\") " Jul 22 18:51:02.997038 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.996923 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" (UID: "f4330fc1-dfdf-48cd-9b23-d03a4182bb2e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:51:02.997038 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.997032 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" (UID: "f4330fc1-dfdf-48cd-9b23-d03a4182bb2e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:51:02.997300 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.997221 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" (UID: "f4330fc1-dfdf-48cd-9b23-d03a4182bb2e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:51:02.997357 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.997315 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-credential-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:51:02.997357 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.997333 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-workload-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:51:02.997357 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.997347 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-workload-certs\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:51:02.997738 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.997532 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" (UID: "f4330fc1-dfdf-48cd-9b23-d03a4182bb2e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:51:02.997839 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.997822 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-data" (OuterVolumeSpecName: "istio-data") pod "f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" (UID: "f4330fc1-dfdf-48cd-9b23-d03a4182bb2e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:51:02.999218 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.999183 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" (UID: "f4330fc1-dfdf-48cd-9b23-d03a4182bb2e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 18:51:02.999329 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.999288 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-token" (OuterVolumeSpecName: "istio-token") pod "f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" (UID: "f4330fc1-dfdf-48cd-9b23-d03a4182bb2e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:51:02.999493 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.999476 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" (UID: "f4330fc1-dfdf-48cd-9b23-d03a4182bb2e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:51:02.999568 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:02.999489 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-kube-api-access-wxzsn" (OuterVolumeSpecName: "kube-api-access-wxzsn") pod "f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" (UID: "f4330fc1-dfdf-48cd-9b23-d03a4182bb2e"). InnerVolumeSpecName "kube-api-access-wxzsn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:51:03.097938 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:03.097898 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-token\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:51:03.097938 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:03.097930 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-envoy\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:51:03.097938 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:03.097941 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istiod-ca-cert\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:51:03.098190 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:03.097951 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-data\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:51:03.098190 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:03.097964 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxzsn\" (UniqueName: \"kubernetes.io/projected/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-kube-api-access-wxzsn\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:51:03.098190 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:03.097976 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e-istio-podinfo\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:51:03.572848 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:03.572810 2554 generic.go:356] "Generic (PLEG): container finished" podID="f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" containerID="95df2d8501edef14b8be8e82cd85a8bfb4dbf040edcc77028e4959c034f5ce9b" exitCode=0 Jul 22 18:51:03.573035 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:03.572856 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" Jul 22 18:51:03.573035 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:03.572890 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" event={"ID":"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e","Type":"ContainerDied","Data":"95df2d8501edef14b8be8e82cd85a8bfb4dbf040edcc77028e4959c034f5ce9b"} Jul 22 18:51:03.573035 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:03.572944 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f" event={"ID":"f4330fc1-dfdf-48cd-9b23-d03a4182bb2e","Type":"ContainerDied","Data":"6dc4971a21d251e82373fb73e51f00751a31ecbe1694598c276ed719fdee415d"} Jul 22 18:51:03.573035 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:03.572966 2554 scope.go:117] "RemoveContainer" containerID="95df2d8501edef14b8be8e82cd85a8bfb4dbf040edcc77028e4959c034f5ce9b" Jul 22 18:51:03.582534 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:03.582514 2554 scope.go:117] "RemoveContainer" containerID="8495d23df499cb3e173c007d910b7086bfe3129a148bf5d4cbdddd5a9901e356" Jul 22 18:51:03.591049 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:03.591029 2554 scope.go:117] "RemoveContainer" containerID="95df2d8501edef14b8be8e82cd85a8bfb4dbf040edcc77028e4959c034f5ce9b" Jul 22 18:51:03.591332 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:51:03.591310 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95df2d8501edef14b8be8e82cd85a8bfb4dbf040edcc77028e4959c034f5ce9b\": container with ID starting with 95df2d8501edef14b8be8e82cd85a8bfb4dbf040edcc77028e4959c034f5ce9b not found: ID does not exist" containerID="95df2d8501edef14b8be8e82cd85a8bfb4dbf040edcc77028e4959c034f5ce9b" Jul 22 18:51:03.591402 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:03.591340 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95df2d8501edef14b8be8e82cd85a8bfb4dbf040edcc77028e4959c034f5ce9b"} err="failed to get container status \"95df2d8501edef14b8be8e82cd85a8bfb4dbf040edcc77028e4959c034f5ce9b\": rpc error: code = NotFound desc = could not find container \"95df2d8501edef14b8be8e82cd85a8bfb4dbf040edcc77028e4959c034f5ce9b\": container with ID starting with 95df2d8501edef14b8be8e82cd85a8bfb4dbf040edcc77028e4959c034f5ce9b not found: ID does not exist" Jul 22 18:51:03.591402 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:03.591358 2554 scope.go:117] "RemoveContainer" containerID="8495d23df499cb3e173c007d910b7086bfe3129a148bf5d4cbdddd5a9901e356" Jul 22 18:51:03.591666 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:51:03.591645 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8495d23df499cb3e173c007d910b7086bfe3129a148bf5d4cbdddd5a9901e356\": container with ID starting with 8495d23df499cb3e173c007d910b7086bfe3129a148bf5d4cbdddd5a9901e356 not found: ID does not exist" containerID="8495d23df499cb3e173c007d910b7086bfe3129a148bf5d4cbdddd5a9901e356" Jul 22 18:51:03.591707 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:03.591671 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8495d23df499cb3e173c007d910b7086bfe3129a148bf5d4cbdddd5a9901e356"} err="failed to get container status \"8495d23df499cb3e173c007d910b7086bfe3129a148bf5d4cbdddd5a9901e356\": rpc error: code = NotFound desc = could not find container \"8495d23df499cb3e173c007d910b7086bfe3129a148bf5d4cbdddd5a9901e356\": container with ID starting with 8495d23df499cb3e173c007d910b7086bfe3129a148bf5d4cbdddd5a9901e356 not found: ID does not exist" Jul 22 18:51:03.599065 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:03.599040 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f"] Jul 22 18:51:03.604112 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:03.604090 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f02c5841-openshift-default-86947499d7-x4j5f"] Jul 22 18:51:04.547030 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:04.546998 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" path="/var/lib/kubelet/pods/f4330fc1-dfdf-48cd-9b23-d03a4182bb2e/volumes" Jul 22 18:51:07.382646 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:07.382608 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:07.455541 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:07.455511 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:08.095576 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:08.095546 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:13.923764 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:13.923729 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:14.029299 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:14.029269 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:14.134845 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:14.134806 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:24.700171 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:24.700133 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:24.818190 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:24.818149 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:25.029202 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:25.029171 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:45.653545 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:45.653513 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:46.008909 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:46.008875 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:52.394001 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:52.393972 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:52.604569 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:52.604538 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:52.737782 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:52.737702 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:53.015244 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.015214 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln"] Jul 22 18:51:53.015796 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.015774 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" containerName="istio-proxy" Jul 22 18:51:53.015858 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.015801 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" containerName="istio-proxy" Jul 22 18:51:53.015858 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.015844 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" containerName="istio-proxy" Jul 22 18:51:53.015858 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.015853 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" containerName="istio-proxy" Jul 22 18:51:53.015952 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.015934 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" containerName="istio-proxy" Jul 22 18:51:53.015952 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.015947 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4330fc1-dfdf-48cd-9b23-d03a4182bb2e" containerName="istio-proxy" Jul 22 18:51:53.019327 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.019308 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.022177 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.022159 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-d001ad-openshift-default-dockercfg-xs2rw\"" Jul 22 18:51:53.030511 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.030483 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln"] Jul 22 18:51:53.042174 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.042145 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:53.177880 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.177835 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwzck\" (UniqueName: \"kubernetes.io/projected/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-kube-api-access-lwzck\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.178087 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.177902 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-envoy\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.178087 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.177933 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-podinfo\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.178087 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.177949 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istiod-ca-cert\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.178087 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.177973 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-token\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.178087 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.178011 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-data\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.178087 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.178034 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-workload-certs\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.178087 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.178065 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-credential-socket\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.178337 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.178134 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-workload-socket\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.279210 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.279104 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-credential-socket\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.279210 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.279199 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-workload-socket\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.279489 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.279263 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwzck\" (UniqueName: \"kubernetes.io/projected/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-kube-api-access-lwzck\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.279489 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.279315 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-envoy\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.279489 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.279344 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-podinfo\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.279489 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.279385 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istiod-ca-cert\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.279489 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.279452 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-token\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.279757 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.279506 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-data\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.279757 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.279536 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-workload-certs\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.279757 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.279575 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-credential-socket\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.279757 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.279634 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-workload-socket\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.279975 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.279961 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-data\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.280075 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.280056 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-workload-certs\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.280554 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.280529 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istiod-ca-cert\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.281896 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.281875 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-envoy\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.282132 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.282113 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-podinfo\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.287893 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.287873 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-token\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.287995 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.287932 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwzck\" (UniqueName: \"kubernetes.io/projected/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-kube-api-access-lwzck\") pod \"e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.332148 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.332114 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:53.415504 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.415365 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:53.481750 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.481726 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln"] Jul 22 18:51:53.484287 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:51:53.484257 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea736d2_a56b_41f2_a9d6_31e7a8150e01.slice/crio-300f49834666e9c9010210a8420e5ccb2e42414817162eb315314680fe80d660 WatchSource:0}: Error finding container 300f49834666e9c9010210a8420e5ccb2e42414817162eb315314680fe80d660: Status 404 returned error can't find the container with id 300f49834666e9c9010210a8420e5ccb2e42414817162eb315314680fe80d660 Jul 22 18:51:53.487544 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.487516 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:51:53.487617 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.487578 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:51:53.487617 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.487606 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:51:53.809117 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.809029 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" event={"ID":"1ea736d2-a56b-41f2-a9d6-31e7a8150e01","Type":"ContainerStarted","Data":"73310066d145f794ec4c0bc53992d93baeca74d2c30cf83c5c07725eb4e885b2"} Jul 22 18:51:53.809117 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.809078 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" event={"ID":"1ea736d2-a56b-41f2-a9d6-31e7a8150e01","Type":"ContainerStarted","Data":"300f49834666e9c9010210a8420e5ccb2e42414817162eb315314680fe80d660"} Jul 22 18:51:53.833109 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:53.833055 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" podStartSLOduration=1.833036054 podStartE2EDuration="1.833036054s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:51:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:51:53.830842366 +0000 UTC m=+2269.755737375" watchObservedRunningTime="2026-07-22 18:51:53.833036054 +0000 UTC m=+2269.757931072" Jul 22 18:51:54.332608 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:54.332577 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:54.337475 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:54.337452 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:54.814779 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:54.814753 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:54.815915 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:54.815897 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:51:55.795470 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:55.795362 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:55.962001 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:55.961957 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:56.052393 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:56.052284 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:56.368942 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:56.368820 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:56.640527 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:56.640400 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:51:56.841915 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:51:56.841886 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:00.269066 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:00.269032 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:00.612609 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:00.612526 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:00.894604 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:00.894507 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf"] Jul 22 18:52:00.898854 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:00.898831 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:00.901516 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:00.901487 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-ef44fb-openshift-default-dockercfg-6ptcf\"" Jul 22 18:52:00.909768 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:00.909742 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf"] Jul 22 18:52:00.926302 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:00.926274 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:01.053191 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.053155 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a91cfa88-877f-4de0-b8df-d1211c4f518e-istiod-ca-cert\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.053191 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.053198 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-workload-socket\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.053467 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.053272 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-credential-socket\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.053467 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.053305 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-token\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.053467 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.053339 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-envoy\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.053467 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.053409 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-workload-certs\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.053467 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.053447 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-data\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.053467 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.053463 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-podinfo\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.053674 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.053479 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdrpz\" (UniqueName: \"kubernetes.io/projected/a91cfa88-877f-4de0-b8df-d1211c4f518e-kube-api-access-mdrpz\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.154749 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.154663 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-credential-socket\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.154749 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.154708 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-token\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.154749 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.154737 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-envoy\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.155036 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.154799 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-workload-certs\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.155036 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.154828 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-data\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.155036 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.154853 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-podinfo\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.155036 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.154995 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdrpz\" (UniqueName: \"kubernetes.io/projected/a91cfa88-877f-4de0-b8df-d1211c4f518e-kube-api-access-mdrpz\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.155296 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.155062 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a91cfa88-877f-4de0-b8df-d1211c4f518e-istiod-ca-cert\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.155296 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.155094 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-credential-socket\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.155296 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.155101 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-workload-socket\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.155296 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.155221 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-workload-certs\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.155296 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.155276 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-data\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.155600 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.155366 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-workload-socket\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.155801 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.155781 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a91cfa88-877f-4de0-b8df-d1211c4f518e-istiod-ca-cert\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.157121 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.157094 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-envoy\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.157325 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.157308 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-podinfo\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.162681 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.162657 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdrpz\" (UniqueName: \"kubernetes.io/projected/a91cfa88-877f-4de0-b8df-d1211c4f518e-kube-api-access-mdrpz\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.162786 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.162661 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-token\") pod \"e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.174190 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.174018 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:01.212570 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.212546 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:01.367666 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.367638 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf"] Jul 22 18:52:01.369656 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:52:01.369624 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda91cfa88_877f_4de0_b8df_d1211c4f518e.slice/crio-9c59c00ece1715b50883f6b142729b21e05853b604b2c107756482a5491df7cc WatchSource:0}: Error finding container 9c59c00ece1715b50883f6b142729b21e05853b604b2c107756482a5491df7cc: Status 404 returned error can't find the container with id 9c59c00ece1715b50883f6b142729b21e05853b604b2c107756482a5491df7cc Jul 22 18:52:01.372346 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.372308 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:52:01.372450 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.372396 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:52:01.372503 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.372480 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:52:01.766740 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.766693 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:01.848843 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.848803 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" event={"ID":"a91cfa88-877f-4de0-b8df-d1211c4f518e","Type":"ContainerStarted","Data":"6896fbfdf8860cee830f9234facf55c8d93bbc1db2bc3f7f412dd5f9833848db"} Jul 22 18:52:01.849020 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.848880 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" event={"ID":"a91cfa88-877f-4de0-b8df-d1211c4f518e","Type":"ContainerStarted","Data":"9c59c00ece1715b50883f6b142729b21e05853b604b2c107756482a5491df7cc"} Jul 22 18:52:01.866812 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.866774 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:01.871901 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:01.871856 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" podStartSLOduration=1.871841344 podStartE2EDuration="1.871841344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:52:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:52:01.870602264 +0000 UTC m=+2277.795497307" watchObservedRunningTime="2026-07-22 18:52:01.871841344 +0000 UTC m=+2277.796736419" Jul 22 18:52:02.213260 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:02.213167 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:02.218525 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:02.218496 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:02.853945 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:02.853914 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:02.855037 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:02.855014 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:03.811313 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:03.811282 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:04.343351 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:04.343320 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:04.498199 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:04.498162 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:04.735757 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:04.735666 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:04.838464 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:04.838432 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:08.366368 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:08.366333 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:09.817036 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:09.817001 2554 patch_prober.go:28] interesting pod/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 22 18:52:09.817548 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:09.817059 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" podUID="1ea736d2-a56b-41f2-a9d6-31e7a8150e01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 22 18:52:09.891114 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:09.891078 2554 generic.go:356] "Generic (PLEG): container finished" podID="1ea736d2-a56b-41f2-a9d6-31e7a8150e01" containerID="73310066d145f794ec4c0bc53992d93baeca74d2c30cf83c5c07725eb4e885b2" exitCode=0 Jul 22 18:52:09.891312 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:09.891154 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" event={"ID":"1ea736d2-a56b-41f2-a9d6-31e7a8150e01","Type":"ContainerDied","Data":"73310066d145f794ec4c0bc53992d93baeca74d2c30cf83c5c07725eb4e885b2"} Jul 22 18:52:09.891678 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:09.891661 2554 scope.go:117] "RemoveContainer" containerID="73310066d145f794ec4c0bc53992d93baeca74d2c30cf83c5c07725eb4e885b2" Jul 22 18:52:09.892738 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:09.892713 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:52:09.892794 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:09.892779 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:52:09.892834 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:09.892810 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:52:10.897406 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:10.897369 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" event={"ID":"1ea736d2-a56b-41f2-a9d6-31e7a8150e01","Type":"ContainerStarted","Data":"d39f182728602198ae387ff842c04de474ce762d82620a868c1a1f7ce322eca4"} Jul 22 18:52:11.333269 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:11.333233 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:52:11.333499 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:11.333365 2554 patch_prober.go:28] interesting pod/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 22 18:52:11.333499 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:11.333408 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" podUID="1ea736d2-a56b-41f2-a9d6-31e7a8150e01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 22 18:52:12.332618 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:12.332580 2554 patch_prober.go:28] interesting pod/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 22 18:52:12.333038 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:12.332641 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" podUID="1ea736d2-a56b-41f2-a9d6-31e7a8150e01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 22 18:52:12.885157 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:12.885114 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:13.332662 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:13.332621 2554 patch_prober.go:28] interesting pod/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 22 18:52:13.333075 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:13.332682 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" podUID="1ea736d2-a56b-41f2-a9d6-31e7a8150e01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 22 18:52:14.333439 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:14.333363 2554 patch_prober.go:28] interesting pod/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 22 18:52:14.333948 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:14.333451 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" podUID="1ea736d2-a56b-41f2-a9d6-31e7a8150e01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 22 18:52:15.333595 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:15.333554 2554 patch_prober.go:28] interesting pod/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body= Jul 22 18:52:15.334018 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:15.333622 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" podUID="1ea736d2-a56b-41f2-a9d6-31e7a8150e01" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" Jul 22 18:52:16.337492 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:16.337463 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:52:16.338016 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:16.337860 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:52:16.338762 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:16.338743 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:52:17.506992 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:17.506957 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:17.607080 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:17.607050 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:18.260350 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:18.259578 2554 patch_prober.go:28] interesting pod/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": read tcp 10.133.0.2:39928->10.133.0.44:15021: read: connection reset by peer" start-of-body= Jul 22 18:52:18.260350 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:18.259656 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" podUID="a91cfa88-877f-4de0-b8df-d1211c4f518e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": read tcp 10.133.0.2:39928->10.133.0.44:15021: read: connection reset by peer" Jul 22 18:52:18.944004 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:18.943970 2554 generic.go:356] "Generic (PLEG): container finished" podID="a91cfa88-877f-4de0-b8df-d1211c4f518e" containerID="6896fbfdf8860cee830f9234facf55c8d93bbc1db2bc3f7f412dd5f9833848db" exitCode=0 Jul 22 18:52:18.944356 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:18.944045 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" event={"ID":"a91cfa88-877f-4de0-b8df-d1211c4f518e","Type":"ContainerDied","Data":"6896fbfdf8860cee830f9234facf55c8d93bbc1db2bc3f7f412dd5f9833848db"} Jul 22 18:52:18.944507 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:18.944492 2554 scope.go:117] "RemoveContainer" containerID="6896fbfdf8860cee830f9234facf55c8d93bbc1db2bc3f7f412dd5f9833848db" Jul 22 18:52:18.945601 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:18.945578 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:52:18.945668 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:18.945641 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:52:18.945705 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:18.945672 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:52:19.951284 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:19.951248 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" event={"ID":"a91cfa88-877f-4de0-b8df-d1211c4f518e","Type":"ContainerStarted","Data":"3fd64d5919c88d9cb0c0f14116c999bcc0d8c575a6a4fca85948eb0e215aaa25"} Jul 22 18:52:20.212853 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:20.212752 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:20.213027 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:20.213005 2554 patch_prober.go:28] interesting pod/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 22 18:52:20.213074 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:20.213053 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" podUID="a91cfa88-877f-4de0-b8df-d1211c4f518e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 22 18:52:21.213951 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:21.213906 2554 patch_prober.go:28] interesting pod/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 22 18:52:21.214494 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:21.213971 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" podUID="a91cfa88-877f-4de0-b8df-d1211c4f518e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 22 18:52:22.213702 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:22.213661 2554 patch_prober.go:28] interesting pod/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 22 18:52:22.213899 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:22.213725 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" podUID="a91cfa88-877f-4de0-b8df-d1211c4f518e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 22 18:52:23.213625 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:23.213583 2554 patch_prober.go:28] interesting pod/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" start-of-body= Jul 22 18:52:23.214173 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:23.213648 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" podUID="a91cfa88-877f-4de0-b8df-d1211c4f518e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.44:15021/healthz/ready\": dial tcp 10.133.0.44:15021: connect: connection refused" Jul 22 18:52:24.217172 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:24.217139 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:24.217596 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:24.217441 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:24.218094 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:24.218074 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:52:26.687363 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:26.687309 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:26.788089 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:26.788056 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:52:40.839255 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:52:40.839228 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:53:22.964511 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:22.964470 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:53:24.944102 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:24.944066 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:53:34.590984 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:34.590949 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:53:39.071954 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:39.071912 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:53:39.472942 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:39.472844 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:53:45.487192 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:45.487156 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:53:45.593297 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:45.593266 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:53:45.747798 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:45.747759 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln"] Jul 22 18:53:46.032673 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:46.032591 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:53:46.117679 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:46.117643 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:53:46.375583 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:46.375486 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" podUID="1ea736d2-a56b-41f2-a9d6-31e7a8150e01" containerName="istio-proxy" containerID="cri-o://d39f182728602198ae387ff842c04de474ce762d82620a868c1a1f7ce322eca4" gracePeriod=30 Jul 22 18:53:46.764153 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:46.764114 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:53:46.863182 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:46.863147 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:53:51.638219 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.638154 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:53:51.668318 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.668289 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istiod-ca-cert\") pod \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " Jul 22 18:53:51.668521 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.668383 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-envoy\") pod \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " Jul 22 18:53:51.668521 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.668409 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-token\") pod \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " Jul 22 18:53:51.668521 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.668468 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-data\") pod \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " Jul 22 18:53:51.668521 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.668492 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-podinfo\") pod \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " Jul 22 18:53:51.668736 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.668525 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwzck\" (UniqueName: \"kubernetes.io/projected/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-kube-api-access-lwzck\") pod \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " Jul 22 18:53:51.668736 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.668679 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1ea736d2-a56b-41f2-a9d6-31e7a8150e01" (UID: "1ea736d2-a56b-41f2-a9d6-31e7a8150e01"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:53:51.668947 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.668608 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-credential-socket\") pod \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " Jul 22 18:53:51.669091 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.669068 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-workload-certs\") pod \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " Jul 22 18:53:51.669224 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.669109 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-workload-socket\") pod \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\" (UID: \"1ea736d2-a56b-41f2-a9d6-31e7a8150e01\") " Jul 22 18:53:51.669615 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.668955 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1ea736d2-a56b-41f2-a9d6-31e7a8150e01" (UID: "1ea736d2-a56b-41f2-a9d6-31e7a8150e01"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:53:51.669733 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.669564 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-data" (OuterVolumeSpecName: "istio-data") pod "1ea736d2-a56b-41f2-a9d6-31e7a8150e01" (UID: "1ea736d2-a56b-41f2-a9d6-31e7a8150e01"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:53:51.669733 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.669571 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1ea736d2-a56b-41f2-a9d6-31e7a8150e01" (UID: "1ea736d2-a56b-41f2-a9d6-31e7a8150e01"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:53:51.669879 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.669748 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-data\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:53:51.669879 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.669772 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-credential-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:53:51.669879 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.669786 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-workload-certs\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:53:51.669879 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.669802 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istiod-ca-cert\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:53:51.669879 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.669828 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1ea736d2-a56b-41f2-a9d6-31e7a8150e01" (UID: "1ea736d2-a56b-41f2-a9d6-31e7a8150e01"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:53:51.671040 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.671017 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-kube-api-access-lwzck" (OuterVolumeSpecName: "kube-api-access-lwzck") pod "1ea736d2-a56b-41f2-a9d6-31e7a8150e01" (UID: "1ea736d2-a56b-41f2-a9d6-31e7a8150e01"). InnerVolumeSpecName "kube-api-access-lwzck". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:53:51.671216 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.671190 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-token" (OuterVolumeSpecName: "istio-token") pod "1ea736d2-a56b-41f2-a9d6-31e7a8150e01" (UID: "1ea736d2-a56b-41f2-a9d6-31e7a8150e01"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:53:51.671285 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.671238 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1ea736d2-a56b-41f2-a9d6-31e7a8150e01" (UID: "1ea736d2-a56b-41f2-a9d6-31e7a8150e01"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 18:53:51.671331 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.671281 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1ea736d2-a56b-41f2-a9d6-31e7a8150e01" (UID: "1ea736d2-a56b-41f2-a9d6-31e7a8150e01"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:53:51.771085 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.771046 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-workload-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:53:51.771085 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.771079 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-envoy\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:53:51.771085 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.771093 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-token\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:53:51.771344 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.771104 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-istio-podinfo\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:53:51.771344 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:51.771117 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwzck\" (UniqueName: \"kubernetes.io/projected/1ea736d2-a56b-41f2-a9d6-31e7a8150e01-kube-api-access-lwzck\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:53:52.408859 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:52.408822 2554 generic.go:356] "Generic (PLEG): container finished" podID="1ea736d2-a56b-41f2-a9d6-31e7a8150e01" containerID="d39f182728602198ae387ff842c04de474ce762d82620a868c1a1f7ce322eca4" exitCode=0 Jul 22 18:53:52.409037 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:52.408877 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" Jul 22 18:53:52.409037 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:52.408908 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" event={"ID":"1ea736d2-a56b-41f2-a9d6-31e7a8150e01","Type":"ContainerDied","Data":"d39f182728602198ae387ff842c04de474ce762d82620a868c1a1f7ce322eca4"} Jul 22 18:53:52.409037 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:52.408968 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln" event={"ID":"1ea736d2-a56b-41f2-a9d6-31e7a8150e01","Type":"ContainerDied","Data":"300f49834666e9c9010210a8420e5ccb2e42414817162eb315314680fe80d660"} Jul 22 18:53:52.409037 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:52.408997 2554 scope.go:117] "RemoveContainer" containerID="d39f182728602198ae387ff842c04de474ce762d82620a868c1a1f7ce322eca4" Jul 22 18:53:52.418285 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:52.418267 2554 scope.go:117] "RemoveContainer" containerID="73310066d145f794ec4c0bc53992d93baeca74d2c30cf83c5c07725eb4e885b2" Jul 22 18:53:52.426558 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:52.426537 2554 scope.go:117] "RemoveContainer" containerID="d39f182728602198ae387ff842c04de474ce762d82620a868c1a1f7ce322eca4" Jul 22 18:53:52.426825 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:53:52.426804 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d39f182728602198ae387ff842c04de474ce762d82620a868c1a1f7ce322eca4\": container with ID starting with d39f182728602198ae387ff842c04de474ce762d82620a868c1a1f7ce322eca4 not found: ID does not exist" containerID="d39f182728602198ae387ff842c04de474ce762d82620a868c1a1f7ce322eca4" Jul 22 18:53:52.426918 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:52.426840 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d39f182728602198ae387ff842c04de474ce762d82620a868c1a1f7ce322eca4"} err="failed to get container status \"d39f182728602198ae387ff842c04de474ce762d82620a868c1a1f7ce322eca4\": rpc error: code = NotFound desc = could not find container \"d39f182728602198ae387ff842c04de474ce762d82620a868c1a1f7ce322eca4\": container with ID starting with d39f182728602198ae387ff842c04de474ce762d82620a868c1a1f7ce322eca4 not found: ID does not exist" Jul 22 18:53:52.426918 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:52.426867 2554 scope.go:117] "RemoveContainer" containerID="73310066d145f794ec4c0bc53992d93baeca74d2c30cf83c5c07725eb4e885b2" Jul 22 18:53:52.427133 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:53:52.427117 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73310066d145f794ec4c0bc53992d93baeca74d2c30cf83c5c07725eb4e885b2\": container with ID starting with 73310066d145f794ec4c0bc53992d93baeca74d2c30cf83c5c07725eb4e885b2 not found: ID does not exist" containerID="73310066d145f794ec4c0bc53992d93baeca74d2c30cf83c5c07725eb4e885b2" Jul 22 18:53:52.427174 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:52.427141 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73310066d145f794ec4c0bc53992d93baeca74d2c30cf83c5c07725eb4e885b2"} err="failed to get container status \"73310066d145f794ec4c0bc53992d93baeca74d2c30cf83c5c07725eb4e885b2\": rpc error: code = NotFound desc = could not find container \"73310066d145f794ec4c0bc53992d93baeca74d2c30cf83c5c07725eb4e885b2\": container with ID starting with 73310066d145f794ec4c0bc53992d93baeca74d2c30cf83c5c07725eb4e885b2 not found: ID does not exist" Jul 22 18:53:52.432784 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:52.432756 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln"] Jul 22 18:53:52.436260 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:52.436235 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-d001ad-openshift-default-68485f88b5-xbhln"] Jul 22 18:53:52.548205 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:52.548170 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ea736d2-a56b-41f2-a9d6-31e7a8150e01" path="/var/lib/kubelet/pods/1ea736d2-a56b-41f2-a9d6-31e7a8150e01/volumes" Jul 22 18:53:56.724182 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:53:56.724142 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:01.224188 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:01.224147 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:01.584825 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:01.584790 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:05.452518 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:05.452486 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:54:05.457223 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:05.457202 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:54:07.205054 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:07.205016 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:07.271828 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:07.271772 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:07.471539 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:07.471447 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf"] Jul 22 18:54:07.471755 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:07.471711 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" podUID="a91cfa88-877f-4de0-b8df-d1211c4f518e" containerName="istio-proxy" containerID="cri-o://3fd64d5919c88d9cb0c0f14116c999bcc0d8c575a6a4fca85948eb0e215aaa25" gracePeriod=30 Jul 22 18:54:07.497859 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:07.497826 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:07.825370 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:07.825332 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:08.080248 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.080167 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:08.377484 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.377374 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg"] Jul 22 18:54:08.377920 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.377815 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea736d2-a56b-41f2-a9d6-31e7a8150e01" containerName="istio-proxy" Jul 22 18:54:08.377920 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.377828 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea736d2-a56b-41f2-a9d6-31e7a8150e01" containerName="istio-proxy" Jul 22 18:54:08.377920 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.377838 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea736d2-a56b-41f2-a9d6-31e7a8150e01" containerName="istio-proxy" Jul 22 18:54:08.377920 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.377843 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea736d2-a56b-41f2-a9d6-31e7a8150e01" containerName="istio-proxy" Jul 22 18:54:08.377920 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.377907 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea736d2-a56b-41f2-a9d6-31e7a8150e01" containerName="istio-proxy" Jul 22 18:54:08.377920 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.377915 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea736d2-a56b-41f2-a9d6-31e7a8150e01" containerName="istio-proxy" Jul 22 18:54:08.382531 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.382512 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.385390 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.385367 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-f44f9a-openshift-default-dockercfg-2smqs\"" Jul 22 18:54:08.394041 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.394017 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg"] Jul 22 18:54:08.396862 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.396835 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:08.530734 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.530695 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65f82d02-867c-43e9-8053-79954244b6e3-istio-token\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.530906 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.530758 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s9m6\" (UniqueName: \"kubernetes.io/projected/65f82d02-867c-43e9-8053-79954244b6e3-kube-api-access-8s9m6\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.530906 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.530825 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65f82d02-867c-43e9-8053-79954244b6e3-istio-podinfo\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.530906 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.530888 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65f82d02-867c-43e9-8053-79954244b6e3-istiod-ca-cert\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.531076 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.530914 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-credential-socket\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.531076 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.531020 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-istio-envoy\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.531076 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.531073 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-istio-data\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.531198 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.531125 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-workload-socket\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.531198 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.531171 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-workload-certs\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.580438 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.580381 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:08.632806 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.632731 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-workload-certs\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.632806 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.632783 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65f82d02-867c-43e9-8053-79954244b6e3-istio-token\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.633005 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.632822 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s9m6\" (UniqueName: \"kubernetes.io/projected/65f82d02-867c-43e9-8053-79954244b6e3-kube-api-access-8s9m6\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.633005 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.632847 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65f82d02-867c-43e9-8053-79954244b6e3-istio-podinfo\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.633005 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.632906 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65f82d02-867c-43e9-8053-79954244b6e3-istiod-ca-cert\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.633005 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.632948 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-credential-socket\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.633213 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.633005 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-istio-envoy\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.633213 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.633037 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-istio-data\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.633213 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.633070 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-workload-socket\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.633213 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.633184 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-workload-certs\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.633469 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.633354 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-credential-socket\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.633518 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.633482 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-istio-data\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.633616 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.633595 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-workload-socket\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.633803 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.633787 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65f82d02-867c-43e9-8053-79954244b6e3-istiod-ca-cert\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.635408 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.635387 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-istio-envoy\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.635586 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.635544 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65f82d02-867c-43e9-8053-79954244b6e3-istio-podinfo\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.641847 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.641816 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65f82d02-867c-43e9-8053-79954244b6e3-istio-token\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.642091 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.642072 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s9m6\" (UniqueName: \"kubernetes.io/projected/65f82d02-867c-43e9-8053-79954244b6e3-kube-api-access-8s9m6\") pod \"e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.694646 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.694617 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:08.833166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.833142 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg"] Jul 22 18:54:08.835883 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:54:08.835844 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65f82d02_867c_43e9_8053_79954244b6e3.slice/crio-eec90f9fcbeb90afe4f60b09b6044d044c0dcd12575dcaeb817635a580e1c858 WatchSource:0}: Error finding container eec90f9fcbeb90afe4f60b09b6044d044c0dcd12575dcaeb817635a580e1c858: Status 404 returned error can't find the container with id eec90f9fcbeb90afe4f60b09b6044d044c0dcd12575dcaeb817635a580e1c858 Jul 22 18:54:08.837965 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.837934 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:54:08.838058 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.838003 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:54:08.838058 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:08.838046 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:54:09.219641 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:09.219548 2554 patch_prober.go:28] interesting pod/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 22 18:54:09.219813 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:09.219634 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" podUID="a91cfa88-877f-4de0-b8df-d1211c4f518e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 18:54:09.492942 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:09.492913 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" event={"ID":"65f82d02-867c-43e9-8053-79954244b6e3","Type":"ContainerStarted","Data":"8eb72ffed8c5a9c41b7f99a19ba013d34ed52e589c64a6639772997a17390288"} Jul 22 18:54:09.493340 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:09.492963 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" event={"ID":"65f82d02-867c-43e9-8053-79954244b6e3","Type":"ContainerStarted","Data":"eec90f9fcbeb90afe4f60b09b6044d044c0dcd12575dcaeb817635a580e1c858"} Jul 22 18:54:09.515950 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:09.515891 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" podStartSLOduration=1.515875545 podStartE2EDuration="1.515875545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:54:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:54:09.5130584 +0000 UTC m=+2405.437953454" watchObservedRunningTime="2026-07-22 18:54:09.515875545 +0000 UTC m=+2405.440770562" Jul 22 18:54:09.695748 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:09.695713 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:09.700599 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:09.700575 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:10.497953 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:10.497924 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:10.498958 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:10.498938 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:11.450034 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:11.450004 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:11.537700 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:11.537662 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:11.617658 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:11.617627 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:11.785483 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:11.785444 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:12.144138 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.144048 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:12.242659 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.242626 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:12.724807 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.724784 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:54:12.875719 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.875671 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-token\") pod \"a91cfa88-877f-4de0-b8df-d1211c4f518e\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " Jul 22 18:54:12.875936 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.875731 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-podinfo\") pod \"a91cfa88-877f-4de0-b8df-d1211c4f518e\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " Jul 22 18:54:12.875936 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.875773 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-envoy\") pod \"a91cfa88-877f-4de0-b8df-d1211c4f518e\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " Jul 22 18:54:12.875936 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.875822 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-workload-certs\") pod \"a91cfa88-877f-4de0-b8df-d1211c4f518e\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " Jul 22 18:54:12.876154 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.875931 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-workload-socket\") pod \"a91cfa88-877f-4de0-b8df-d1211c4f518e\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " Jul 22 18:54:12.876154 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.875983 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdrpz\" (UniqueName: \"kubernetes.io/projected/a91cfa88-877f-4de0-b8df-d1211c4f518e-kube-api-access-mdrpz\") pod \"a91cfa88-877f-4de0-b8df-d1211c4f518e\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " Jul 22 18:54:12.876154 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.876069 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a91cfa88-877f-4de0-b8df-d1211c4f518e-istiod-ca-cert\") pod \"a91cfa88-877f-4de0-b8df-d1211c4f518e\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " Jul 22 18:54:12.876154 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.876108 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-credential-socket\") pod \"a91cfa88-877f-4de0-b8df-d1211c4f518e\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " Jul 22 18:54:12.876609 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.876161 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-data\") pod \"a91cfa88-877f-4de0-b8df-d1211c4f518e\" (UID: \"a91cfa88-877f-4de0-b8df-d1211c4f518e\") " Jul 22 18:54:12.876930 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.876156 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a91cfa88-877f-4de0-b8df-d1211c4f518e" (UID: "a91cfa88-877f-4de0-b8df-d1211c4f518e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:54:12.876930 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.876560 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a91cfa88-877f-4de0-b8df-d1211c4f518e" (UID: "a91cfa88-877f-4de0-b8df-d1211c4f518e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:54:12.876930 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.876710 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a91cfa88-877f-4de0-b8df-d1211c4f518e" (UID: "a91cfa88-877f-4de0-b8df-d1211c4f518e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:54:12.876930 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.876866 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a91cfa88-877f-4de0-b8df-d1211c4f518e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a91cfa88-877f-4de0-b8df-d1211c4f518e" (UID: "a91cfa88-877f-4de0-b8df-d1211c4f518e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:54:12.877506 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.876990 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-credential-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:54:12.877506 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.877012 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-workload-certs\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:54:12.877506 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.877028 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-workload-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:54:12.877669 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.877581 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-data" (OuterVolumeSpecName: "istio-data") pod "a91cfa88-877f-4de0-b8df-d1211c4f518e" (UID: "a91cfa88-877f-4de0-b8df-d1211c4f518e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:54:12.878571 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.878546 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a91cfa88-877f-4de0-b8df-d1211c4f518e" (UID: "a91cfa88-877f-4de0-b8df-d1211c4f518e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 18:54:12.878986 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.878962 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-token" (OuterVolumeSpecName: "istio-token") pod "a91cfa88-877f-4de0-b8df-d1211c4f518e" (UID: "a91cfa88-877f-4de0-b8df-d1211c4f518e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:54:12.879088 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.878965 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a91cfa88-877f-4de0-b8df-d1211c4f518e" (UID: "a91cfa88-877f-4de0-b8df-d1211c4f518e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:54:12.879618 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.879590 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a91cfa88-877f-4de0-b8df-d1211c4f518e-kube-api-access-mdrpz" (OuterVolumeSpecName: "kube-api-access-mdrpz") pod "a91cfa88-877f-4de0-b8df-d1211c4f518e" (UID: "a91cfa88-877f-4de0-b8df-d1211c4f518e"). InnerVolumeSpecName "kube-api-access-mdrpz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:54:12.977806 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.977768 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-token\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:54:12.977806 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.977798 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-podinfo\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:54:12.977806 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.977807 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-envoy\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:54:12.977806 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.977814 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdrpz\" (UniqueName: \"kubernetes.io/projected/a91cfa88-877f-4de0-b8df-d1211c4f518e-kube-api-access-mdrpz\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:54:12.978065 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.977824 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a91cfa88-877f-4de0-b8df-d1211c4f518e-istiod-ca-cert\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:54:12.978065 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:12.977831 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a91cfa88-877f-4de0-b8df-d1211c4f518e-istio-data\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:54:13.513581 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:13.513549 2554 generic.go:356] "Generic (PLEG): container finished" podID="a91cfa88-877f-4de0-b8df-d1211c4f518e" containerID="3fd64d5919c88d9cb0c0f14116c999bcc0d8c575a6a4fca85948eb0e215aaa25" exitCode=0 Jul 22 18:54:13.513788 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:13.513605 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" Jul 22 18:54:13.513788 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:13.513635 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" event={"ID":"a91cfa88-877f-4de0-b8df-d1211c4f518e","Type":"ContainerDied","Data":"3fd64d5919c88d9cb0c0f14116c999bcc0d8c575a6a4fca85948eb0e215aaa25"} Jul 22 18:54:13.513788 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:13.513691 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf" event={"ID":"a91cfa88-877f-4de0-b8df-d1211c4f518e","Type":"ContainerDied","Data":"9c59c00ece1715b50883f6b142729b21e05853b604b2c107756482a5491df7cc"} Jul 22 18:54:13.513788 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:13.513718 2554 scope.go:117] "RemoveContainer" containerID="3fd64d5919c88d9cb0c0f14116c999bcc0d8c575a6a4fca85948eb0e215aaa25" Jul 22 18:54:13.523613 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:13.523596 2554 scope.go:117] "RemoveContainer" containerID="6896fbfdf8860cee830f9234facf55c8d93bbc1db2bc3f7f412dd5f9833848db" Jul 22 18:54:13.534310 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:13.534290 2554 scope.go:117] "RemoveContainer" containerID="3fd64d5919c88d9cb0c0f14116c999bcc0d8c575a6a4fca85948eb0e215aaa25" Jul 22 18:54:13.534587 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:54:13.534567 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fd64d5919c88d9cb0c0f14116c999bcc0d8c575a6a4fca85948eb0e215aaa25\": container with ID starting with 3fd64d5919c88d9cb0c0f14116c999bcc0d8c575a6a4fca85948eb0e215aaa25 not found: ID does not exist" containerID="3fd64d5919c88d9cb0c0f14116c999bcc0d8c575a6a4fca85948eb0e215aaa25" Jul 22 18:54:13.534660 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:13.534597 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fd64d5919c88d9cb0c0f14116c999bcc0d8c575a6a4fca85948eb0e215aaa25"} err="failed to get container status \"3fd64d5919c88d9cb0c0f14116c999bcc0d8c575a6a4fca85948eb0e215aaa25\": rpc error: code = NotFound desc = could not find container \"3fd64d5919c88d9cb0c0f14116c999bcc0d8c575a6a4fca85948eb0e215aaa25\": container with ID starting with 3fd64d5919c88d9cb0c0f14116c999bcc0d8c575a6a4fca85948eb0e215aaa25 not found: ID does not exist" Jul 22 18:54:13.534660 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:13.534615 2554 scope.go:117] "RemoveContainer" containerID="6896fbfdf8860cee830f9234facf55c8d93bbc1db2bc3f7f412dd5f9833848db" Jul 22 18:54:13.534864 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:54:13.534849 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6896fbfdf8860cee830f9234facf55c8d93bbc1db2bc3f7f412dd5f9833848db\": container with ID starting with 6896fbfdf8860cee830f9234facf55c8d93bbc1db2bc3f7f412dd5f9833848db not found: ID does not exist" containerID="6896fbfdf8860cee830f9234facf55c8d93bbc1db2bc3f7f412dd5f9833848db" Jul 22 18:54:13.534904 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:13.534867 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6896fbfdf8860cee830f9234facf55c8d93bbc1db2bc3f7f412dd5f9833848db"} err="failed to get container status \"6896fbfdf8860cee830f9234facf55c8d93bbc1db2bc3f7f412dd5f9833848db\": rpc error: code = NotFound desc = could not find container \"6896fbfdf8860cee830f9234facf55c8d93bbc1db2bc3f7f412dd5f9833848db\": container with ID starting with 6896fbfdf8860cee830f9234facf55c8d93bbc1db2bc3f7f412dd5f9833848db not found: ID does not exist" Jul 22 18:54:13.543434 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:13.543385 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf"] Jul 22 18:54:13.546388 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:13.546367 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-ef44fb-openshift-default-8697bcb7d5-rxnbf"] Jul 22 18:54:14.548458 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:14.548400 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a91cfa88-877f-4de0-b8df-d1211c4f518e" path="/var/lib/kubelet/pods/a91cfa88-877f-4de0-b8df-d1211c4f518e/volumes" Jul 22 18:54:15.964530 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:15.964497 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:16.454085 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.454055 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:16.727071 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.726980 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5"] Jul 22 18:54:16.727682 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.727657 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a91cfa88-877f-4de0-b8df-d1211c4f518e" containerName="istio-proxy" Jul 22 18:54:16.727869 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.727846 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a91cfa88-877f-4de0-b8df-d1211c4f518e" containerName="istio-proxy" Jul 22 18:54:16.727987 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.727910 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a91cfa88-877f-4de0-b8df-d1211c4f518e" containerName="istio-proxy" Jul 22 18:54:16.727987 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.727920 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a91cfa88-877f-4de0-b8df-d1211c4f518e" containerName="istio-proxy" Jul 22 18:54:16.728095 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.728019 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a91cfa88-877f-4de0-b8df-d1211c4f518e" containerName="istio-proxy" Jul 22 18:54:16.728095 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.728029 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a91cfa88-877f-4de0-b8df-d1211c4f518e" containerName="istio-proxy" Jul 22 18:54:16.732618 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.732599 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.735458 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.735438 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-9984f4-openshift-default-dockercfg-9km6h\"" Jul 22 18:54:16.742758 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.742734 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5"] Jul 22 18:54:16.756109 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.756073 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:16.818193 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.818145 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-credential-socket\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.818387 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.818196 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-istio-data\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.818387 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.818259 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-workload-socket\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.818387 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.818295 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95185673-9920-479a-94bf-230aa09adfea-istio-podinfo\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.818387 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.818321 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95185673-9920-479a-94bf-230aa09adfea-istiod-ca-cert\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.818387 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.818366 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95185673-9920-479a-94bf-230aa09adfea-istio-token\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.818686 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.818457 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-workload-certs\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.818686 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.818518 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2t9j\" (UniqueName: \"kubernetes.io/projected/95185673-9920-479a-94bf-230aa09adfea-kube-api-access-n2t9j\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.818686 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.818560 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-istio-envoy\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.919859 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.919810 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-workload-certs\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.920039 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.919886 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2t9j\" (UniqueName: \"kubernetes.io/projected/95185673-9920-479a-94bf-230aa09adfea-kube-api-access-n2t9j\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.920039 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.919916 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-istio-envoy\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.920039 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.919952 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-credential-socket\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.920039 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.919970 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-istio-data\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.920039 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.920036 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-workload-socket\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.920365 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.920088 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95185673-9920-479a-94bf-230aa09adfea-istio-podinfo\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.920365 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.920336 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-credential-socket\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.920518 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.920383 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-istio-data\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.920518 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.920263 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95185673-9920-479a-94bf-230aa09adfea-istiod-ca-cert\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.920518 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.920492 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-workload-socket\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.920659 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.920569 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95185673-9920-479a-94bf-230aa09adfea-istio-token\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.920659 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.920575 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-workload-certs\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.921324 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.921300 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95185673-9920-479a-94bf-230aa09adfea-istiod-ca-cert\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.922753 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.922729 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-istio-envoy\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.922922 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.922904 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95185673-9920-479a-94bf-230aa09adfea-istio-podinfo\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.929667 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.929641 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95185673-9920-479a-94bf-230aa09adfea-istio-token\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.929939 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.929922 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2t9j\" (UniqueName: \"kubernetes.io/projected/95185673-9920-479a-94bf-230aa09adfea-kube-api-access-n2t9j\") pod \"e2e-api-b-9984f4-openshift-default-759567b885-4nfj5\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:16.975459 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:16.975247 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:17.044092 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:17.044054 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:17.263403 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:17.263372 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5"] Jul 22 18:54:17.292146 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:17.292095 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:54:17.292263 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:17.292188 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:54:17.292263 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:17.292228 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:54:17.536654 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:17.536613 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" event={"ID":"95185673-9920-479a-94bf-230aa09adfea","Type":"ContainerStarted","Data":"bc4bff762c870e86a29ab8194089299c68c3503c74d209b071a3827587674e5c"} Jul 22 18:54:17.536852 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:17.536682 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" event={"ID":"95185673-9920-479a-94bf-230aa09adfea","Type":"ContainerStarted","Data":"95a44d1d474031c99b036fd0a082ac06d4bf68521402872c72556da944c3e336"} Jul 22 18:54:18.044603 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:18.044571 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:18.049385 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:18.049364 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:18.068290 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:18.068244 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" podStartSLOduration=2.068226032 podStartE2EDuration="2.068226032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:54:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:54:17.557953299 +0000 UTC m=+2413.482848320" watchObservedRunningTime="2026-07-22 18:54:18.068226032 +0000 UTC m=+2413.993121053" Jul 22 18:54:18.547461 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:18.547432 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:18.547652 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:18.547506 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:19.491176 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:19.491142 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:19.588864 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:19.588830 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:19.661484 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:19.661449 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:19.812017 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:19.811934 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:20.195237 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:20.195140 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:20.293659 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:20.293623 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:22.564891 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:22.564855 2554 generic.go:356] "Generic (PLEG): container finished" podID="65f82d02-867c-43e9-8053-79954244b6e3" containerID="8eb72ffed8c5a9c41b7f99a19ba013d34ed52e589c64a6639772997a17390288" exitCode=0 Jul 22 18:54:22.565369 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:22.564921 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" event={"ID":"65f82d02-867c-43e9-8053-79954244b6e3","Type":"ContainerDied","Data":"8eb72ffed8c5a9c41b7f99a19ba013d34ed52e589c64a6639772997a17390288"} Jul 22 18:54:22.565369 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:22.565325 2554 scope.go:117] "RemoveContainer" containerID="8eb72ffed8c5a9c41b7f99a19ba013d34ed52e589c64a6639772997a17390288" Jul 22 18:54:22.566361 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:22.566338 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:54:22.566439 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:22.566407 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:54:22.566485 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:22.566460 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:54:23.575461 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:23.575398 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" event={"ID":"65f82d02-867c-43e9-8053-79954244b6e3","Type":"ContainerStarted","Data":"fd2bfc7e45af7a04e2a3ab934d53154c482fee1f512449e7d47447bfec968656"} Jul 22 18:54:23.694910 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:23.694864 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:23.695992 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:23.695964 2554 patch_prober.go:28] interesting pod/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 22 18:54:23.696111 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:23.696011 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" podUID="65f82d02-867c-43e9-8053-79954244b6e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 22 18:54:23.975247 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:23.975097 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:24.696045 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:24.696013 2554 patch_prober.go:28] interesting pod/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 22 18:54:24.696478 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:24.696066 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" podUID="65f82d02-867c-43e9-8053-79954244b6e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 22 18:54:25.498863 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:25.498764 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:25.695845 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:25.695805 2554 patch_prober.go:28] interesting pod/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 22 18:54:25.696022 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:25.695872 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" podUID="65f82d02-867c-43e9-8053-79954244b6e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 22 18:54:26.696088 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:26.695593 2554 patch_prober.go:28] interesting pod/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body= Jul 22 18:54:26.696088 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:26.695677 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" podUID="65f82d02-867c-43e9-8053-79954244b6e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" Jul 22 18:54:27.699256 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:27.699227 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:27.700440 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:27.700401 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:54:32.734614 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:32.734573 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:32.835458 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:32.835401 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:33.543228 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:33.543197 2554 patch_prober.go:28] interesting pod/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 22 18:54:33.543469 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:33.543247 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" podUID="95185673-9920-479a-94bf-230aa09adfea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 22 18:54:33.632688 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:33.632655 2554 generic.go:356] "Generic (PLEG): container finished" podID="95185673-9920-479a-94bf-230aa09adfea" containerID="bc4bff762c870e86a29ab8194089299c68c3503c74d209b071a3827587674e5c" exitCode=0 Jul 22 18:54:33.632899 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:33.632736 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" event={"ID":"95185673-9920-479a-94bf-230aa09adfea","Type":"ContainerDied","Data":"bc4bff762c870e86a29ab8194089299c68c3503c74d209b071a3827587674e5c"} Jul 22 18:54:33.633242 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:33.633225 2554 scope.go:117] "RemoveContainer" containerID="bc4bff762c870e86a29ab8194089299c68c3503c74d209b071a3827587674e5c" Jul 22 18:54:33.634328 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:33.634299 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:54:33.634439 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:33.634395 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:54:33.634513 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:33.634477 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:54:34.639302 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:34.639267 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" event={"ID":"95185673-9920-479a-94bf-230aa09adfea","Type":"ContainerStarted","Data":"7d8188f045063e8e24033b7e82b8601e7b886db0486cb8c16d655f6e0c3571af"} Jul 22 18:54:35.044555 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:35.044516 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:35.044809 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:35.044786 2554 patch_prober.go:28] interesting pod/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 22 18:54:35.044891 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:35.044838 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" podUID="95185673-9920-479a-94bf-230aa09adfea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 22 18:54:36.044514 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:36.044480 2554 patch_prober.go:28] interesting pod/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 22 18:54:36.044941 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:36.044530 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" podUID="95185673-9920-479a-94bf-230aa09adfea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 22 18:54:37.045274 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:37.045228 2554 patch_prober.go:28] interesting pod/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 22 18:54:37.045729 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:37.045307 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" podUID="95185673-9920-479a-94bf-230aa09adfea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 22 18:54:38.044761 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:38.044727 2554 patch_prober.go:28] interesting pod/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body= Jul 22 18:54:38.044948 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:38.044795 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" podUID="95185673-9920-479a-94bf-230aa09adfea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" Jul 22 18:54:39.049129 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:39.049100 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:39.049675 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:39.049363 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:39.050030 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:39.050016 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:54:40.939960 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:40.939927 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:41.040022 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:41.039989 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:42.612878 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:42.612849 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:42.714223 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:42.714195 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:47.890596 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:47.890565 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:52.155243 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:52.155203 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:52.663483 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:52.663440 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:58.375595 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:58.375560 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:58.474979 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:58.474945 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:58.612169 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:58.612134 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg"] Jul 22 18:54:58.612463 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:58.612399 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" podUID="65f82d02-867c-43e9-8053-79954244b6e3" containerName="istio-proxy" containerID="cri-o://fd2bfc7e45af7a04e2a3ab934d53154c482fee1f512449e7d47447bfec968656" gracePeriod=30 Jul 22 18:54:58.628068 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:58.628002 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:58.860311 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:58.860274 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:59.426273 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:59.426241 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:59.581389 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:59.581357 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:54:59.682455 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:54:59.682349 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:03.788453 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.788386 2554 generic.go:356] "Generic (PLEG): container finished" podID="65f82d02-867c-43e9-8053-79954244b6e3" containerID="fd2bfc7e45af7a04e2a3ab934d53154c482fee1f512449e7d47447bfec968656" exitCode=0 Jul 22 18:55:03.788893 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.788470 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" event={"ID":"65f82d02-867c-43e9-8053-79954244b6e3","Type":"ContainerDied","Data":"fd2bfc7e45af7a04e2a3ab934d53154c482fee1f512449e7d47447bfec968656"} Jul 22 18:55:03.788893 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.788586 2554 scope.go:117] "RemoveContainer" containerID="8eb72ffed8c5a9c41b7f99a19ba013d34ed52e589c64a6639772997a17390288" Jul 22 18:55:03.868472 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.868446 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:55:03.916284 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.916202 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65f82d02-867c-43e9-8053-79954244b6e3-istiod-ca-cert\") pod \"65f82d02-867c-43e9-8053-79954244b6e3\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " Jul 22 18:55:03.916284 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.916235 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-credential-socket\") pod \"65f82d02-867c-43e9-8053-79954244b6e3\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " Jul 22 18:55:03.916284 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.916256 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8s9m6\" (UniqueName: \"kubernetes.io/projected/65f82d02-867c-43e9-8053-79954244b6e3-kube-api-access-8s9m6\") pod \"65f82d02-867c-43e9-8053-79954244b6e3\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " Jul 22 18:55:03.916553 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.916385 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65f82d02-867c-43e9-8053-79954244b6e3-istio-podinfo\") pod \"65f82d02-867c-43e9-8053-79954244b6e3\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " Jul 22 18:55:03.916553 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.916493 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-workload-socket\") pod \"65f82d02-867c-43e9-8053-79954244b6e3\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " Jul 22 18:55:03.916553 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.916522 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-istio-data\") pod \"65f82d02-867c-43e9-8053-79954244b6e3\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " Jul 22 18:55:03.916710 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.916578 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-istio-envoy\") pod \"65f82d02-867c-43e9-8053-79954244b6e3\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " Jul 22 18:55:03.916710 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.916593 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "65f82d02-867c-43e9-8053-79954244b6e3" (UID: "65f82d02-867c-43e9-8053-79954244b6e3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:55:03.916710 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.916603 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-workload-certs\") pod \"65f82d02-867c-43e9-8053-79954244b6e3\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " Jul 22 18:55:03.916710 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.916662 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65f82d02-867c-43e9-8053-79954244b6e3-istio-token\") pod \"65f82d02-867c-43e9-8053-79954244b6e3\" (UID: \"65f82d02-867c-43e9-8053-79954244b6e3\") " Jul 22 18:55:03.916921 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.916751 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "65f82d02-867c-43e9-8053-79954244b6e3" (UID: "65f82d02-867c-43e9-8053-79954244b6e3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:55:03.916993 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.916810 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65f82d02-867c-43e9-8053-79954244b6e3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "65f82d02-867c-43e9-8053-79954244b6e3" (UID: "65f82d02-867c-43e9-8053-79954244b6e3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:55:03.917050 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.916997 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "65f82d02-867c-43e9-8053-79954244b6e3" (UID: "65f82d02-867c-43e9-8053-79954244b6e3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:55:03.917050 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.917020 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-credential-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:55:03.917662 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.917636 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-istio-data" (OuterVolumeSpecName: "istio-data") pod "65f82d02-867c-43e9-8053-79954244b6e3" (UID: "65f82d02-867c-43e9-8053-79954244b6e3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:55:03.918832 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.918810 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65f82d02-867c-43e9-8053-79954244b6e3-kube-api-access-8s9m6" (OuterVolumeSpecName: "kube-api-access-8s9m6") pod "65f82d02-867c-43e9-8053-79954244b6e3" (UID: "65f82d02-867c-43e9-8053-79954244b6e3"). InnerVolumeSpecName "kube-api-access-8s9m6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:55:03.918953 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.918904 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/65f82d02-867c-43e9-8053-79954244b6e3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "65f82d02-867c-43e9-8053-79954244b6e3" (UID: "65f82d02-867c-43e9-8053-79954244b6e3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 18:55:03.919077 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.919060 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65f82d02-867c-43e9-8053-79954244b6e3-istio-token" (OuterVolumeSpecName: "istio-token") pod "65f82d02-867c-43e9-8053-79954244b6e3" (UID: "65f82d02-867c-43e9-8053-79954244b6e3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:55:03.919268 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:03.919246 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "65f82d02-867c-43e9-8053-79954244b6e3" (UID: "65f82d02-867c-43e9-8053-79954244b6e3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:55:04.018508 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:04.018461 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-workload-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:55:04.018508 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:04.018494 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-istio-data\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:55:04.018508 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:04.018504 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-istio-envoy\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:55:04.018508 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:04.018512 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65f82d02-867c-43e9-8053-79954244b6e3-workload-certs\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:55:04.018508 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:04.018519 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65f82d02-867c-43e9-8053-79954244b6e3-istio-token\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:55:04.018809 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:04.018526 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65f82d02-867c-43e9-8053-79954244b6e3-istiod-ca-cert\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:55:04.018809 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:04.018535 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8s9m6\" (UniqueName: \"kubernetes.io/projected/65f82d02-867c-43e9-8053-79954244b6e3-kube-api-access-8s9m6\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:55:04.018809 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:04.018544 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65f82d02-867c-43e9-8053-79954244b6e3-istio-podinfo\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:55:04.795049 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:04.795018 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" Jul 22 18:55:04.795547 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:04.795068 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg" event={"ID":"65f82d02-867c-43e9-8053-79954244b6e3","Type":"ContainerDied","Data":"eec90f9fcbeb90afe4f60b09b6044d044c0dcd12575dcaeb817635a580e1c858"} Jul 22 18:55:04.795547 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:04.795133 2554 scope.go:117] "RemoveContainer" containerID="fd2bfc7e45af7a04e2a3ab934d53154c482fee1f512449e7d47447bfec968656" Jul 22 18:55:04.814660 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:04.814590 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg"] Jul 22 18:55:04.818018 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:04.817986 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-f44f9a-openshift-default-75655bf79f-s8hdg"] Jul 22 18:55:06.547381 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:06.547343 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65f82d02-867c-43e9-8053-79954244b6e3" path="/var/lib/kubelet/pods/65f82d02-867c-43e9-8053-79954244b6e3/volumes" Jul 22 18:55:14.435217 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:14.435187 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:19.097435 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:19.097384 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:19.459955 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:19.459920 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:25.411545 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:25.411512 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:25.511911 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:25.511875 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:25.658306 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:25.658274 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5"] Jul 22 18:55:25.658569 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:25.658547 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" podUID="95185673-9920-479a-94bf-230aa09adfea" containerName="istio-proxy" containerID="cri-o://7d8188f045063e8e24033b7e82b8601e7b886db0486cb8c16d655f6e0c3571af" gracePeriod=30 Jul 22 18:55:25.670945 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:25.670869 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:25.906769 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:25.906736 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:26.255317 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.255281 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:26.536966 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.536877 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq"] Jul 22 18:55:26.537450 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.537258 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65f82d02-867c-43e9-8053-79954244b6e3" containerName="istio-proxy" Jul 22 18:55:26.537450 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.537270 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="65f82d02-867c-43e9-8053-79954244b6e3" containerName="istio-proxy" Jul 22 18:55:26.537450 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.537352 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="65f82d02-867c-43e9-8053-79954244b6e3" containerName="istio-proxy" Jul 22 18:55:26.540351 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.540331 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.542919 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.542896 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-d24283-openshift-default-dockercfg-w2xfp\"" Jul 22 18:55:26.553476 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.553364 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq"] Jul 22 18:55:26.562211 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.562180 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:26.638671 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.638630 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-workload-socket\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.638873 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.638682 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-podinfo\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.638873 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.638719 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-workload-certs\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.638873 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.638815 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-token\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.639025 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.638877 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istiod-ca-cert\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.639025 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.638946 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-credential-socket\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.639025 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.638971 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-envoy\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.639025 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.638994 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-data\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.639025 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.639020 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlsqf\" (UniqueName: \"kubernetes.io/projected/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-kube-api-access-qlsqf\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.739942 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.739903 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istiod-ca-cert\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.740109 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.739978 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-credential-socket\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.740109 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.740006 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-envoy\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.740109 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.740031 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-data\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.740109 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.740054 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlsqf\" (UniqueName: \"kubernetes.io/projected/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-kube-api-access-qlsqf\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.740341 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.740148 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-workload-socket\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.740341 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.740173 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-podinfo\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.740341 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.740272 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-workload-certs\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.740545 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.740347 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-token\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.740545 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.740406 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-credential-socket\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.740545 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.740525 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-data\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.740719 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.740700 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istiod-ca-cert\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.740783 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.740763 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-workload-certs\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.740873 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.740817 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-workload-socket\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.748774 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.748744 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-envoy\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.749076 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.749051 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-podinfo\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.752585 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.752556 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-token\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.753541 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.753506 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlsqf\" (UniqueName: \"kubernetes.io/projected/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-kube-api-access-qlsqf\") pod \"e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:26.852166 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:26.852070 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:27.003940 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:27.003911 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq"] Jul 22 18:55:27.005957 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:55:27.005924 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aaf18be_8db7_429c_a262_4f8ebb5ec1c3.slice/crio-bdaeeafc434c37eab40a62ffaa4d3e886490f19c5d53c7521acd65d07f44d815 WatchSource:0}: Error finding container bdaeeafc434c37eab40a62ffaa4d3e886490f19c5d53c7521acd65d07f44d815: Status 404 returned error can't find the container with id bdaeeafc434c37eab40a62ffaa4d3e886490f19c5d53c7521acd65d07f44d815 Jul 22 18:55:27.008060 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:27.008026 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:55:27.008155 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:27.008105 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:55:27.008155 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:27.008148 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:55:27.418455 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:27.418394 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:27.912595 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:27.912561 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" event={"ID":"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3","Type":"ContainerStarted","Data":"5bed66bd1a19e7b84d327d5d1c6e35214b1d0467e95489931e9b147fad03fc44"} Jul 22 18:55:27.912983 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:27.912613 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" event={"ID":"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3","Type":"ContainerStarted","Data":"bdaeeafc434c37eab40a62ffaa4d3e886490f19c5d53c7521acd65d07f44d815"} Jul 22 18:55:27.932487 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:27.932406 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" podStartSLOduration=1.9323810240000001 podStartE2EDuration="1.932381024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:55:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:55:27.932341119 +0000 UTC m=+2483.857236131" watchObservedRunningTime="2026-07-22 18:55:27.932381024 +0000 UTC m=+2483.857276032" Jul 22 18:55:28.852648 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:28.852614 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:28.857952 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:28.857927 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:28.917646 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:28.917619 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:28.918522 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:28.918503 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:29.849130 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:29.849072 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:29.961279 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:29.961223 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:30.062201 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:30.062140 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:30.198064 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:30.197956 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:30.610142 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:30.610112 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:30.711262 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:30.711221 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:30.911596 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:30.911574 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:55:30.929559 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:30.929525 2554 generic.go:356] "Generic (PLEG): container finished" podID="95185673-9920-479a-94bf-230aa09adfea" containerID="7d8188f045063e8e24033b7e82b8601e7b886db0486cb8c16d655f6e0c3571af" exitCode=0 Jul 22 18:55:30.929722 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:30.929571 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" Jul 22 18:55:30.929722 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:30.929605 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" event={"ID":"95185673-9920-479a-94bf-230aa09adfea","Type":"ContainerDied","Data":"7d8188f045063e8e24033b7e82b8601e7b886db0486cb8c16d655f6e0c3571af"} Jul 22 18:55:30.929722 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:30.929659 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5" event={"ID":"95185673-9920-479a-94bf-230aa09adfea","Type":"ContainerDied","Data":"95a44d1d474031c99b036fd0a082ac06d4bf68521402872c72556da944c3e336"} Jul 22 18:55:30.929722 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:30.929690 2554 scope.go:117] "RemoveContainer" containerID="7d8188f045063e8e24033b7e82b8601e7b886db0486cb8c16d655f6e0c3571af" Jul 22 18:55:30.943344 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:30.943312 2554 scope.go:117] "RemoveContainer" containerID="bc4bff762c870e86a29ab8194089299c68c3503c74d209b071a3827587674e5c" Jul 22 18:55:30.952580 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:30.952560 2554 scope.go:117] "RemoveContainer" containerID="7d8188f045063e8e24033b7e82b8601e7b886db0486cb8c16d655f6e0c3571af" Jul 22 18:55:30.952906 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:55:30.952874 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d8188f045063e8e24033b7e82b8601e7b886db0486cb8c16d655f6e0c3571af\": container with ID starting with 7d8188f045063e8e24033b7e82b8601e7b886db0486cb8c16d655f6e0c3571af not found: ID does not exist" containerID="7d8188f045063e8e24033b7e82b8601e7b886db0486cb8c16d655f6e0c3571af" Jul 22 18:55:30.953002 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:30.952912 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d8188f045063e8e24033b7e82b8601e7b886db0486cb8c16d655f6e0c3571af"} err="failed to get container status \"7d8188f045063e8e24033b7e82b8601e7b886db0486cb8c16d655f6e0c3571af\": rpc error: code = NotFound desc = could not find container \"7d8188f045063e8e24033b7e82b8601e7b886db0486cb8c16d655f6e0c3571af\": container with ID starting with 7d8188f045063e8e24033b7e82b8601e7b886db0486cb8c16d655f6e0c3571af not found: ID does not exist" Jul 22 18:55:30.953002 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:30.952929 2554 scope.go:117] "RemoveContainer" containerID="bc4bff762c870e86a29ab8194089299c68c3503c74d209b071a3827587674e5c" Jul 22 18:55:30.953203 ip-10-0-132-65 kubenswrapper[2554]: E0722 18:55:30.953183 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc4bff762c870e86a29ab8194089299c68c3503c74d209b071a3827587674e5c\": container with ID starting with bc4bff762c870e86a29ab8194089299c68c3503c74d209b071a3827587674e5c not found: ID does not exist" containerID="bc4bff762c870e86a29ab8194089299c68c3503c74d209b071a3827587674e5c" Jul 22 18:55:30.953275 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:30.953211 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc4bff762c870e86a29ab8194089299c68c3503c74d209b071a3827587674e5c"} err="failed to get container status \"bc4bff762c870e86a29ab8194089299c68c3503c74d209b071a3827587674e5c\": rpc error: code = NotFound desc = could not find container \"bc4bff762c870e86a29ab8194089299c68c3503c74d209b071a3827587674e5c\": container with ID starting with bc4bff762c870e86a29ab8194089299c68c3503c74d209b071a3827587674e5c not found: ID does not exist" Jul 22 18:55:31.087146 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.087112 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-istio-envoy\") pod \"95185673-9920-479a-94bf-230aa09adfea\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " Jul 22 18:55:31.087850 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.087189 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-credential-socket\") pod \"95185673-9920-479a-94bf-230aa09adfea\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " Jul 22 18:55:31.087850 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.087215 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-workload-socket\") pod \"95185673-9920-479a-94bf-230aa09adfea\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " Jul 22 18:55:31.087850 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.087245 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-workload-certs\") pod \"95185673-9920-479a-94bf-230aa09adfea\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " Jul 22 18:55:31.087850 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.087281 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95185673-9920-479a-94bf-230aa09adfea-istiod-ca-cert\") pod \"95185673-9920-479a-94bf-230aa09adfea\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " Jul 22 18:55:31.087850 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.087305 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2t9j\" (UniqueName: \"kubernetes.io/projected/95185673-9920-479a-94bf-230aa09adfea-kube-api-access-n2t9j\") pod \"95185673-9920-479a-94bf-230aa09adfea\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " Jul 22 18:55:31.087850 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.087387 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95185673-9920-479a-94bf-230aa09adfea-istio-token\") pod \"95185673-9920-479a-94bf-230aa09adfea\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " Jul 22 18:55:31.087850 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.087445 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95185673-9920-479a-94bf-230aa09adfea-istio-podinfo\") pod \"95185673-9920-479a-94bf-230aa09adfea\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " Jul 22 18:55:31.087850 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.087474 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-istio-data\") pod \"95185673-9920-479a-94bf-230aa09adfea\" (UID: \"95185673-9920-479a-94bf-230aa09adfea\") " Jul 22 18:55:31.089026 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.088495 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "95185673-9920-479a-94bf-230aa09adfea" (UID: "95185673-9920-479a-94bf-230aa09adfea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:55:31.089026 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.088671 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "95185673-9920-479a-94bf-230aa09adfea" (UID: "95185673-9920-479a-94bf-230aa09adfea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:55:31.089026 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.088782 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "95185673-9920-479a-94bf-230aa09adfea" (UID: "95185673-9920-479a-94bf-230aa09adfea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:55:31.089026 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.088811 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-istio-data" (OuterVolumeSpecName: "istio-data") pod "95185673-9920-479a-94bf-230aa09adfea" (UID: "95185673-9920-479a-94bf-230aa09adfea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:55:31.089631 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.089519 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95185673-9920-479a-94bf-230aa09adfea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "95185673-9920-479a-94bf-230aa09adfea" (UID: "95185673-9920-479a-94bf-230aa09adfea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 18:55:31.092077 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.092042 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95185673-9920-479a-94bf-230aa09adfea-kube-api-access-n2t9j" (OuterVolumeSpecName: "kube-api-access-n2t9j") pod "95185673-9920-479a-94bf-230aa09adfea" (UID: "95185673-9920-479a-94bf-230aa09adfea"). InnerVolumeSpecName "kube-api-access-n2t9j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:55:31.092273 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.092245 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/95185673-9920-479a-94bf-230aa09adfea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "95185673-9920-479a-94bf-230aa09adfea" (UID: "95185673-9920-479a-94bf-230aa09adfea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 18:55:31.093128 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.092556 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95185673-9920-479a-94bf-230aa09adfea-istio-token" (OuterVolumeSpecName: "istio-token") pod "95185673-9920-479a-94bf-230aa09adfea" (UID: "95185673-9920-479a-94bf-230aa09adfea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 18:55:31.093128 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.093097 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "95185673-9920-479a-94bf-230aa09adfea" (UID: "95185673-9920-479a-94bf-230aa09adfea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 18:55:31.188476 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.188376 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95185673-9920-479a-94bf-230aa09adfea-istio-podinfo\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:55:31.188476 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.188400 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-istio-data\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:55:31.188476 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.188408 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-istio-envoy\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:55:31.188476 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.188438 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-credential-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:55:31.188476 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.188446 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-workload-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:55:31.188476 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.188454 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95185673-9920-479a-94bf-230aa09adfea-workload-certs\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:55:31.188476 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.188463 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95185673-9920-479a-94bf-230aa09adfea-istiod-ca-cert\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:55:31.188476 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.188470 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2t9j\" (UniqueName: \"kubernetes.io/projected/95185673-9920-479a-94bf-230aa09adfea-kube-api-access-n2t9j\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:55:31.188476 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.188479 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95185673-9920-479a-94bf-230aa09adfea-istio-token\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 18:55:31.251588 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.251556 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5"] Jul 22 18:55:31.255193 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:31.255168 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-9984f4-openshift-default-759567b885-4nfj5"] Jul 22 18:55:32.547961 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:32.547924 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95185673-9920-479a-94bf-230aa09adfea" path="/var/lib/kubelet/pods/95185673-9920-479a-94bf-230aa09adfea/volumes" Jul 22 18:55:34.374464 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:34.374428 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:34.928553 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:34.928519 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:35.002059 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.002028 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k"] Jul 22 18:55:35.002411 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.002398 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95185673-9920-479a-94bf-230aa09adfea" containerName="istio-proxy" Jul 22 18:55:35.002500 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.002441 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="95185673-9920-479a-94bf-230aa09adfea" containerName="istio-proxy" Jul 22 18:55:35.002500 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.002468 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65f82d02-867c-43e9-8053-79954244b6e3" containerName="istio-proxy" Jul 22 18:55:35.002500 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.002474 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="65f82d02-867c-43e9-8053-79954244b6e3" containerName="istio-proxy" Jul 22 18:55:35.002648 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.002540 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="65f82d02-867c-43e9-8053-79954244b6e3" containerName="istio-proxy" Jul 22 18:55:35.002648 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.002548 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="95185673-9920-479a-94bf-230aa09adfea" containerName="istio-proxy" Jul 22 18:55:35.002648 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.002555 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="95185673-9920-479a-94bf-230aa09adfea" containerName="istio-proxy" Jul 22 18:55:35.007784 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.007763 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.010496 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.010479 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-63c82d-openshift-default-dockercfg-qwb4m\"" Jul 22 18:55:35.019211 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.019187 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k"] Jul 22 18:55:35.020597 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.020575 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46ccm\" (UniqueName: \"kubernetes.io/projected/15dc2664-c987-4baa-9aca-c661c5161a52-kube-api-access-46ccm\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.020718 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.020606 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-workload-certs\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.020718 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.020652 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15dc2664-c987-4baa-9aca-c661c5161a52-istiod-ca-cert\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.020836 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.020745 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15dc2664-c987-4baa-9aca-c661c5161a52-istio-token\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.020836 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.020795 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-istio-data\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.020927 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.020836 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-workload-socket\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.020927 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.020909 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-istio-envoy\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.020992 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.020958 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-credential-socket\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.021029 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.020990 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15dc2664-c987-4baa-9aca-c661c5161a52-istio-podinfo\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.031559 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.031528 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:35.121661 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.121621 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-workload-certs\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.121863 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.121688 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15dc2664-c987-4baa-9aca-c661c5161a52-istiod-ca-cert\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.121863 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.121721 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15dc2664-c987-4baa-9aca-c661c5161a52-istio-token\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.121863 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.121761 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-istio-data\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.121863 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.121791 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-workload-socket\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.121863 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.121862 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-istio-envoy\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.122154 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.121912 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-credential-socket\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.122154 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.121944 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15dc2664-c987-4baa-9aca-c661c5161a52-istio-podinfo\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.123826 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.122443 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-workload-certs\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.123826 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.122571 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-credential-socket\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.123826 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.122634 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-istio-data\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.123826 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.122637 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-workload-socket\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.123826 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.123010 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15dc2664-c987-4baa-9aca-c661c5161a52-istiod-ca-cert\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.125976 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.125103 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46ccm\" (UniqueName: \"kubernetes.io/projected/15dc2664-c987-4baa-9aca-c661c5161a52-kube-api-access-46ccm\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.127460 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.127099 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-istio-envoy\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.128177 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.128125 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15dc2664-c987-4baa-9aca-c661c5161a52-istio-podinfo\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.131108 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.130999 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15dc2664-c987-4baa-9aca-c661c5161a52-istio-token\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.134473 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.134451 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46ccm\" (UniqueName: \"kubernetes.io/projected/15dc2664-c987-4baa-9aca-c661c5161a52-kube-api-access-46ccm\") pod \"e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.145935 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.145912 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:35.322587 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.322560 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:35.463806 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.463781 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k"] Jul 22 18:55:35.466580 ip-10-0-132-65 kubenswrapper[2554]: W0722 18:55:35.466552 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15dc2664_c987_4baa_9aca_c661c5161a52.slice/crio-b742e22ee9defec660729e69f4fba36c3d23298d73d6ef248b1dc052dfed3cf3 WatchSource:0}: Error finding container b742e22ee9defec660729e69f4fba36c3d23298d73d6ef248b1dc052dfed3cf3: Status 404 returned error can't find the container with id b742e22ee9defec660729e69f4fba36c3d23298d73d6ef248b1dc052dfed3cf3 Jul 22 18:55:35.468777 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.468743 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:55:35.468861 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.468832 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:55:35.468908 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.468866 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:55:35.959389 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.959359 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" event={"ID":"15dc2664-c987-4baa-9aca-c661c5161a52","Type":"ContainerStarted","Data":"943c9a24ad143d58e6cd3589feec8323a9e2b19e5ae4afb03b5d47aaa8555900"} Jul 22 18:55:35.959597 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.959408 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" event={"ID":"15dc2664-c987-4baa-9aca-c661c5161a52","Type":"ContainerStarted","Data":"b742e22ee9defec660729e69f4fba36c3d23298d73d6ef248b1dc052dfed3cf3"} Jul 22 18:55:35.982438 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:35.982374 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" podStartSLOduration=1.9823559290000001 podStartE2EDuration="1.982355929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-22 18:55:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 18:55:35.979456086 +0000 UTC m=+2491.904351104" watchObservedRunningTime="2026-07-22 18:55:35.982355929 +0000 UTC m=+2491.907250947" Jul 22 18:55:36.323103 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:36.323073 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:36.328804 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:36.328783 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:36.964972 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:36.964931 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:36.965950 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:36.965929 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:37.885248 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:37.885205 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:38.231219 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:38.231129 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:38.341051 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:38.341010 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:38.569701 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:38.569620 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:38.667873 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:38.667827 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:38.769237 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:38.769179 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:42.411704 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:42.411665 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:44.810238 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:44.808531 2554 patch_prober.go:28] interesting pod/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": read tcp 10.133.0.2:59264->10.133.0.47:15021: read: connection reset by peer" start-of-body= Jul 22 18:55:44.810238 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:44.808601 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" podUID="6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": read tcp 10.133.0.2:59264->10.133.0.47:15021: read: connection reset by peer" Jul 22 18:55:45.016249 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:45.016218 2554 generic.go:356] "Generic (PLEG): container finished" podID="6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" containerID="5bed66bd1a19e7b84d327d5d1c6e35214b1d0467e95489931e9b147fad03fc44" exitCode=0 Jul 22 18:55:45.016249 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:45.016253 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" event={"ID":"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3","Type":"ContainerDied","Data":"5bed66bd1a19e7b84d327d5d1c6e35214b1d0467e95489931e9b147fad03fc44"} Jul 22 18:55:45.016690 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:45.016675 2554 scope.go:117] "RemoveContainer" containerID="5bed66bd1a19e7b84d327d5d1c6e35214b1d0467e95489931e9b147fad03fc44" Jul 22 18:55:45.017790 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:45.017762 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:55:45.017846 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:45.017830 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:55:45.017886 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:45.017861 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:55:46.022936 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:46.022902 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" event={"ID":"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3","Type":"ContainerStarted","Data":"698be15bf2ff0cce81c0aa44e13cb0642e283f553b4531c0591792f22b04f730"} Jul 22 18:55:46.852647 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:46.852620 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:46.852874 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:46.852770 2554 patch_prober.go:28] interesting pod/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 22 18:55:46.852958 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:46.852906 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" podUID="6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 22 18:55:47.852757 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:47.852716 2554 patch_prober.go:28] interesting pod/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 22 18:55:47.853158 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:47.852773 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" podUID="6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 22 18:55:48.852689 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:48.852653 2554 patch_prober.go:28] interesting pod/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 22 18:55:48.852872 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:48.852708 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" podUID="6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 22 18:55:49.853269 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:49.853231 2554 patch_prober.go:28] interesting pod/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body= Jul 22 18:55:49.853707 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:49.853297 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" podUID="6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" Jul 22 18:55:50.856402 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:50.856371 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:50.856950 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:50.856754 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:50.857525 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:50.857504 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 18:55:51.509478 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:51.509438 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:51.618244 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:51.618213 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:51.754725 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:51.754693 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:51.966881 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:51.966852 2554 patch_prober.go:28] interesting pod/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 22 18:55:51.967283 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:51.966923 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" podUID="15dc2664-c987-4baa-9aca-c661c5161a52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 22 18:55:52.053917 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:52.053882 2554 generic.go:356] "Generic (PLEG): container finished" podID="15dc2664-c987-4baa-9aca-c661c5161a52" containerID="943c9a24ad143d58e6cd3589feec8323a9e2b19e5ae4afb03b5d47aaa8555900" exitCode=0 Jul 22 18:55:52.054120 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:52.053966 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" event={"ID":"15dc2664-c987-4baa-9aca-c661c5161a52","Type":"ContainerDied","Data":"943c9a24ad143d58e6cd3589feec8323a9e2b19e5ae4afb03b5d47aaa8555900"} Jul 22 18:55:52.054587 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:52.054568 2554 scope.go:117] "RemoveContainer" containerID="943c9a24ad143d58e6cd3589feec8323a9e2b19e5ae4afb03b5d47aaa8555900" Jul 22 18:55:52.055596 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:52.055567 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:55:52.055681 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:52.055643 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:55:52.055741 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:52.055686 2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892172Ki","pods":"250"} Jul 22 18:55:53.061130 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:53.061096 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" event={"ID":"15dc2664-c987-4baa-9aca-c661c5161a52","Type":"ContainerStarted","Data":"6918ae33a57cfe62454907f22f96dc7b7051d318d7bf84ec266a3c0a393cf8d4"} Jul 22 18:55:53.323240 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:53.323155 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:53.323391 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:53.323359 2554 patch_prober.go:28] interesting pod/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 22 18:55:53.323457 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:53.323397 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" podUID="15dc2664-c987-4baa-9aca-c661c5161a52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 22 18:55:54.323087 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:54.323043 2554 patch_prober.go:28] interesting pod/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 22 18:55:54.323537 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:54.323110 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" podUID="15dc2664-c987-4baa-9aca-c661c5161a52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 22 18:55:55.073150 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:55.073025 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:55.176326 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:55.176291 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:55.322972 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:55.322940 2554 patch_prober.go:28] interesting pod/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 22 18:55:55.323148 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:55.322993 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" podUID="15dc2664-c987-4baa-9aca-c661c5161a52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 22 18:55:56.323466 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:56.323395 2554 patch_prober.go:28] interesting pod/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" start-of-body= Jul 22 18:55:56.323989 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:56.323490 2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" podUID="15dc2664-c987-4baa-9aca-c661c5161a52" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.48:15021/healthz/ready\": dial tcp 10.133.0.48:15021: connect: connection refused" Jul 22 18:55:57.327544 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:57.327515 2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:57.328011 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:57.327782 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:57.328469 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:57.328452 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 18:55:59.585392 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:59.585360 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:55:59.685301 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:55:59.685271 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:02.697570 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:56:02.697534 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:56:47.419345 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:56:47.419313 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:57:02.127840 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:57:02.127803 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:58:39.242824 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:58:39.242771 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:58:48.497235 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:58:48.497201 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:58:49.427767 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:58:49.427727 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:58:53.353973 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:58:53.353937 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:59:04.328148 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:59:04.328110 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:59:05.481781 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:59:05.481756 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:59:05.487019 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:59:05.486994 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qmw4c_ab829dfc-b3d2-4f76-be11-cf9f0beabcf1/ovn-acl-logging/0.log" Jul 22 18:59:18.890157 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:59:18.890120 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:59:52.921090 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:59:52.921059 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:59:53.795234 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:59:53.795206 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 18:59:58.020766 ip-10-0-132-65 kubenswrapper[2554]: I0722 18:59:58.020733 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:11.753570 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:00:11.753539 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:17.826314 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:00:17.826282 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:17.878277 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:00:17.878247 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:52.349626 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:00:52.349593 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:52.639234 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:00:52.639142 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:56.190738 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:00:56.190700 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:00:56.246000 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:00:56.245966 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:00.509854 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:00.509815 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:00.608823 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:00.608790 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:04.911921 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:04.911882 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:05.745061 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:05.745020 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:26.598476 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:26.598444 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:26.699562 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:26.699530 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:36.082679 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:36.082639 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:40.712263 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:40.712227 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:41.147762 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:41.147724 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:48.055443 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:48.055353 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:48.138394 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:48.138359 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:48.367383 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:48.367289 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq"] Jul 22 19:01:48.367577 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:48.367546 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" podUID="6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" containerName="istio-proxy" containerID="cri-o://698be15bf2ff0cce81c0aa44e13cb0642e283f553b4531c0591792f22b04f730" gracePeriod=30 Jul 22 19:01:48.378240 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:48.378203 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:48.595938 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:48.595913 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:49.381562 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:49.381529 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:49.480546 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:49.480516 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:49.881709 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:49.881669 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:50.101683 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:50.101651 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:01:50.859500 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:50.859458 2554 patch_prober.go:28] interesting pod/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 22 19:01:50.859927 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:50.859529 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" podUID="6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 19:01:53.622391 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.622370 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 19:01:53.658621 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.658539 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-workload-socket\") pod \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " Jul 22 19:01:53.658792 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.658656 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-envoy\") pod \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " Jul 22 19:01:53.658792 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.658714 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-token\") pod \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " Jul 22 19:01:53.658792 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.658744 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" (UID: "6aaf18be-8db7-429c-a262-4f8ebb5ec1c3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 19:01:53.658792 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.658762 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-credential-socket\") pod \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " Jul 22 19:01:53.658984 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.658851 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istiod-ca-cert\") pod \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " Jul 22 19:01:53.658984 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.658882 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-podinfo\") pod \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " Jul 22 19:01:53.658984 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.658937 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlsqf\" (UniqueName: \"kubernetes.io/projected/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-kube-api-access-qlsqf\") pod \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " Jul 22 19:01:53.658984 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.658965 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-workload-certs\") pod \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " Jul 22 19:01:53.658984 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.658972 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" (UID: "6aaf18be-8db7-429c-a262-4f8ebb5ec1c3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 19:01:53.659246 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.659025 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-data\") pod \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\" (UID: \"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3\") " Jul 22 19:01:53.659246 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.659219 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" (UID: "6aaf18be-8db7-429c-a262-4f8ebb5ec1c3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 19:01:53.659364 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.659320 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-credential-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 19:01:53.659364 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.659322 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" (UID: "6aaf18be-8db7-429c-a262-4f8ebb5ec1c3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 19:01:53.659364 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.659340 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istiod-ca-cert\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 19:01:53.659364 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.659354 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-workload-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 19:01:53.660228 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.660198 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-data" (OuterVolumeSpecName: "istio-data") pod "6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" (UID: "6aaf18be-8db7-429c-a262-4f8ebb5ec1c3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 19:01:53.661201 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.661177 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-token" (OuterVolumeSpecName: "istio-token") pod "6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" (UID: "6aaf18be-8db7-429c-a262-4f8ebb5ec1c3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 19:01:53.661509 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.661452 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" (UID: "6aaf18be-8db7-429c-a262-4f8ebb5ec1c3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 19:01:53.661593 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.661574 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" (UID: "6aaf18be-8db7-429c-a262-4f8ebb5ec1c3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 19:01:53.661634 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.661587 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-kube-api-access-qlsqf" (OuterVolumeSpecName: "kube-api-access-qlsqf") pod "6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" (UID: "6aaf18be-8db7-429c-a262-4f8ebb5ec1c3"). InnerVolumeSpecName "kube-api-access-qlsqf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 19:01:53.760077 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.760045 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-envoy\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 19:01:53.760077 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.760072 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-token\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 19:01:53.760077 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.760080 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-podinfo\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 19:01:53.760311 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.760091 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlsqf\" (UniqueName: \"kubernetes.io/projected/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-kube-api-access-qlsqf\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 19:01:53.760311 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.760100 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-workload-certs\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 19:01:53.760311 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.760107 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3-istio-data\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 19:01:53.834917 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.834870 2554 generic.go:356] "Generic (PLEG): container finished" podID="6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" containerID="698be15bf2ff0cce81c0aa44e13cb0642e283f553b4531c0591792f22b04f730" exitCode=0 Jul 22 19:01:53.835085 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.834929 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" Jul 22 19:01:53.835085 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.834936 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" event={"ID":"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3","Type":"ContainerDied","Data":"698be15bf2ff0cce81c0aa44e13cb0642e283f553b4531c0591792f22b04f730"} Jul 22 19:01:53.835085 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.834993 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq" event={"ID":"6aaf18be-8db7-429c-a262-4f8ebb5ec1c3","Type":"ContainerDied","Data":"bdaeeafc434c37eab40a62ffaa4d3e886490f19c5d53c7521acd65d07f44d815"} Jul 22 19:01:53.835085 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.835014 2554 scope.go:117] "RemoveContainer" containerID="698be15bf2ff0cce81c0aa44e13cb0642e283f553b4531c0591792f22b04f730" Jul 22 19:01:53.847748 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.847731 2554 scope.go:117] "RemoveContainer" containerID="5bed66bd1a19e7b84d327d5d1c6e35214b1d0467e95489931e9b147fad03fc44" Jul 22 19:01:53.855608 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.855582 2554 scope.go:117] "RemoveContainer" containerID="698be15bf2ff0cce81c0aa44e13cb0642e283f553b4531c0591792f22b04f730" Jul 22 19:01:53.855964 ip-10-0-132-65 kubenswrapper[2554]: E0722 19:01:53.855936 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"698be15bf2ff0cce81c0aa44e13cb0642e283f553b4531c0591792f22b04f730\": container with ID starting with 698be15bf2ff0cce81c0aa44e13cb0642e283f553b4531c0591792f22b04f730 not found: ID does not exist" containerID="698be15bf2ff0cce81c0aa44e13cb0642e283f553b4531c0591792f22b04f730" Jul 22 19:01:53.856178 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.855975 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"698be15bf2ff0cce81c0aa44e13cb0642e283f553b4531c0591792f22b04f730"} err="failed to get container status \"698be15bf2ff0cce81c0aa44e13cb0642e283f553b4531c0591792f22b04f730\": rpc error: code = NotFound desc = could not find container \"698be15bf2ff0cce81c0aa44e13cb0642e283f553b4531c0591792f22b04f730\": container with ID starting with 698be15bf2ff0cce81c0aa44e13cb0642e283f553b4531c0591792f22b04f730 not found: ID does not exist" Jul 22 19:01:53.856178 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.856001 2554 scope.go:117] "RemoveContainer" containerID="5bed66bd1a19e7b84d327d5d1c6e35214b1d0467e95489931e9b147fad03fc44" Jul 22 19:01:53.856520 ip-10-0-132-65 kubenswrapper[2554]: E0722 19:01:53.856449 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bed66bd1a19e7b84d327d5d1c6e35214b1d0467e95489931e9b147fad03fc44\": container with ID starting with 5bed66bd1a19e7b84d327d5d1c6e35214b1d0467e95489931e9b147fad03fc44 not found: ID does not exist" containerID="5bed66bd1a19e7b84d327d5d1c6e35214b1d0467e95489931e9b147fad03fc44" Jul 22 19:01:53.856520 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.856495 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bed66bd1a19e7b84d327d5d1c6e35214b1d0467e95489931e9b147fad03fc44"} err="failed to get container status \"5bed66bd1a19e7b84d327d5d1c6e35214b1d0467e95489931e9b147fad03fc44\": rpc error: code = NotFound desc = could not find container \"5bed66bd1a19e7b84d327d5d1c6e35214b1d0467e95489931e9b147fad03fc44\": container with ID starting with 5bed66bd1a19e7b84d327d5d1c6e35214b1d0467e95489931e9b147fad03fc44 not found: ID does not exist" Jul 22 19:01:53.858926 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.858905 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq"] Jul 22 19:01:53.865228 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:53.865208 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-d24283-openshift-default-6b5bb47d59-fhhrq"] Jul 22 19:01:54.546999 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:54.546965 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" path="/var/lib/kubelet/pods/6aaf18be-8db7-429c-a262-4f8ebb5ec1c3/volumes" Jul 22 19:01:59.187808 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:01:59.187769 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:03.827578 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:03.827537 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:04.222744 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:04.222656 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:10.711263 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:10.711227 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:10.890965 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:10.890932 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:11.086330 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:11.086291 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k"] Jul 22 19:02:11.086538 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:11.086508 2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" podUID="15dc2664-c987-4baa-9aca-c661c5161a52" containerName="istio-proxy" containerID="cri-o://6918ae33a57cfe62454907f22f96dc7b7051d318d7bf84ec266a3c0a393cf8d4" gracePeriod=30 Jul 22 19:02:11.125331 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:11.125297 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:11.313206 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:11.313177 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:12.330585 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:12.330554 2554 patch_prober.go:28] interesting pod/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 22 19:02:12.330980 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:12.330626 2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" podUID="15dc2664-c987-4baa-9aca-c661c5161a52" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 22 19:02:16.348872 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.348800 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 19:02:16.475715 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.475673 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-istio-data\") pod \"15dc2664-c987-4baa-9aca-c661c5161a52\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " Jul 22 19:02:16.475715 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.475715 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-workload-socket\") pod \"15dc2664-c987-4baa-9aca-c661c5161a52\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " Jul 22 19:02:16.475936 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.475735 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46ccm\" (UniqueName: \"kubernetes.io/projected/15dc2664-c987-4baa-9aca-c661c5161a52-kube-api-access-46ccm\") pod \"15dc2664-c987-4baa-9aca-c661c5161a52\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " Jul 22 19:02:16.475936 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.475772 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15dc2664-c987-4baa-9aca-c661c5161a52-istiod-ca-cert\") pod \"15dc2664-c987-4baa-9aca-c661c5161a52\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " Jul 22 19:02:16.475936 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.475900 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-credential-socket\") pod \"15dc2664-c987-4baa-9aca-c661c5161a52\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " Jul 22 19:02:16.476502 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.475954 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15dc2664-c987-4baa-9aca-c661c5161a52-istio-podinfo\") pod \"15dc2664-c987-4baa-9aca-c661c5161a52\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " Jul 22 19:02:16.476502 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.475986 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-workload-certs\") pod \"15dc2664-c987-4baa-9aca-c661c5161a52\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " Jul 22 19:02:16.476502 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.476009 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15dc2664-c987-4baa-9aca-c661c5161a52-istio-token\") pod \"15dc2664-c987-4baa-9aca-c661c5161a52\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " Jul 22 19:02:16.476502 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.476028 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "15dc2664-c987-4baa-9aca-c661c5161a52" (UID: "15dc2664-c987-4baa-9aca-c661c5161a52"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 19:02:16.476502 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.476040 2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-istio-envoy\") pod \"15dc2664-c987-4baa-9aca-c661c5161a52\" (UID: \"15dc2664-c987-4baa-9aca-c661c5161a52\") " Jul 22 19:02:16.476502 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.476220 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "15dc2664-c987-4baa-9aca-c661c5161a52" (UID: "15dc2664-c987-4baa-9aca-c661c5161a52"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 19:02:16.476502 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.476226 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15dc2664-c987-4baa-9aca-c661c5161a52-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "15dc2664-c987-4baa-9aca-c661c5161a52" (UID: "15dc2664-c987-4baa-9aca-c661c5161a52"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 22 19:02:16.476502 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.476366 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "15dc2664-c987-4baa-9aca-c661c5161a52" (UID: "15dc2664-c987-4baa-9aca-c661c5161a52"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 19:02:16.477102 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.476564 2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15dc2664-c987-4baa-9aca-c661c5161a52-istiod-ca-cert\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 19:02:16.477102 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.476604 2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-credential-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 19:02:16.477102 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.476621 2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-workload-certs\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 19:02:16.477102 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.476635 2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-workload-socket\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 19:02:16.477102 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.476563 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-istio-data" (OuterVolumeSpecName: "istio-data") pod "15dc2664-c987-4baa-9aca-c661c5161a52" (UID: "15dc2664-c987-4baa-9aca-c661c5161a52"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 19:02:16.478201 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.478170 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15dc2664-c987-4baa-9aca-c661c5161a52-kube-api-access-46ccm" (OuterVolumeSpecName: "kube-api-access-46ccm") pod "15dc2664-c987-4baa-9aca-c661c5161a52" (UID: "15dc2664-c987-4baa-9aca-c661c5161a52"). InnerVolumeSpecName "kube-api-access-46ccm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 19:02:16.478297 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.478257 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "15dc2664-c987-4baa-9aca-c661c5161a52" (UID: "15dc2664-c987-4baa-9aca-c661c5161a52"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 22 19:02:16.478469 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.478445 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15dc2664-c987-4baa-9aca-c661c5161a52-istio-token" (OuterVolumeSpecName: "istio-token") pod "15dc2664-c987-4baa-9aca-c661c5161a52" (UID: "15dc2664-c987-4baa-9aca-c661c5161a52"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 22 19:02:16.478616 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.478484 2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/15dc2664-c987-4baa-9aca-c661c5161a52-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "15dc2664-c987-4baa-9aca-c661c5161a52" (UID: "15dc2664-c987-4baa-9aca-c661c5161a52"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 22 19:02:16.577438 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.577373 2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15dc2664-c987-4baa-9aca-c661c5161a52-istio-token\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 19:02:16.577438 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.577407 2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-istio-envoy\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 19:02:16.577649 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.577453 2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15dc2664-c987-4baa-9aca-c661c5161a52-istio-data\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 19:02:16.577649 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.577466 2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46ccm\" (UniqueName: \"kubernetes.io/projected/15dc2664-c987-4baa-9aca-c661c5161a52-kube-api-access-46ccm\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 19:02:16.577649 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.577480 2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15dc2664-c987-4baa-9aca-c661c5161a52-istio-podinfo\") on node \"ip-10-0-132-65.ec2.internal\" DevicePath \"\"" Jul 22 19:02:16.943749 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.943718 2554 generic.go:356] "Generic (PLEG): container finished" podID="15dc2664-c987-4baa-9aca-c661c5161a52" containerID="6918ae33a57cfe62454907f22f96dc7b7051d318d7bf84ec266a3c0a393cf8d4" exitCode=0 Jul 22 19:02:16.943929 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.943767 2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" Jul 22 19:02:16.943929 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.943773 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" event={"ID":"15dc2664-c987-4baa-9aca-c661c5161a52","Type":"ContainerDied","Data":"6918ae33a57cfe62454907f22f96dc7b7051d318d7bf84ec266a3c0a393cf8d4"} Jul 22 19:02:16.943929 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.943885 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k" event={"ID":"15dc2664-c987-4baa-9aca-c661c5161a52","Type":"ContainerDied","Data":"b742e22ee9defec660729e69f4fba36c3d23298d73d6ef248b1dc052dfed3cf3"} Jul 22 19:02:16.943929 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.943906 2554 scope.go:117] "RemoveContainer" containerID="6918ae33a57cfe62454907f22f96dc7b7051d318d7bf84ec266a3c0a393cf8d4" Jul 22 19:02:16.953058 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.953035 2554 scope.go:117] "RemoveContainer" containerID="943c9a24ad143d58e6cd3589feec8323a9e2b19e5ae4afb03b5d47aaa8555900" Jul 22 19:02:16.962121 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.962100 2554 scope.go:117] "RemoveContainer" containerID="6918ae33a57cfe62454907f22f96dc7b7051d318d7bf84ec266a3c0a393cf8d4" Jul 22 19:02:16.965147 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.964162 2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k"] Jul 22 19:02:16.965300 ip-10-0-132-65 kubenswrapper[2554]: E0722 19:02:16.965227 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6918ae33a57cfe62454907f22f96dc7b7051d318d7bf84ec266a3c0a393cf8d4\": container with ID starting with 6918ae33a57cfe62454907f22f96dc7b7051d318d7bf84ec266a3c0a393cf8d4 not found: ID does not exist" containerID="6918ae33a57cfe62454907f22f96dc7b7051d318d7bf84ec266a3c0a393cf8d4" Jul 22 19:02:16.965380 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.965293 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6918ae33a57cfe62454907f22f96dc7b7051d318d7bf84ec266a3c0a393cf8d4"} err="failed to get container status \"6918ae33a57cfe62454907f22f96dc7b7051d318d7bf84ec266a3c0a393cf8d4\": rpc error: code = NotFound desc = could not find container \"6918ae33a57cfe62454907f22f96dc7b7051d318d7bf84ec266a3c0a393cf8d4\": container with ID starting with 6918ae33a57cfe62454907f22f96dc7b7051d318d7bf84ec266a3c0a393cf8d4 not found: ID does not exist" Jul 22 19:02:16.965380 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.965322 2554 scope.go:117] "RemoveContainer" containerID="943c9a24ad143d58e6cd3589feec8323a9e2b19e5ae4afb03b5d47aaa8555900" Jul 22 19:02:16.965783 ip-10-0-132-65 kubenswrapper[2554]: E0722 19:02:16.965752 2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"943c9a24ad143d58e6cd3589feec8323a9e2b19e5ae4afb03b5d47aaa8555900\": container with ID starting with 943c9a24ad143d58e6cd3589feec8323a9e2b19e5ae4afb03b5d47aaa8555900 not found: ID does not exist" containerID="943c9a24ad143d58e6cd3589feec8323a9e2b19e5ae4afb03b5d47aaa8555900" Jul 22 19:02:16.965897 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.965785 2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"943c9a24ad143d58e6cd3589feec8323a9e2b19e5ae4afb03b5d47aaa8555900"} err="failed to get container status \"943c9a24ad143d58e6cd3589feec8323a9e2b19e5ae4afb03b5d47aaa8555900\": rpc error: code = NotFound desc = could not find container \"943c9a24ad143d58e6cd3589feec8323a9e2b19e5ae4afb03b5d47aaa8555900\": container with ID starting with 943c9a24ad143d58e6cd3589feec8323a9e2b19e5ae4afb03b5d47aaa8555900 not found: ID does not exist" Jul 22 19:02:16.967799 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:16.967776 2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-63c82d-openshift-default-b7b8c7f47-b464k"] Jul 22 19:02:17.842787 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:17.842758 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-ddf6698b6-vhvv9_a268b6e6-64a1-47fe-913f-c566857cba04/manager/0.log" Jul 22 19:02:18.339716 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:18.339690 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-549865fcdf-f2l5q_41688e46-a79d-4770-a7ed-438f0893c8d7/copy-manifests/0.log" Jul 22 19:02:18.347433 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:18.347393 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-549865fcdf-f2l5q_41688e46-a79d-4770-a7ed-438f0893c8d7/manager/0.log" Jul 22 19:02:18.546479 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:18.546447 2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15dc2664-c987-4baa-9aca-c661c5161a52" path="/var/lib/kubelet/pods/15dc2664-c987-4baa-9aca-c661c5161a52/volumes" Jul 22 19:02:18.868264 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:18.868237 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-858f867677-dqb67_ae587d03-5bb6-4d06-84ee-ee332e19e074/maas-api/0.log" Jul 22 19:02:22.069982 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:22.069947 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4vw225_d6d42110-5189-4edb-b028-491740b40f60/istio-proxy/0.log" Jul 22 19:02:22.208575 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:22.208546 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-t66pg_7ce810eb-85b2-4431-856b-5a2f9f8d0da1/discovery/0.log" Jul 22 19:02:22.580112 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:22.580077 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-x8hfp_cec98bb9-2357-4f68-9076-ecd5351e84ff/istio-proxy/1.log" Jul 22 19:02:22.704933 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:22.704905 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-k6k55_15e0a02c-b9f1-4936-a0ce-5dc70b6456bf/payload-pre-processing/0.log" Jul 22 19:02:22.838541 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:22.838471 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-h4b9f_09b19d25-b11e-434f-8d32-d50167d2285d/payload-processing/0.log" Jul 22 19:02:23.739671 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:23.739645 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ffzgbw_03c0d9f6-960c-46bd-b6fd-88c778fd9041/main/0.log" Jul 22 19:02:23.879298 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:23.879266 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-rqxtx_c87a2c62-ff2d-4d6d-bd11-614c8268b774/main/0.log" Jul 22 19:02:29.651624 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:29.651588 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:29.752702 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:29.752666 2554 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" limit=1024 Jul 22 19:02:33.150138 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:33.150104 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5t9vd_26e1aabe-1b0e-43fe-ab3e-4dad9cb58a96/global-pull-secret-syncer/0.log" Jul 22 19:02:33.207367 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:33.207333 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jq95d_d3cf4800-3b6b-47c5-b9a1-4e14d716f323/konnectivity-agent/0.log" Jul 22 19:02:33.327548 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:33.327519 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-65.ec2.internal_5bb4be778fdc4d1b1c65a09ca6ed53e9/haproxy/0.log" Jul 22 19:02:40.473373 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:40.473342 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-7lkxc_5e7d448f-575c-4335-8274-d2b9541738eb/cluster-monitoring-operator/0.log" Jul 22 19:02:40.501006 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:40.500976 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-cdtcf_7e526eb5-3430-4be1-94bd-5971d7a3212e/kube-state-metrics/0.log" Jul 22 19:02:40.521805 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:40.521772 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-cdtcf_7e526eb5-3430-4be1-94bd-5971d7a3212e/kube-rbac-proxy-main/0.log" Jul 22 19:02:40.544489 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:40.544438 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-cdtcf_7e526eb5-3430-4be1-94bd-5971d7a3212e/kube-rbac-proxy-self/0.log" Jul 22 19:02:40.587349 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:40.587322 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7986f4464d-lccpm_a8f70565-0ea7-4f56-be71-4c6927371816/metrics-server/0.log" Jul 22 19:02:40.622605 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:40.622570 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-cjbnr_70369879-4cfb-47ec-96c5-8045bc22a2a7/monitoring-plugin/0.log" Jul 22 19:02:40.658621 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:40.658547 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ggj9z_bf1e9f8e-d430-4187-958b-cd7137154d7b/node-exporter/0.log" Jul 22 19:02:40.679339 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:40.679317 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ggj9z_bf1e9f8e-d430-4187-958b-cd7137154d7b/kube-rbac-proxy/0.log" Jul 22 19:02:40.701000 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:40.700971 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ggj9z_bf1e9f8e-d430-4187-958b-cd7137154d7b/init-textfile/0.log" Jul 22 19:02:41.011034 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:41.011007 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d6903f5d-2e4c-4df5-bc19-5ee5e4693998/prometheus/0.log" Jul 22 19:02:41.035163 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:41.035139 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d6903f5d-2e4c-4df5-bc19-5ee5e4693998/config-reloader/0.log" Jul 22 19:02:41.061466 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:41.061408 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d6903f5d-2e4c-4df5-bc19-5ee5e4693998/thanos-sidecar/0.log" Jul 22 19:02:41.091562 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:41.091538 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d6903f5d-2e4c-4df5-bc19-5ee5e4693998/kube-rbac-proxy-web/0.log" Jul 22 19:02:41.113618 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:41.113590 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d6903f5d-2e4c-4df5-bc19-5ee5e4693998/kube-rbac-proxy/0.log" Jul 22 19:02:41.138790 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:41.138763 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d6903f5d-2e4c-4df5-bc19-5ee5e4693998/kube-rbac-proxy-thanos/0.log" Jul 22 19:02:41.160203 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:41.160177 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d6903f5d-2e4c-4df5-bc19-5ee5e4693998/init-config-reloader/0.log" Jul 22 19:02:43.142035 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.141995 2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs"] Jul 22 19:02:43.142684 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.142565 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" containerName="istio-proxy" Jul 22 19:02:43.142684 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.142587 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" containerName="istio-proxy" Jul 22 19:02:43.142684 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.142601 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95185673-9920-479a-94bf-230aa09adfea" containerName="istio-proxy" Jul 22 19:02:43.142684 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.142610 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="95185673-9920-479a-94bf-230aa09adfea" containerName="istio-proxy" Jul 22 19:02:43.142684 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.142635 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15dc2664-c987-4baa-9aca-c661c5161a52" containerName="istio-proxy" Jul 22 19:02:43.142684 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.142643 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="15dc2664-c987-4baa-9aca-c661c5161a52" containerName="istio-proxy" Jul 22 19:02:43.142684 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.142656 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" containerName="istio-proxy" Jul 22 19:02:43.142684 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.142664 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" containerName="istio-proxy" Jul 22 19:02:43.143098 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.142701 2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15dc2664-c987-4baa-9aca-c661c5161a52" containerName="istio-proxy" Jul 22 19:02:43.143098 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.142711 2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="15dc2664-c987-4baa-9aca-c661c5161a52" containerName="istio-proxy" Jul 22 19:02:43.143098 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.142808 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="15dc2664-c987-4baa-9aca-c661c5161a52" containerName="istio-proxy" Jul 22 19:02:43.143098 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.142823 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6aaf18be-8db7-429c-a262-4f8ebb5ec1c3" containerName="istio-proxy" Jul 22 19:02:43.143098 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.142832 2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="15dc2664-c987-4baa-9aca-c661c5161a52" containerName="istio-proxy" Jul 22 19:02:43.146009 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.145988 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" Jul 22 19:02:43.148737 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.148717 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r6bg7\"/\"kube-root-ca.crt\"" Jul 22 19:02:43.148942 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.148928 2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-r6bg7\"/\"openshift-service-ca.crt\"" Jul 22 19:02:43.149025 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.149011 2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-r6bg7\"/\"default-dockercfg-m6ggt\"" Jul 22 19:02:43.155324 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.155301 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs"] Jul 22 19:02:43.236519 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.236479 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqtcf\" (UniqueName: \"kubernetes.io/projected/2833c7ce-8291-4686-89f7-0245bd600dee-kube-api-access-jqtcf\") pod \"perf-node-gather-daemonset-2s7vs\" (UID: \"2833c7ce-8291-4686-89f7-0245bd600dee\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" Jul 22 19:02:43.236743 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.236566 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2833c7ce-8291-4686-89f7-0245bd600dee-proc\") pod \"perf-node-gather-daemonset-2s7vs\" (UID: \"2833c7ce-8291-4686-89f7-0245bd600dee\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" Jul 22 19:02:43.236743 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.236703 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2833c7ce-8291-4686-89f7-0245bd600dee-podres\") pod \"perf-node-gather-daemonset-2s7vs\" (UID: \"2833c7ce-8291-4686-89f7-0245bd600dee\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" Jul 22 19:02:43.236887 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.236742 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2833c7ce-8291-4686-89f7-0245bd600dee-sys\") pod \"perf-node-gather-daemonset-2s7vs\" (UID: \"2833c7ce-8291-4686-89f7-0245bd600dee\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" Jul 22 19:02:43.236887 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.236768 2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2833c7ce-8291-4686-89f7-0245bd600dee-lib-modules\") pod \"perf-node-gather-daemonset-2s7vs\" (UID: \"2833c7ce-8291-4686-89f7-0245bd600dee\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" Jul 22 19:02:43.337808 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.337771 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqtcf\" (UniqueName: \"kubernetes.io/projected/2833c7ce-8291-4686-89f7-0245bd600dee-kube-api-access-jqtcf\") pod \"perf-node-gather-daemonset-2s7vs\" (UID: \"2833c7ce-8291-4686-89f7-0245bd600dee\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" Jul 22 19:02:43.338009 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.337826 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2833c7ce-8291-4686-89f7-0245bd600dee-proc\") pod \"perf-node-gather-daemonset-2s7vs\" (UID: \"2833c7ce-8291-4686-89f7-0245bd600dee\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" Jul 22 19:02:43.338009 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.337880 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2833c7ce-8291-4686-89f7-0245bd600dee-podres\") pod \"perf-node-gather-daemonset-2s7vs\" (UID: \"2833c7ce-8291-4686-89f7-0245bd600dee\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" Jul 22 19:02:43.338009 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.337909 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2833c7ce-8291-4686-89f7-0245bd600dee-sys\") pod \"perf-node-gather-daemonset-2s7vs\" (UID: \"2833c7ce-8291-4686-89f7-0245bd600dee\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" Jul 22 19:02:43.338009 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.337927 2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2833c7ce-8291-4686-89f7-0245bd600dee-lib-modules\") pod \"perf-node-gather-daemonset-2s7vs\" (UID: \"2833c7ce-8291-4686-89f7-0245bd600dee\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" Jul 22 19:02:43.338009 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.337983 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2833c7ce-8291-4686-89f7-0245bd600dee-proc\") pod \"perf-node-gather-daemonset-2s7vs\" (UID: \"2833c7ce-8291-4686-89f7-0245bd600dee\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" Jul 22 19:02:43.338009 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.338000 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2833c7ce-8291-4686-89f7-0245bd600dee-sys\") pod \"perf-node-gather-daemonset-2s7vs\" (UID: \"2833c7ce-8291-4686-89f7-0245bd600dee\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" Jul 22 19:02:43.338286 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.338037 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2833c7ce-8291-4686-89f7-0245bd600dee-podres\") pod \"perf-node-gather-daemonset-2s7vs\" (UID: \"2833c7ce-8291-4686-89f7-0245bd600dee\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" Jul 22 19:02:43.338286 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.338054 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2833c7ce-8291-4686-89f7-0245bd600dee-lib-modules\") pod \"perf-node-gather-daemonset-2s7vs\" (UID: \"2833c7ce-8291-4686-89f7-0245bd600dee\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" Jul 22 19:02:43.346277 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.346254 2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqtcf\" (UniqueName: \"kubernetes.io/projected/2833c7ce-8291-4686-89f7-0245bd600dee-kube-api-access-jqtcf\") pod \"perf-node-gather-daemonset-2s7vs\" (UID: \"2833c7ce-8291-4686-89f7-0245bd600dee\") " pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" Jul 22 19:02:43.456338 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.456250 2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" Jul 22 19:02:43.592522 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.592492 2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs"] Jul 22 19:02:43.595291 ip-10-0-132-65 kubenswrapper[2554]: W0722 19:02:43.595261 2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2833c7ce_8291_4686_89f7_0245bd600dee.slice/crio-8d0222367168511f57719f043996e4243390a911a566db0515e12a87d1188065 WatchSource:0}: Error finding container 8d0222367168511f57719f043996e4243390a911a566db0515e12a87d1188065: Status 404 returned error can't find the container with id 8d0222367168511f57719f043996e4243390a911a566db0515e12a87d1188065 Jul 22 19:02:43.865946 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:43.865911 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-xmrzf_8060d058-e84a-43be-9cdc-f288cb37966d/download-server/0.log" Jul 22 19:02:44.081644 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:44.081612 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" event={"ID":"2833c7ce-8291-4686-89f7-0245bd600dee","Type":"ContainerStarted","Data":"8d91e7a2cb67737a0e49af9934c378ff1c99b456aacb39a410e8c2ebec793ede"} Jul 22 19:02:44.081829 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:44.081663 2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" event={"ID":"2833c7ce-8291-4686-89f7-0245bd600dee","Type":"ContainerStarted","Data":"8d0222367168511f57719f043996e4243390a911a566db0515e12a87d1188065"} Jul 22 19:02:44.081829 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:44.081705 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" Jul 22 19:02:44.098954 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:44.098892 2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" podStartSLOduration=1.098874367 podStartE2EDuration="1.098874367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-22 19:02:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-22 19:02:44.096973441 +0000 UTC m=+2920.021868459" watchObservedRunningTime="2026-07-22 19:02:44.098874367 +0000 UTC m=+2920.023769385" Jul 22 19:02:44.454609 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:44.454582 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-rlmks_05b5f170-0012-4e33-9518-c901407c9cde/volume-data-source-validator/0.log" Jul 22 19:02:45.539679 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:45.539650 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dhqrm_f40c4040-42e8-402a-b893-2055c35bc560/dns/0.log" Jul 22 19:02:45.563762 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:45.563735 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dhqrm_f40c4040-42e8-402a-b893-2055c35bc560/kube-rbac-proxy/0.log" Jul 22 19:02:45.672926 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:45.672895 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8tx85_07da8a07-dcb9-4331-99de-82a25374214b/dns-node-resolver/0.log" Jul 22 19:02:46.215970 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:46.215941 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-867fdb9447-wwxjj_65e99ee8-3638-4997-92f8-41dac9890459/registry/0.log" Jul 22 19:02:46.259580 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:46.259549 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d7fbm_03a472de-a374-457c-9959-409546b51390/node-ca/0.log" Jul 22 19:02:47.252445 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:47.252393 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4vw225_d6d42110-5189-4edb-b028-491740b40f60/istio-proxy/0.log" Jul 22 19:02:47.382248 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:47.382217 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-t66pg_7ce810eb-85b2-4431-856b-5a2f9f8d0da1/discovery/0.log" Jul 22 19:02:47.464040 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:47.464012 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-x8hfp_cec98bb9-2357-4f68-9076-ecd5351e84ff/istio-proxy/0.log" Jul 22 19:02:47.492301 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:47.492264 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-x8hfp_cec98bb9-2357-4f68-9076-ecd5351e84ff/istio-proxy/1.log" Jul 22 19:02:47.529147 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:47.524406 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-k6k55_15e0a02c-b9f1-4936-a0ce-5dc70b6456bf/payload-pre-processing/0.log" Jul 22 19:02:47.555751 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:47.555726 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-h4b9f_09b19d25-b11e-434f-8d32-d50167d2285d/payload-processing/0.log" Jul 22 19:02:48.323059 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:48.323029 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rfdk4_6998e97e-e9c2-4a74-b215-7261baa166cf/serve-healthcheck-canary/0.log" Jul 22 19:02:49.188578 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:49.188547 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vh2pz_d3a449c1-034d-44c6-a5e4-d01189c070ff/kube-rbac-proxy/0.log" Jul 22 19:02:49.239596 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:49.239573 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vh2pz_d3a449c1-034d-44c6-a5e4-d01189c070ff/exporter/0.log" Jul 22 19:02:49.271007 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:49.270980 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vh2pz_d3a449c1-034d-44c6-a5e4-d01189c070ff/extractor/0.log" Jul 22 19:02:50.096990 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:50.096963 2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-r6bg7/perf-node-gather-daemonset-2s7vs" Jul 22 19:02:52.081102 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:52.081076 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-ddf6698b6-vhvv9_a268b6e6-64a1-47fe-913f-c566857cba04/manager/0.log" Jul 22 19:02:52.292971 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:52.292940 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-549865fcdf-f2l5q_41688e46-a79d-4770-a7ed-438f0893c8d7/manager/0.log" Jul 22 19:02:52.313691 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:52.313667 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-549865fcdf-f2l5q_41688e46-a79d-4770-a7ed-438f0893c8d7/copy-manifests/0.log" Jul 22 19:02:53.593771 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:53.593741 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4vw225_d6d42110-5189-4edb-b028-491740b40f60/istio-proxy/0.log" Jul 22 19:02:53.719912 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:53.719864 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-t66pg_7ce810eb-85b2-4431-856b-5a2f9f8d0da1/discovery/0.log" Jul 22 19:02:53.760882 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:53.760855 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7b479b546f-26gvd_d07c8ea0-3502-4e0f-8f2c-157365147b2e/manager/0.log" Jul 22 19:02:53.764080 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:53.764048 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-x8hfp_cec98bb9-2357-4f68-9076-ecd5351e84ff/istio-proxy/0.log" Jul 22 19:02:53.792123 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:53.792094 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-x8hfp_cec98bb9-2357-4f68-9076-ecd5351e84ff/istio-proxy/1.log" Jul 22 19:02:53.814063 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:53.814040 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-k6k55_15e0a02c-b9f1-4936-a0ce-5dc70b6456bf/payload-pre-processing/0.log" Jul 22 19:02:53.832587 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:53.832559 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-h4b9f_09b19d25-b11e-434f-8d32-d50167d2285d/payload-processing/0.log" Jul 22 19:02:55.162130 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:55.162047 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4vw225_d6d42110-5189-4edb-b028-491740b40f60/istio-proxy/0.log" Jul 22 19:02:55.297575 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:55.297542 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-t66pg_7ce810eb-85b2-4431-856b-5a2f9f8d0da1/discovery/0.log" Jul 22 19:02:55.341440 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:55.341375 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-x8hfp_cec98bb9-2357-4f68-9076-ecd5351e84ff/istio-proxy/0.log" Jul 22 19:02:55.367354 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:55.367324 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-x8hfp_cec98bb9-2357-4f68-9076-ecd5351e84ff/istio-proxy/1.log" Jul 22 19:02:55.389547 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:55.389519 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-k6k55_15e0a02c-b9f1-4936-a0ce-5dc70b6456bf/payload-pre-processing/0.log" Jul 22 19:02:55.411494 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:55.411465 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-h4b9f_09b19d25-b11e-434f-8d32-d50167d2285d/payload-processing/0.log" Jul 22 19:02:59.148518 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:59.148466 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-qxkn8_a3e31864-a150-4faf-9f4d-28d655bd4795/kube-storage-version-migrator-operator/1.log" Jul 22 19:02:59.149467 ip-10-0-132-65 kubenswrapper[2554]: I0722 19:02:59.149444 2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-qxkn8_a3e31864-a150-4faf-9f4d-28d655bd4795/kube-storage-version-migrator-operator/0.log"