Jul 09 14:02:49.529834 ip-10-0-134-107 systemd[1]: Starting Kubernetes Kubelet... Jul 09 14:02:51.294222 ip-10-0-134-107 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:02:51.294222 ip-10-0-134-107 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 14:02:51.294222 ip-10-0-134-107 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:02:51.294222 ip-10-0-134-107 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 14:02:51.294222 ip-10-0-134-107 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:02:51.295443 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.295347 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 14:02:51.300607 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300577 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:02:51.300607 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300603 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:02:51.300607 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300609 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:02:51.300607 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300613 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:02:51.300607 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300617 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:02:51.300896 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300625 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:02:51.300896 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300631 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:02:51.300896 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300635 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:02:51.300896 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300640 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:02:51.300896 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300646 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:02:51.300896 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300650 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:02:51.300896 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300655 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:02:51.300896 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300659 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:02:51.300896 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300663 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:02:51.300896 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300667 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:02:51.300896 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300671 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:02:51.300896 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300674 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:02:51.300896 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300686 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:02:51.300896 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300691 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:02:51.300896 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300695 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:02:51.300896 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300700 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:02:51.300896 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300705 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:02:51.300896 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300709 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:02:51.300896 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300713 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:02:51.300896 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300717 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:02:51.301700 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300720 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:02:51.301700 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300724 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:02:51.301700 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300728 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:02:51.301700 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300734 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:02:51.301700 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300739 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:02:51.301700 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300744 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:02:51.301700 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300749 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:02:51.301700 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300753 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:02:51.301700 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300758 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:02:51.301700 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300763 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:02:51.301700 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300769 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:02:51.301700 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300774 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:02:51.301700 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300779 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:02:51.301700 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300784 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:02:51.301700 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300790 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:02:51.301700 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300794 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:02:51.301700 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300799 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:02:51.301700 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300803 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:02:51.301700 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300808 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:02:51.301700 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300812 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:02:51.302515 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300817 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:02:51.302515 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300822 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:02:51.302515 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300826 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:02:51.302515 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300831 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:02:51.302515 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300835 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:02:51.302515 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300839 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:02:51.302515 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300843 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:02:51.302515 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300848 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:02:51.302515 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300852 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:02:51.302515 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300856 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:02:51.302515 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300860 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:02:51.302515 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300864 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:02:51.302515 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300870 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:02:51.302515 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300875 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:02:51.302515 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300879 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:02:51.302515 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300884 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:02:51.302515 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300889 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:02:51.302515 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300894 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:02:51.302515 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300899 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:02:51.303279 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300904 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:02:51.303279 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300909 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:02:51.303279 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300913 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:02:51.303279 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300917 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:02:51.303279 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300922 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:02:51.303279 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300927 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:02:51.303279 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300932 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:02:51.303279 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300939 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:02:51.303279 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300943 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:02:51.303279 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300948 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:02:51.303279 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300952 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:02:51.303279 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300957 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:02:51.303279 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300961 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:02:51.303279 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300966 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:02:51.303279 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300970 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:02:51.303279 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300974 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:02:51.303279 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300978 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:02:51.303279 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300983 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:02:51.303279 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300988 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:02:51.303279 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300992 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:02:51.304110 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.300997 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:02:51.304110 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.301001 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:02:51.304110 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.301005 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:02:51.304110 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.301009 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:02:51.304110 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.301013 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:02:51.304110 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.301017 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:02:51.304110 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.301021 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:02:51.304110 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.301026 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:02:51.304110 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.301029 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:02:51.304110 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.301033 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:02:51.304110 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.301037 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:02:51.304110 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.301042 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:02:51.304110 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.301046 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:02:51.304110 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.301050 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:02:51.304110 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.301055 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:02:51.304110 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302252 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:02:51.304110 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302264 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:02:51.304110 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302269 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:02:51.304110 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302275 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:02:51.304110 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302280 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:02:51.304934 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302285 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:02:51.304934 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302289 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:02:51.304934 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302293 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:02:51.304934 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302300 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:02:51.304934 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302325 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:02:51.304934 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302331 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:02:51.304934 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302336 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:02:51.304934 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302340 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:02:51.304934 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302345 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:02:51.304934 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302349 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:02:51.304934 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302353 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:02:51.304934 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302357 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:02:51.304934 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302361 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:02:51.304934 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302365 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:02:51.304934 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302370 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:02:51.304934 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302373 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:02:51.304934 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302378 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:02:51.304934 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302382 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:02:51.304934 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302387 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:02:51.305701 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302394 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:02:51.305701 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302399 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:02:51.305701 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302403 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:02:51.305701 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302408 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:02:51.305701 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302412 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:02:51.305701 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302417 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:02:51.305701 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302421 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:02:51.305701 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302428 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:02:51.305701 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302433 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:02:51.305701 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302437 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:02:51.305701 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302442 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:02:51.305701 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302447 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:02:51.305701 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302452 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:02:51.305701 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302457 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:02:51.305701 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302461 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:02:51.305701 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302466 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:02:51.305701 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302470 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:02:51.305701 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302474 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:02:51.305701 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302478 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:02:51.305701 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302483 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:02:51.306256 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302488 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:02:51.306256 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302492 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:02:51.306256 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302496 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:02:51.306256 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302502 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:02:51.306256 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302506 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:02:51.306256 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302510 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:02:51.306256 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302514 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:02:51.306256 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302518 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:02:51.306256 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302522 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:02:51.306256 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302526 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:02:51.306256 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302530 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:02:51.306256 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302534 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:02:51.306256 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302538 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:02:51.306256 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302542 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:02:51.306256 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302547 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:02:51.306256 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302551 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:02:51.306256 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302555 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:02:51.306256 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302559 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:02:51.306256 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302563 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:02:51.306256 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302567 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:02:51.306915 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302571 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:02:51.306915 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302576 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:02:51.306915 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302580 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:02:51.306915 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302585 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:02:51.306915 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302589 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:02:51.306915 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302595 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:02:51.306915 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302600 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:02:51.306915 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302604 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:02:51.306915 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302608 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:02:51.306915 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302612 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:02:51.306915 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302616 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:02:51.306915 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302620 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:02:51.306915 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302624 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:02:51.306915 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302629 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:02:51.306915 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302633 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:02:51.306915 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302637 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:02:51.306915 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302641 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:02:51.306915 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302645 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:02:51.306915 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302649 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:02:51.306915 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302653 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:02:51.307432 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302660 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:02:51.307432 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302665 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:02:51.307432 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302671 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:02:51.307432 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302675 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:02:51.307432 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302680 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:02:51.307432 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302685 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:02:51.307432 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302689 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:02:51.307432 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302693 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:02:51.307432 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302698 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:02:51.307432 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302702 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:02:51.307432 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302706 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:02:51.307432 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302710 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:02:51.307432 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302714 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:02:51.307432 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302719 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:02:51.307432 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.302723 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:02:51.307432 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303348 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:02:51.307432 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303358 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:02:51.307432 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303364 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:02:51.307432 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303369 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:02:51.307961 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303373 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:02:51.307961 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303380 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:02:51.307961 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303387 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:02:51.307961 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303392 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:02:51.307961 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303397 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:02:51.307961 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303402 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:02:51.307961 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303407 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:02:51.307961 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303412 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:02:51.307961 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303416 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:02:51.307961 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303421 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:02:51.307961 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303427 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:02:51.307961 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303433 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:02:51.307961 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303437 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:02:51.307961 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303442 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:02:51.307961 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303446 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:02:51.307961 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303451 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:02:51.307961 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303456 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:02:51.307961 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303460 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:02:51.307961 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303464 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:02:51.308467 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303468 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:02:51.308467 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303472 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:02:51.308467 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303477 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:02:51.308467 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303481 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:02:51.308467 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303486 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:02:51.308467 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303490 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:02:51.308467 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303494 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:02:51.308467 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303500 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:02:51.308467 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303504 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:02:51.308467 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303509 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:02:51.308467 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303513 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:02:51.308467 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303517 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:02:51.308467 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303522 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:02:51.308467 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303527 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:02:51.308467 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303531 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:02:51.308467 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303535 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:02:51.308467 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303539 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:02:51.308467 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303543 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:02:51.308467 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303548 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:02:51.308930 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303552 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:02:51.308930 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303556 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:02:51.308930 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303560 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:02:51.308930 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303566 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:02:51.308930 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303570 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:02:51.308930 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303574 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:02:51.308930 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303578 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:02:51.308930 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303583 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:02:51.308930 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303587 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:02:51.308930 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303591 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:02:51.308930 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303595 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:02:51.308930 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303599 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:02:51.308930 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303603 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:02:51.308930 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303608 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:02:51.308930 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303611 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:02:51.308930 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303616 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:02:51.308930 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303620 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:02:51.308930 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303624 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:02:51.308930 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303628 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:02:51.308930 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303633 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:02:51.309435 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303640 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:02:51.309435 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303645 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:02:51.309435 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303649 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:02:51.309435 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303653 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:02:51.309435 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303658 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:02:51.309435 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303662 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:02:51.309435 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303667 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:02:51.309435 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303672 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:02:51.309435 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303676 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:02:51.309435 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303681 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:02:51.309435 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303685 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:02:51.309435 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303689 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:02:51.309435 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303693 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:02:51.309435 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303697 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:02:51.309435 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303703 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:02:51.309435 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303707 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:02:51.309435 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303712 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:02:51.309435 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303716 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:02:51.309435 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303720 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:02:51.309435 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303724 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:02:51.309939 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303728 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:02:51.309939 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303732 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:02:51.309939 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303736 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:02:51.309939 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303741 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:02:51.309939 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303745 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:02:51.309939 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303749 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:02:51.309939 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303753 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:02:51.309939 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303761 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:02:51.309939 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303765 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:02:51.309939 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303770 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:02:51.309939 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303774 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:02:51.309939 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303778 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:02:51.309939 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303782 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:02:51.309939 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303786 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:02:51.309939 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303791 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:02:51.309939 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303795 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:02:51.309939 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.303799 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:02:51.309939 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.303904 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 14:02:51.309939 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.303916 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 14:02:51.309939 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.303928 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 14:02:51.309939 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.303935 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.303942 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.303947 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.303953 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.303960 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.303966 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.303992 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304000 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304005 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304011 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304016 2581 flags.go:64] FLAG: --cgroup-root="" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304021 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304025 2581 flags.go:64] FLAG: --client-ca-file="" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304030 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304035 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304042 2581 flags.go:64] FLAG: --cluster-domain="" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304047 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304052 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304059 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304067 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304074 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304079 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304084 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 14:02:51.310455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304090 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304094 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304099 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304104 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304109 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304113 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304120 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304125 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304129 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304135 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304140 2581 flags.go:64] FLAG: --enable-server="true" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304145 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304152 2581 flags.go:64] FLAG: --event-burst="100" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304157 2581 flags.go:64] FLAG: --event-qps="50" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304163 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304168 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304172 2581 flags.go:64] FLAG: --eviction-hard="" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304178 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304183 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304189 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304194 2581 flags.go:64] FLAG: --eviction-soft="" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304199 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304204 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304209 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304213 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 14:02:51.310989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304218 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304223 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304230 2581 flags.go:64] FLAG: --feature-gates="" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304237 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304243 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304248 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304253 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304258 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304263 2581 flags.go:64] FLAG: --help="false" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304267 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-134-107.ec2.internal" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304273 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304277 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304282 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304288 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304294 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304299 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304303 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304329 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304334 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304339 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304345 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304349 2581 flags.go:64] FLAG: --kube-reserved="" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304354 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304358 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 14:02:51.311722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304363 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304368 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304373 2581 flags.go:64] FLAG: --lock-file="" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304377 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304382 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304387 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304397 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304402 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304407 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304412 2581 flags.go:64] FLAG: --logging-format="text" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304420 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304427 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304432 2581 flags.go:64] FLAG: --manifest-url="" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304437 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304444 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304449 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304456 2581 flags.go:64] FLAG: --max-pods="110" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304461 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304466 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304470 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304475 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304480 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304485 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304490 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304501 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 14:02:51.312448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304506 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304512 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304517 2581 flags.go:64] FLAG: --pod-cidr="" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304522 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304531 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304536 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304541 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304546 2581 flags.go:64] FLAG: --port="10250" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304551 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304556 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b1918ac9598efbeb" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304561 2581 flags.go:64] FLAG: --qos-reserved="" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304566 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304571 2581 flags.go:64] FLAG: --register-node="true" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304575 2581 flags.go:64] FLAG: --register-with-taints="" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304581 2581 flags.go:64] FLAG: --registry-burst="10" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304586 2581 flags.go:64] FLAG: --registry-qps="5" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304590 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304595 2581 flags.go:64] FLAG: --reserved-memory="" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304604 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304609 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304614 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304618 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304623 2581 flags.go:64] FLAG: --runonce="false" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304628 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304633 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 14:02:51.313388 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304638 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304643 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304647 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304652 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304657 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304662 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304667 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304671 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304676 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304682 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304687 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304691 2581 flags.go:64] FLAG: --system-cgroups="" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304696 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304705 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304710 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304714 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304721 2581 flags.go:64] FLAG: --tls-min-version="" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304725 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304730 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304734 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304739 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304744 2581 flags.go:64] FLAG: --v="2" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304750 2581 flags.go:64] FLAG: --version="false" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304757 2581 flags.go:64] FLAG: --vmodule="" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304763 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 14:02:51.314003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.304772 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 14:02:51.314730 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.304957 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:02:51.314730 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.304964 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:02:51.314730 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.304969 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:02:51.314730 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.304974 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:02:51.314730 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.304979 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:02:51.314730 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.304983 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:02:51.314730 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.304988 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:02:51.314730 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.304992 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:02:51.314730 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.304997 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:02:51.314730 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305001 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:02:51.314730 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305006 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:02:51.314730 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305011 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:02:51.314730 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305015 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:02:51.314730 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305019 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:02:51.314730 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305024 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:02:51.314730 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305028 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:02:51.314730 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305036 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:02:51.314730 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305041 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:02:51.314730 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305046 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:02:51.315175 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305051 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:02:51.315175 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305055 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:02:51.315175 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305059 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:02:51.315175 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305063 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:02:51.315175 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305067 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:02:51.315175 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305072 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:02:51.315175 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305076 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:02:51.315175 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305080 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:02:51.315175 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305085 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:02:51.315175 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305089 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:02:51.315175 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305093 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:02:51.315175 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305097 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:02:51.315175 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305107 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:02:51.315175 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305111 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:02:51.315175 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305115 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:02:51.315175 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305120 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:02:51.315175 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305124 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:02:51.315175 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305128 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:02:51.315175 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305132 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:02:51.315175 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305136 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:02:51.315696 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305141 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:02:51.315696 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305145 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:02:51.315696 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305149 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:02:51.315696 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305154 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:02:51.315696 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305158 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:02:51.315696 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305162 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:02:51.315696 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305166 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:02:51.315696 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305171 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:02:51.315696 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305175 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:02:51.315696 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305179 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:02:51.315696 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305184 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:02:51.315696 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305189 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:02:51.315696 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305193 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:02:51.315696 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305196 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:02:51.315696 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305201 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:02:51.315696 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305207 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:02:51.315696 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305213 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:02:51.315696 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305218 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:02:51.315696 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305222 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:02:51.315696 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305226 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:02:51.316172 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305231 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:02:51.316172 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305235 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:02:51.316172 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305239 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:02:51.316172 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305243 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:02:51.316172 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305251 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:02:51.316172 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305255 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:02:51.316172 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305259 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:02:51.316172 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305264 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:02:51.316172 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305268 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:02:51.316172 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305272 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:02:51.316172 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305276 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:02:51.316172 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305281 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:02:51.316172 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305285 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:02:51.316172 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305289 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:02:51.316172 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305293 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:02:51.316172 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305297 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:02:51.316172 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305301 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:02:51.316172 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305323 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:02:51.316172 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305328 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:02:51.316172 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305333 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:02:51.316767 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305337 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:02:51.316767 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305343 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:02:51.316767 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305350 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:02:51.316767 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305355 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:02:51.316767 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305359 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:02:51.316767 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305364 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:02:51.316767 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305368 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:02:51.316767 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305373 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:02:51.316767 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305377 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:02:51.316767 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305381 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:02:51.316767 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305385 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:02:51.316767 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305389 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:02:51.316767 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305394 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:02:51.316767 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305398 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:02:51.316767 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305402 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:02:51.316767 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305407 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:02:51.316767 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305422 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:02:51.316767 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305426 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:02:51.316767 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305430 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:02:51.317224 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.305435 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:02:51.317224 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.305443 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:02:51.317224 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.314385 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 14:02:51.317224 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.314404 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 14:02:51.317224 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.314424 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 14:02:51.317224 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.314434 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 14:02:51.317224 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314492 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:02:51.317224 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314497 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:02:51.317224 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314501 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:02:51.317224 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314504 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:02:51.317224 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314507 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:02:51.317224 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314510 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:02:51.317224 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314513 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:02:51.317224 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314515 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:02:51.317224 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314518 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:02:51.317635 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314521 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:02:51.317635 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314524 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:02:51.317635 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314527 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:02:51.317635 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314530 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:02:51.317635 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314533 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:02:51.317635 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314536 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:02:51.317635 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314538 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:02:51.317635 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314541 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:02:51.317635 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314544 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:02:51.317635 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314546 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:02:51.317635 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314549 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:02:51.317635 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314553 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:02:51.317635 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314557 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:02:51.317635 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314560 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:02:51.317635 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314563 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:02:51.317635 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314565 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:02:51.317635 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314569 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:02:51.317635 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314572 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:02:51.317635 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314581 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:02:51.317635 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314584 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:02:51.318107 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314588 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:02:51.318107 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314591 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:02:51.318107 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314594 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:02:51.318107 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314597 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:02:51.318107 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314600 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:02:51.318107 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314604 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:02:51.318107 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314607 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:02:51.318107 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314610 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:02:51.318107 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314613 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:02:51.318107 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314616 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:02:51.318107 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314619 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:02:51.318107 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314621 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:02:51.318107 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314624 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:02:51.318107 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314627 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:02:51.318107 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314629 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:02:51.318107 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314632 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:02:51.318107 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314634 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:02:51.318107 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314637 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:02:51.318107 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314639 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:02:51.318576 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314642 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:02:51.318576 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314645 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:02:51.318576 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314648 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:02:51.318576 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314650 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:02:51.318576 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314653 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:02:51.318576 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314656 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:02:51.318576 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314658 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:02:51.318576 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314661 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:02:51.318576 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314663 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:02:51.318576 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314666 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:02:51.318576 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314669 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:02:51.318576 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314672 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:02:51.318576 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314674 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:02:51.318576 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314677 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:02:51.318576 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314680 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:02:51.318576 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314682 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:02:51.318576 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314686 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:02:51.318576 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314690 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:02:51.318576 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314693 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:02:51.319027 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314696 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:02:51.319027 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314698 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:02:51.319027 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314701 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:02:51.319027 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314703 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:02:51.319027 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314706 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:02:51.319027 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314709 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:02:51.319027 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314711 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:02:51.319027 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314714 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:02:51.319027 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314716 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:02:51.319027 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314719 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:02:51.319027 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314721 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:02:51.319027 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314724 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:02:51.319027 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314727 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:02:51.319027 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314730 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:02:51.319027 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314732 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:02:51.319027 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314735 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:02:51.319027 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314738 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:02:51.319027 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314741 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:02:51.319027 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314743 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:02:51.319027 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314747 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:02:51.319528 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314750 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:02:51.319528 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314753 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:02:51.319528 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314756 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:02:51.319528 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314758 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:02:51.319528 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314761 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:02:51.319528 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314763 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:02:51.319528 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314766 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:02:51.319528 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314768 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:02:51.319528 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314771 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:02:51.319528 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314773 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:02:51.319528 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314776 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:02:51.319528 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314778 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:02:51.319528 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.314783 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:02:51.319528 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314911 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:02:51.319528 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314917 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:02:51.319892 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314920 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:02:51.319892 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314923 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:02:51.319892 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314926 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:02:51.319892 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314928 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:02:51.319892 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314931 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:02:51.319892 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314933 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:02:51.319892 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314936 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:02:51.319892 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314938 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:02:51.319892 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314941 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:02:51.319892 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314943 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:02:51.319892 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314946 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:02:51.319892 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314949 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:02:51.319892 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314951 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:02:51.319892 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314954 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:02:51.319892 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314956 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:02:51.319892 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314959 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:02:51.319892 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314962 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:02:51.319892 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314964 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:02:51.319892 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314967 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:02:51.319892 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314970 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:02:51.320390 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314973 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:02:51.320390 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314975 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:02:51.320390 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314978 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:02:51.320390 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314981 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:02:51.320390 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314984 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:02:51.320390 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314987 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:02:51.320390 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314989 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:02:51.320390 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314992 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:02:51.320390 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314995 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:02:51.320390 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.314997 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:02:51.320390 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315001 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:02:51.320390 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315003 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:02:51.320390 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315006 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:02:51.320390 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315008 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:02:51.320390 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315011 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:02:51.320390 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315013 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:02:51.320390 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315017 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:02:51.320390 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315021 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:02:51.320390 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315024 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:02:51.320880 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315027 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:02:51.320880 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315030 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:02:51.320880 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315033 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:02:51.320880 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315036 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:02:51.320880 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315039 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:02:51.320880 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315042 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:02:51.320880 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315045 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:02:51.320880 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315049 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:02:51.320880 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315051 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:02:51.320880 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315054 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:02:51.320880 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315057 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:02:51.320880 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315060 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:02:51.320880 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315062 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:02:51.320880 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315065 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:02:51.320880 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315068 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:02:51.320880 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315070 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:02:51.320880 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315073 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:02:51.320880 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315076 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:02:51.320880 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315078 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:02:51.321343 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315081 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:02:51.321343 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315083 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:02:51.321343 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315086 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:02:51.321343 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315089 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:02:51.321343 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315091 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:02:51.321343 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315094 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:02:51.321343 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315097 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:02:51.321343 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315099 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:02:51.321343 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315102 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:02:51.321343 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315104 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:02:51.321343 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315107 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:02:51.321343 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315109 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:02:51.321343 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315112 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:02:51.321343 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315114 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:02:51.321343 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315117 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:02:51.321343 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315119 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:02:51.321343 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315122 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:02:51.321343 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315124 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:02:51.321343 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315128 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:02:51.321343 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315131 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:02:51.321830 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315133 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:02:51.321830 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315137 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:02:51.321830 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315140 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:02:51.321830 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315143 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:02:51.321830 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315145 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:02:51.321830 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315148 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:02:51.321830 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315150 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:02:51.321830 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315153 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:02:51.321830 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315155 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:02:51.321830 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315158 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:02:51.321830 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315161 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:02:51.321830 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315163 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:02:51.321830 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315166 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:02:51.321830 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315168 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:02:51.321830 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315171 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:02:51.321830 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315174 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:02:51.321830 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315176 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:02:51.321830 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315179 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:02:51.321830 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:51.315182 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:02:51.322276 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.315187 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:02:51.322276 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.315351 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 14:02:51.322276 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.317594 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 14:02:51.322276 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.319048 2581 server.go:1019] "Starting client certificate rotation" Jul 09 14:02:51.322276 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.319151 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 14:02:51.322276 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.319184 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 14:02:51.322449 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.322435 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 14:02:51.323832 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.323805 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 14:02:51.334213 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.334189 2581 log.go:25] "Validated CRI v1 runtime API" Jul 09 14:02:51.339294 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.339274 2581 log.go:25] "Validated CRI v1 image API" Jul 09 14:02:51.340255 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.340238 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 14:02:51.343464 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.343438 2581 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b8683c5f-2e02-40ec-94b7-4ad45f81aa0e:/dev/nvme0n1p3 da8b2cae-79c6-48b7-bae5-793180d21d65:/dev/nvme0n1p4] Jul 09 14:02:51.343510 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.343465 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 14:02:51.351643 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.351617 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 14:02:51.352222 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.352103 2581 manager.go:216] Machine: {Timestamp:2026-07-09 14:02:51.350370067 +0000 UTC m=+0.550870433 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3091166 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec293659fab13ea9ad1f321e4e79d092 SystemUUID:ec293659-fab1-3ea9-ad1f-321e4e79d092 BootID:00df9356-2995-420c-8e69-a353eeb00dab Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:9e:46:88:e7:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:9e:46:88:e7:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:38:ef:d8:b5:a5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 14:02:51.352222 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.352222 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 14:02:51.352381 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.352363 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 14:02:51.355421 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.355392 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 14:02:51.355591 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.355423 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-107.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 14:02:51.356186 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.356173 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 14:02:51.356236 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.356190 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 14:02:51.356236 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.356200 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 14:02:51.357387 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.357373 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 14:02:51.358207 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.358195 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 14:02:51.361160 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.361146 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 09 14:02:51.361304 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.361292 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 14:02:51.361383 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.361344 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 09 14:02:51.361383 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.361359 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 14:02:51.361383 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.361379 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 14:02:51.361522 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.361392 2581 kubelet.go:398] "Adding apiserver pod source" Jul 09 14:02:51.361522 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.361410 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 14:02:51.361813 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.361799 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 14:02:51.361872 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.361823 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 14:02:51.364020 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.364000 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 14:02:51.365604 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.365590 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 14:02:51.365645 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.365620 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 14:02:51.366344 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.366333 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 14:02:51.366384 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.366350 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 14:02:51.366384 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.366356 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 14:02:51.366384 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.366361 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 14:02:51.366384 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.366369 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 14:02:51.366384 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.366375 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 14:02:51.366384 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.366382 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 14:02:51.366535 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.366388 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 14:02:51.366535 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.366395 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 14:02:51.366535 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.366400 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 14:02:51.366535 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.366411 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 14:02:51.366535 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.366417 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 14:02:51.367526 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.367512 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 14:02:51.367526 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.367525 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 14:02:51.370919 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.370906 2581 server.go:1268] "Started kubelet" Jul 09 14:02:51.371091 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.371058 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 14:02:51.371382 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.371364 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wfgbj" Jul 09 14:02:51.371592 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.371520 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 14:02:51.371745 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.371721 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 14:02:51.372064 ip-10-0-134-107 systemd[1]: Started Kubernetes Kubelet. Jul 09 14:02:51.372496 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.372077 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-107.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 14:02:51.372807 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:51.372670 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 14:02:51.372807 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:51.372665 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 14:02:51.373713 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.373699 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 09 14:02:51.375148 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.375084 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 14:02:51.377554 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:51.375037 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-107.ec2.internal.18c0a3ffc5e5ddad default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-107.ec2.internal,UID:ip-10-0-134-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-107.ec2.internal,},FirstTimestamp:2026-07-09 14:02:51.370880429 +0000 UTC m=+0.571380795,LastTimestamp:2026-07-09 14:02:51.370880429 +0000 UTC m=+0.571380795,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-107.ec2.internal,}" Jul 09 14:02:51.378526 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.378497 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wfgbj" Jul 09 14:02:51.380001 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:51.379977 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 14:02:51.382809 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.382787 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 14:02:51.382903 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.382809 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 14:02:51.382903 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:51.382898 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-107.ec2.internal\" not found" Jul 09 14:02:51.383603 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.383586 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 14:02:51.383693 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.383606 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 14:02:51.383693 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.383594 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 14:02:51.383693 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.383683 2581 factory.go:55] Registering systemd factory Jul 09 14:02:51.383693 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.383698 2581 factory.go:223] Registration of the systemd container factory successfully Jul 09 14:02:51.383857 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.383752 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 09 14:02:51.383857 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.383760 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 09 14:02:51.383925 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.383916 2581 factory.go:153] Registering CRI-O factory Jul 09 14:02:51.383967 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.383929 2581 factory.go:223] Registration of the crio container factory successfully Jul 09 14:02:51.384017 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.383981 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 14:02:51.384017 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.384002 2581 factory.go:103] Registering Raw factory Jul 09 14:02:51.384017 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.384013 2581 manager.go:1196] Started watching for new ooms in manager Jul 09 14:02:51.384487 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.384468 2581 manager.go:349] Starting recovery of all containers Jul 09 14:02:51.385520 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:51.385484 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 14:02:51.385621 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:51.385599 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 14:02:51.395207 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.395008 2581 manager.go:354] Recovery completed Jul 09 14:02:51.399693 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.399676 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:02:51.401690 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.401671 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:02:51.401778 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.401707 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:02:51.401778 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.401723 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:02:51.402258 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.402242 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 14:02:51.402353 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.402258 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 14:02:51.402353 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.402278 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 09 14:02:51.402353 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.402323 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:02:51.403067 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.403053 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:02:51.403119 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.403082 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:02:51.403119 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.403095 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:02:51.403628 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.403618 2581 policy_none.go:49] "None policy: Start" Jul 09 14:02:51.403662 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.403632 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 14:02:51.403662 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.403643 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 14:02:51.404697 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.404685 2581 policy_none.go:47] "Start" Jul 09 14:02:51.445961 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.445947 2581 manager.go:337] "Starting Device Plugin manager" Jul 09 14:02:51.446054 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:51.445981 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 14:02:51.446054 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.445994 2581 server.go:87] "Starting device plugin registration server" Jul 09 14:02:51.446292 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.446279 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 14:02:51.446365 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.446293 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 14:02:51.446545 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.446524 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 14:02:51.446673 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.446611 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 14:02:51.446673 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.446620 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 14:02:51.447065 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:51.447044 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 14:02:51.447170 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:51.447158 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-107.ec2.internal\" not found" Jul 09 14:02:51.546822 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.546787 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:02:51.548019 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.547839 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:02:51.548019 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.547868 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:02:51.548019 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.547880 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:02:51.548019 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.547919 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-107.ec2.internal" Jul 09 14:02:51.553756 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.553739 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-107.ec2.internal" Jul 09 14:02:51.553812 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:51.553767 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-107.ec2.internal\": node \"ip-10-0-134-107.ec2.internal\" not found" Jul 09 14:02:51.557239 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.557192 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 14:02:51.558899 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.558881 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 14:02:51.558993 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.558918 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 14:02:51.558993 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.558938 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 14:02:51.558993 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:51.558970 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 14:02:51.561236 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.561219 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:02:51.565705 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:51.565688 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-107.ec2.internal\" not found" Jul 09 14:02:51.659366 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.659246 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-107.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-107.ec2.internal"] Jul 09 14:02:51.659366 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.659371 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:02:51.660616 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.660591 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:02:51.660616 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.660624 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:02:51.660783 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.660633 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:02:51.662001 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.661987 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:02:51.662102 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.662086 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-107.ec2.internal" Jul 09 14:02:51.662160 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.662119 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:02:51.662751 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.662733 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:02:51.662751 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.662749 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:02:51.662881 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.662763 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:02:51.662881 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.662773 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:02:51.662881 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.662773 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:02:51.662881 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.662793 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:02:51.664220 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.664201 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-107.ec2.internal" Jul 09 14:02:51.664345 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.664229 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:02:51.664970 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.664952 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:02:51.665050 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.664980 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:02:51.665050 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.664989 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:02:51.665863 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:51.665850 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-107.ec2.internal\" not found" Jul 09 14:02:51.685339 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:51.685302 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-107.ec2.internal\" not found" node="ip-10-0-134-107.ec2.internal" Jul 09 14:02:51.686109 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.686087 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/45fa6098de5cf9fb647d955c2c5b37d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-107.ec2.internal\" (UID: \"45fa6098de5cf9fb647d955c2c5b37d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-107.ec2.internal" Jul 09 14:02:51.686159 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.686132 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45fa6098de5cf9fb647d955c2c5b37d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-107.ec2.internal\" (UID: \"45fa6098de5cf9fb647d955c2c5b37d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-107.ec2.internal" Jul 09 14:02:51.686159 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.686152 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6817e2e237c40714ab072889b9b23a38-config\") pod \"kube-apiserver-proxy-ip-10-0-134-107.ec2.internal\" (UID: \"6817e2e237c40714ab072889b9b23a38\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-107.ec2.internal" Jul 09 14:02:51.689939 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:51.689919 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-107.ec2.internal\" not found" node="ip-10-0-134-107.ec2.internal" Jul 09 14:02:51.766861 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:51.766829 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-107.ec2.internal\" not found" Jul 09 14:02:51.787214 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.787189 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/45fa6098de5cf9fb647d955c2c5b37d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-107.ec2.internal\" (UID: \"45fa6098de5cf9fb647d955c2c5b37d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-107.ec2.internal" Jul 09 14:02:51.787360 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.787244 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45fa6098de5cf9fb647d955c2c5b37d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-107.ec2.internal\" (UID: \"45fa6098de5cf9fb647d955c2c5b37d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-107.ec2.internal" Jul 09 14:02:51.787360 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.787267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6817e2e237c40714ab072889b9b23a38-config\") pod \"kube-apiserver-proxy-ip-10-0-134-107.ec2.internal\" (UID: \"6817e2e237c40714ab072889b9b23a38\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-107.ec2.internal" Jul 09 14:02:51.787360 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.787284 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/45fa6098de5cf9fb647d955c2c5b37d2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-107.ec2.internal\" (UID: \"45fa6098de5cf9fb647d955c2c5b37d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-107.ec2.internal" Jul 09 14:02:51.787360 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.787294 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6817e2e237c40714ab072889b9b23a38-config\") pod \"kube-apiserver-proxy-ip-10-0-134-107.ec2.internal\" (UID: \"6817e2e237c40714ab072889b9b23a38\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-107.ec2.internal" Jul 09 14:02:51.787360 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.787325 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45fa6098de5cf9fb647d955c2c5b37d2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-107.ec2.internal\" (UID: \"45fa6098de5cf9fb647d955c2c5b37d2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-107.ec2.internal" Jul 09 14:02:51.867670 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:51.867632 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-107.ec2.internal\" not found" Jul 09 14:02:51.968218 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:51.968131 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-107.ec2.internal\" not found" Jul 09 14:02:51.988563 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.988543 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-107.ec2.internal" Jul 09 14:02:51.993386 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:51.993369 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-107.ec2.internal" Jul 09 14:02:52.068493 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:52.068452 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-107.ec2.internal\" not found" Jul 09 14:02:52.169076 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:52.169039 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-107.ec2.internal\" not found" Jul 09 14:02:52.269707 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:52.269616 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-107.ec2.internal\" not found" Jul 09 14:02:52.318116 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:52.318090 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 14:02:52.318674 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:52.318244 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 14:02:52.370625 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:52.370592 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-107.ec2.internal\" not found" Jul 09 14:02:52.383843 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:52.383803 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 13:57:51 +0000 UTC" deadline="2027-12-12 13:54:21.267896479 +0000 UTC" Jul 09 14:02:52.383843 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:52.383840 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12503h51m28.884059475s" Jul 09 14:02:52.409985 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:52.409960 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:02:52.483282 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:52.483250 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-107.ec2.internal" Jul 09 14:02:52.498719 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:52.498691 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 14:02:52.501400 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:52.501385 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-107.ec2.internal" Jul 09 14:02:52.510127 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:52.510108 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 14:02:52.536405 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:52.536338 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:02:52.738543 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:52.738512 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6817e2e237c40714ab072889b9b23a38.slice/crio-fea0a8079abedfda12c90ccfe722b9fe331be0062dfc14bcb2470be3dfa296bf WatchSource:0}: Error finding container fea0a8079abedfda12c90ccfe722b9fe331be0062dfc14bcb2470be3dfa296bf: Status 404 returned error can't find the container with id fea0a8079abedfda12c90ccfe722b9fe331be0062dfc14bcb2470be3dfa296bf Jul 09 14:02:52.743758 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:52.743741 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:02:52.751181 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:52.751162 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:02:52.764214 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:52.764192 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45fa6098de5cf9fb647d955c2c5b37d2.slice/crio-783bf6fce8443cf88cbf6e5b6078b267a8397c4c06b448e904fc7245a5cdefec WatchSource:0}: Error finding container 783bf6fce8443cf88cbf6e5b6078b267a8397c4c06b448e904fc7245a5cdefec: Status 404 returned error can't find the container with id 783bf6fce8443cf88cbf6e5b6078b267a8397c4c06b448e904fc7245a5cdefec Jul 09 14:02:53.362714 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.362680 2581 apiserver.go:52] "Watching apiserver" Jul 09 14:02:53.371199 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.371170 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 14:02:53.371759 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.371737 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-clsk2","kube-system/konnectivity-agent-mxk8s","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs","openshift-dns/node-resolver-p8q9w","openshift-multus/multus-nnvq7","openshift-multus/network-metrics-daemon-sm7hq","openshift-network-operator/iptables-alerter-zdlqt","openshift-ovn-kubernetes/ovnkube-node-rnqq6","kube-system/kube-apiserver-proxy-ip-10-0-134-107.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qs4b4","openshift-image-registry/node-ca-qdfgv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-107.ec2.internal","openshift-multus/multus-additional-cni-plugins-7bknr","openshift-network-diagnostics/network-check-target-dwp56"] Jul 09 14:02:53.373753 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.373724 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zdlqt" Jul 09 14:02:53.376130 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.375327 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.376778 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.376358 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.376778 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.376758 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 14:02:53.377044 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.376855 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:02:53.377044 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.376918 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 14:02:53.377144 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.377065 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-plsbj\"" Jul 09 14:02:53.377565 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.377545 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 14:02:53.377825 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.377807 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p8q9w" Jul 09 14:02:53.377881 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.377836 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 14:02:53.378167 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.378147 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gxjfm\"" Jul 09 14:02:53.378346 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.378330 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 14:02:53.378587 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.378479 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 14:02:53.378587 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.378507 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 14:02:53.379128 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.379018 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 14:02:53.380239 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.380215 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 14:02:53.380431 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.380410 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 14:02:53.382687 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.381771 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.382687 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.382383 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 14:02:53.382687 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.382642 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 14:02:53.383094 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.383016 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-txn5h\"" Jul 09 14:02:53.384035 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.383739 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:02:53.385303 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:53.384512 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sm7hq" podUID="dd6bd814-79b7-4e7b-beeb-e04976f6d1d9" Jul 09 14:02:53.385498 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.385333 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-74bqg\"" Jul 09 14:02:53.386219 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.386203 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kz2hh\"" Jul 09 14:02:53.386456 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.385836 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 14:02:53.387226 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.385567 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 14:02:53.387450 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.387430 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:02:53.387525 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:53.387507 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwp56" podUID="2a03b990-06d4-4e07-8ef1-771f8b853040" Jul 09 14:02:53.388586 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.388568 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:02:53.388723 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:53.388702 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clsk2" podUID="37f5d43f-9abe-4758-bba1-59ae699d42ec" Jul 09 14:02:53.390439 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.389918 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mxk8s" Jul 09 14:02:53.391343 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.391324 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.392902 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.392881 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 14:02:53.393166 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.393149 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 14:02:53.393384 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.393366 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c79z5\"" Jul 09 14:02:53.393906 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.393888 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:02:53.394096 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.394081 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rl7lj\"" Jul 09 14:02:53.394551 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.394301 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 14:02:53.394551 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.394498 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.395370 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.394847 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qdfgv" Jul 09 14:02:53.395845 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.395615 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-host-var-lib-kubelet\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.395845 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.395652 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38a844f5-ef21-4817-b365-3b852d56ca7c-os-release\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.395845 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.395684 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/38a844f5-ef21-4817-b365-3b852d56ca7c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.395845 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.395711 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-host-run-k8s-cni-cncf-io\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.395845 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.395736 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-host-run-multus-certs\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.395845 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.395758 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-cnibin\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.395845 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.395819 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-host-var-lib-cni-multus\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.396220 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.395850 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-hostroot\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.396220 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.395874 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4b0323a-b5d4-4ed7-82ef-c558ea06dc25-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dwxrs\" (UID: \"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.396220 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.395896 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4b0323a-b5d4-4ed7-82ef-c558ea06dc25-registration-dir\") pod \"aws-ebs-csi-driver-node-dwxrs\" (UID: \"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.396220 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.395923 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-system-cni-dir\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.396220 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.395946 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-host-var-lib-cni-bin\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.396220 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.395968 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs\") pod \"network-metrics-daemon-sm7hq\" (UID: \"dd6bd814-79b7-4e7b-beeb-e04976f6d1d9\") " pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:02:53.396220 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.395993 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38a844f5-ef21-4817-b365-3b852d56ca7c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.396220 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396019 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdp66\" (UniqueName: \"kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66\") pod \"network-check-target-dwp56\" (UID: \"2a03b990-06d4-4e07-8ef1-771f8b853040\") " pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:02:53.396220 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396048 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6cc0b610-de8c-45a6-862f-8c859f4c7777-hosts-file\") pod \"node-resolver-p8q9w\" (UID: \"6cc0b610-de8c-45a6-862f-8c859f4c7777\") " pod="openshift-dns/node-resolver-p8q9w" Jul 09 14:02:53.396220 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396072 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38a844f5-ef21-4817-b365-3b852d56ca7c-cnibin\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.396220 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396105 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38a844f5-ef21-4817-b365-3b852d56ca7c-cni-binary-copy\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.396220 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396152 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4b0323a-b5d4-4ed7-82ef-c558ea06dc25-sys-fs\") pod \"aws-ebs-csi-driver-node-dwxrs\" (UID: \"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.396220 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396176 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76x2n\" (UniqueName: \"kubernetes.io/projected/6cc0b610-de8c-45a6-862f-8c859f4c7777-kube-api-access-76x2n\") pod \"node-resolver-p8q9w\" (UID: \"6cc0b610-de8c-45a6-862f-8c859f4c7777\") " pod="openshift-dns/node-resolver-p8q9w" Jul 09 14:02:53.396220 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396201 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-os-release\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.396220 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef9e1e6f-f75a-466d-a03f-f27995d36263-cni-binary-copy\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.396940 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396244 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-multus-socket-dir-parent\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.396940 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396272 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-host-run-netns\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.396940 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396296 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwsdq\" (UniqueName: \"kubernetes.io/projected/ef9e1e6f-f75a-466d-a03f-f27995d36263-kube-api-access-qwsdq\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.396940 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396346 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3700ddc-af0f-48d6-81ff-d04001239309-iptables-alerter-script\") pod \"iptables-alerter-zdlqt\" (UID: \"e3700ddc-af0f-48d6-81ff-d04001239309\") " pod="openshift-network-operator/iptables-alerter-zdlqt" Jul 09 14:02:53.396940 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396400 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4b0323a-b5d4-4ed7-82ef-c558ea06dc25-socket-dir\") pod \"aws-ebs-csi-driver-node-dwxrs\" (UID: \"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.396940 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396461 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fr52\" (UniqueName: \"kubernetes.io/projected/e3700ddc-af0f-48d6-81ff-d04001239309-kube-api-access-7fr52\") pod \"iptables-alerter-zdlqt\" (UID: \"e3700ddc-af0f-48d6-81ff-d04001239309\") " pod="openshift-network-operator/iptables-alerter-zdlqt" Jul 09 14:02:53.396940 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396486 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-multus-conf-dir\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.396940 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396511 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef9e1e6f-f75a-466d-a03f-f27995d36263-multus-daemon-config\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.396940 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396534 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3700ddc-af0f-48d6-81ff-d04001239309-host-slash\") pod \"iptables-alerter-zdlqt\" (UID: \"e3700ddc-af0f-48d6-81ff-d04001239309\") " pod="openshift-network-operator/iptables-alerter-zdlqt" Jul 09 14:02:53.396940 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396558 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/38a844f5-ef21-4817-b365-3b852d56ca7c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.396940 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396597 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4b0323a-b5d4-4ed7-82ef-c558ea06dc25-device-dir\") pod \"aws-ebs-csi-driver-node-dwxrs\" (UID: \"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.396940 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396628 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-etc-kubernetes\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.396940 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396654 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2v2c\" (UniqueName: \"kubernetes.io/projected/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-kube-api-access-w2v2c\") pod \"network-metrics-daemon-sm7hq\" (UID: \"dd6bd814-79b7-4e7b-beeb-e04976f6d1d9\") " pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:02:53.396940 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396678 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38a844f5-ef21-4817-b365-3b852d56ca7c-system-cni-dir\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.396940 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396704 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pkrz\" (UniqueName: \"kubernetes.io/projected/38a844f5-ef21-4817-b365-3b852d56ca7c-kube-api-access-4pkrz\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.396940 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396728 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4b0323a-b5d4-4ed7-82ef-c558ea06dc25-etc-selinux\") pod \"aws-ebs-csi-driver-node-dwxrs\" (UID: \"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.397689 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396769 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksc5d\" (UniqueName: \"kubernetes.io/projected/e4b0323a-b5d4-4ed7-82ef-c558ea06dc25-kube-api-access-ksc5d\") pod \"aws-ebs-csi-driver-node-dwxrs\" (UID: \"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.397689 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396796 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cc0b610-de8c-45a6-862f-8c859f4c7777-tmp-dir\") pod \"node-resolver-p8q9w\" (UID: \"6cc0b610-de8c-45a6-862f-8c859f4c7777\") " pod="openshift-dns/node-resolver-p8q9w" Jul 09 14:02:53.397689 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.396822 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-multus-cni-dir\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.397689 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.397008 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 14:02:53.397689 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.397382 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 14:02:53.397921 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.397726 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 14:02:53.399659 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.398851 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 14:02:53.399659 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.399071 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6nwm6\"" Jul 09 14:02:53.399659 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.399264 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8vjht\"" Jul 09 14:02:53.399659 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.399423 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 14:02:53.399659 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.399487 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 14:02:53.399937 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.399668 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 14:02:53.399937 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.399749 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 14:02:53.399937 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.399673 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 14:02:53.402804 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.402783 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 14:02:53.415094 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.415071 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:02:53.425606 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.425579 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dbnn9" Jul 09 14:02:53.433502 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.433477 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dbnn9" Jul 09 14:02:53.485262 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.485230 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 14:02:53.497345 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497297 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99589261-6e32-45b6-8a5a-c3be040e781c-env-overrides\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.497526 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497392 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-etc-sysctl-conf\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.497526 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497437 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd9909a6-9743-4756-83ac-19b7bbdb0a72-serviceca\") pod \"node-ca-qdfgv\" (UID: \"dd9909a6-9743-4756-83ac-19b7bbdb0a72\") " pod="openshift-image-registry/node-ca-qdfgv" Jul 09 14:02:53.497526 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497471 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-multus-cni-dir\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.497526 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497497 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-host-var-lib-kubelet\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.497526 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497522 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/38a844f5-ef21-4817-b365-3b852d56ca7c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.497780 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497545 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-host-slash\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.497780 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497567 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99589261-6e32-45b6-8a5a-c3be040e781c-ovnkube-config\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.497780 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497575 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-multus-cni-dir\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.497780 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497589 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-var-lib-kubelet\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.497780 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497623 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-host-run-multus-certs\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.497780 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497651 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-host-cni-netd\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.497780 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497678 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret\") pod \"global-pull-secret-syncer-clsk2\" (UID: \"37f5d43f-9abe-4758-bba1-59ae699d42ec\") " pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:02:53.497780 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497702 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-host\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.497780 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497728 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-host-var-lib-cni-multus\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.497780 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497764 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4b0323a-b5d4-4ed7-82ef-c558ea06dc25-registration-dir\") pod \"aws-ebs-csi-driver-node-dwxrs\" (UID: \"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.498238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497788 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99589261-6e32-45b6-8a5a-c3be040e781c-ovnkube-script-lib\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.498238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497813 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fbef93c8-131c-466f-a704-9afdd480b500-agent-certs\") pod \"konnectivity-agent-mxk8s\" (UID: \"fbef93c8-131c-466f-a704-9afdd480b500\") " pod="kube-system/konnectivity-agent-mxk8s" Jul 09 14:02:53.498238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497838 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6cc0b610-de8c-45a6-862f-8c859f4c7777-hosts-file\") pod \"node-resolver-p8q9w\" (UID: \"6cc0b610-de8c-45a6-862f-8c859f4c7777\") " pod="openshift-dns/node-resolver-p8q9w" Jul 09 14:02:53.498238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497862 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4b0323a-b5d4-4ed7-82ef-c558ea06dc25-sys-fs\") pod \"aws-ebs-csi-driver-node-dwxrs\" (UID: \"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.498238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497884 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-node-log\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.498238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497908 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-host-run-ovn-kubernetes\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.498238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497930 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-host-cni-bin\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.498238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497953 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/848147ce-53d7-44e7-af03-f2ae7fc34fe7-etc-tuned\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.498238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498013 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e4b0323a-b5d4-4ed7-82ef-c558ea06dc25-registration-dir\") pod \"aws-ebs-csi-driver-node-dwxrs\" (UID: \"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.498238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498029 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6cc0b610-de8c-45a6-862f-8c859f4c7777-hosts-file\") pod \"node-resolver-p8q9w\" (UID: \"6cc0b610-de8c-45a6-862f-8c859f4c7777\") " pod="openshift-dns/node-resolver-p8q9w" Jul 09 14:02:53.498238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.497652 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-host-var-lib-kubelet\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.498238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498061 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/848147ce-53d7-44e7-af03-f2ae7fc34fe7-tmp\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.498238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498092 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-host-run-multus-certs\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.498238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498107 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-host-var-lib-cni-multus\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.498238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498145 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e4b0323a-b5d4-4ed7-82ef-c558ea06dc25-sys-fs\") pod \"aws-ebs-csi-driver-node-dwxrs\" (UID: \"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.498238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498150 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-os-release\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.498238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498175 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwsdq\" (UniqueName: \"kubernetes.io/projected/ef9e1e6f-f75a-466d-a03f-f27995d36263-kube-api-access-qwsdq\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.499106 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498202 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3700ddc-af0f-48d6-81ff-d04001239309-iptables-alerter-script\") pod \"iptables-alerter-zdlqt\" (UID: \"e3700ddc-af0f-48d6-81ff-d04001239309\") " pod="openshift-network-operator/iptables-alerter-zdlqt" Jul 09 14:02:53.499106 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498232 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-os-release\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.499106 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498228 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-var-lib-openvswitch\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.499106 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498273 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/37f5d43f-9abe-4758-bba1-59ae699d42ec-kubelet-config\") pod \"global-pull-secret-syncer-clsk2\" (UID: \"37f5d43f-9abe-4758-bba1-59ae699d42ec\") " pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:02:53.499106 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498324 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/37f5d43f-9abe-4758-bba1-59ae699d42ec-dbus\") pod \"global-pull-secret-syncer-clsk2\" (UID: \"37f5d43f-9abe-4758-bba1-59ae699d42ec\") " pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:02:53.499106 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498350 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-run\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.499106 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498381 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-sys\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.499106 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fr52\" (UniqueName: \"kubernetes.io/projected/e3700ddc-af0f-48d6-81ff-d04001239309-kube-api-access-7fr52\") pod \"iptables-alerter-zdlqt\" (UID: \"e3700ddc-af0f-48d6-81ff-d04001239309\") " pod="openshift-network-operator/iptables-alerter-zdlqt" Jul 09 14:02:53.499106 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498436 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3700ddc-af0f-48d6-81ff-d04001239309-host-slash\") pod \"iptables-alerter-zdlqt\" (UID: \"e3700ddc-af0f-48d6-81ff-d04001239309\") " pod="openshift-network-operator/iptables-alerter-zdlqt" Jul 09 14:02:53.499106 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498460 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-run-ovn\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.499106 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498502 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99589261-6e32-45b6-8a5a-c3be040e781c-ovn-node-metrics-cert\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.499106 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498531 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38a844f5-ef21-4817-b365-3b852d56ca7c-system-cni-dir\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.499106 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498556 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pkrz\" (UniqueName: \"kubernetes.io/projected/38a844f5-ef21-4817-b365-3b852d56ca7c-kube-api-access-4pkrz\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.499106 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498600 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e3700ddc-af0f-48d6-81ff-d04001239309-host-slash\") pod \"iptables-alerter-zdlqt\" (UID: \"e3700ddc-af0f-48d6-81ff-d04001239309\") " pod="openshift-network-operator/iptables-alerter-zdlqt" Jul 09 14:02:53.499106 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498628 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4b0323a-b5d4-4ed7-82ef-c558ea06dc25-etc-selinux\") pod \"aws-ebs-csi-driver-node-dwxrs\" (UID: \"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.499106 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498660 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-etc-modprobe-d\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.499106 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498683 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-etc-sysconfig\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.500032 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498707 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-etc-sysctl-d\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.500032 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498809 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cc0b610-de8c-45a6-862f-8c859f4c7777-tmp-dir\") pod \"node-resolver-p8q9w\" (UID: \"6cc0b610-de8c-45a6-862f-8c859f4c7777\") " pod="openshift-dns/node-resolver-p8q9w" Jul 09 14:02:53.500032 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38a844f5-ef21-4817-b365-3b852d56ca7c-os-release\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.500032 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498934 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e4b0323a-b5d4-4ed7-82ef-c558ea06dc25-etc-selinux\") pod \"aws-ebs-csi-driver-node-dwxrs\" (UID: \"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.500032 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498971 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/38a844f5-ef21-4817-b365-3b852d56ca7c-system-cni-dir\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.500032 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.498978 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-run-systemd\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.500032 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499024 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/38a844f5-ef21-4817-b365-3b852d56ca7c-os-release\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.500032 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499069 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-log-socket\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.500032 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499101 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m59x9\" (UniqueName: \"kubernetes.io/projected/99589261-6e32-45b6-8a5a-c3be040e781c-kube-api-access-m59x9\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.500032 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499132 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-lib-modules\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.500032 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499142 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e3700ddc-af0f-48d6-81ff-d04001239309-iptables-alerter-script\") pod \"iptables-alerter-zdlqt\" (UID: \"e3700ddc-af0f-48d6-81ff-d04001239309\") " pod="openshift-network-operator/iptables-alerter-zdlqt" Jul 09 14:02:53.500032 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499157 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrrvk\" (UniqueName: \"kubernetes.io/projected/848147ce-53d7-44e7-af03-f2ae7fc34fe7-kube-api-access-qrrvk\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.500032 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499166 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6cc0b610-de8c-45a6-862f-8c859f4c7777-tmp-dir\") pod \"node-resolver-p8q9w\" (UID: \"6cc0b610-de8c-45a6-862f-8c859f4c7777\") " pod="openshift-dns/node-resolver-p8q9w" Jul 09 14:02:53.500032 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499186 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd9909a6-9743-4756-83ac-19b7bbdb0a72-host\") pod \"node-ca-qdfgv\" (UID: \"dd9909a6-9743-4756-83ac-19b7bbdb0a72\") " pod="openshift-image-registry/node-ca-qdfgv" Jul 09 14:02:53.500032 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499233 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-host-run-k8s-cni-cncf-io\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.500032 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499268 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-etc-openvswitch\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.500032 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499277 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-host-run-k8s-cni-cncf-io\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.500898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499299 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-cnibin\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.500898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499303 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/38a844f5-ef21-4817-b365-3b852d56ca7c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.500898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499340 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-hostroot\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.500898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4b0323a-b5d4-4ed7-82ef-c558ea06dc25-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dwxrs\" (UID: \"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.500898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499386 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-cnibin\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.500898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499389 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-etc-systemd\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.500898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499426 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-hostroot\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.500898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499434 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e4b0323a-b5d4-4ed7-82ef-c558ea06dc25-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dwxrs\" (UID: \"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.500898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499435 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4pc2\" (UniqueName: \"kubernetes.io/projected/dd9909a6-9743-4756-83ac-19b7bbdb0a72-kube-api-access-c4pc2\") pod \"node-ca-qdfgv\" (UID: \"dd9909a6-9743-4756-83ac-19b7bbdb0a72\") " pod="openshift-image-registry/node-ca-qdfgv" Jul 09 14:02:53.500898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499482 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-system-cni-dir\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.500898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-host-var-lib-cni-bin\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.500898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499543 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs\") pod \"network-metrics-daemon-sm7hq\" (UID: \"dd6bd814-79b7-4e7b-beeb-e04976f6d1d9\") " pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:02:53.500898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499622 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-host-var-lib-cni-bin\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.500898 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:53.499633 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:02:53.500898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499644 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38a844f5-ef21-4817-b365-3b852d56ca7c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.500898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499668 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-system-cni-dir\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.500898 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:53.499703 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs podName:dd6bd814-79b7-4e7b-beeb-e04976f6d1d9 nodeName:}" failed. No retries permitted until 2026-07-09 14:02:53.999682825 +0000 UTC m=+3.200183205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs") pod "network-metrics-daemon-sm7hq" (UID: "dd6bd814-79b7-4e7b-beeb-e04976f6d1d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:02:53.501708 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499764 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdp66\" (UniqueName: \"kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66\") pod \"network-check-target-dwp56\" (UID: \"2a03b990-06d4-4e07-8ef1-771f8b853040\") " pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:02:53.501708 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499893 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/38a844f5-ef21-4817-b365-3b852d56ca7c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.501708 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499896 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38a844f5-ef21-4817-b365-3b852d56ca7c-cnibin\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.501708 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499935 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38a844f5-ef21-4817-b365-3b852d56ca7c-cni-binary-copy\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.501708 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499974 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76x2n\" (UniqueName: \"kubernetes.io/projected/6cc0b610-de8c-45a6-862f-8c859f4c7777-kube-api-access-76x2n\") pod \"node-resolver-p8q9w\" (UID: \"6cc0b610-de8c-45a6-862f-8c859f4c7777\") " pod="openshift-dns/node-resolver-p8q9w" Jul 09 14:02:53.501708 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.499999 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef9e1e6f-f75a-466d-a03f-f27995d36263-cni-binary-copy\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.501708 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500016 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/38a844f5-ef21-4817-b365-3b852d56ca7c-cnibin\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.501708 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500025 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-multus-socket-dir-parent\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.501708 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500050 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-host-run-netns\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.501708 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500077 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4b0323a-b5d4-4ed7-82ef-c558ea06dc25-socket-dir\") pod \"aws-ebs-csi-driver-node-dwxrs\" (UID: \"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.501708 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500101 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4b0323a-b5d4-4ed7-82ef-c558ea06dc25-device-dir\") pod \"aws-ebs-csi-driver-node-dwxrs\" (UID: \"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.501708 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500127 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fbef93c8-131c-466f-a704-9afdd480b500-konnectivity-ca\") pod \"konnectivity-agent-mxk8s\" (UID: \"fbef93c8-131c-466f-a704-9afdd480b500\") " pod="kube-system/konnectivity-agent-mxk8s" Jul 09 14:02:53.501708 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500156 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-etc-kubernetes\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.501708 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500182 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-multus-conf-dir\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.501708 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500207 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef9e1e6f-f75a-466d-a03f-f27995d36263-multus-daemon-config\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.501708 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500236 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/38a844f5-ef21-4817-b365-3b852d56ca7c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.501708 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500264 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-host-kubelet\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.502254 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500276 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e4b0323a-b5d4-4ed7-82ef-c558ea06dc25-device-dir\") pod \"aws-ebs-csi-driver-node-dwxrs\" (UID: \"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.502254 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500288 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-systemd-units\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.502254 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500331 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-host-run-netns\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.502254 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500356 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-run-openvswitch\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.502254 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500383 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.502254 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-etc-kubernetes\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.502254 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500434 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2v2c\" (UniqueName: \"kubernetes.io/projected/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-kube-api-access-w2v2c\") pod \"network-metrics-daemon-sm7hq\" (UID: \"dd6bd814-79b7-4e7b-beeb-e04976f6d1d9\") " pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:02:53.502254 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500435 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/38a844f5-ef21-4817-b365-3b852d56ca7c-cni-binary-copy\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.502254 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500461 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksc5d\" (UniqueName: \"kubernetes.io/projected/e4b0323a-b5d4-4ed7-82ef-c558ea06dc25-kube-api-access-ksc5d\") pod \"aws-ebs-csi-driver-node-dwxrs\" (UID: \"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.502254 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500497 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-host-run-netns\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.502254 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500550 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-multus-socket-dir-parent\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.502254 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500638 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e4b0323a-b5d4-4ed7-82ef-c558ea06dc25-socket-dir\") pod \"aws-ebs-csi-driver-node-dwxrs\" (UID: \"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.502254 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500713 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-multus-conf-dir\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.502254 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500783 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef9e1e6f-f75a-466d-a03f-f27995d36263-cni-binary-copy\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.502254 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.500796 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef9e1e6f-f75a-466d-a03f-f27995d36263-etc-kubernetes\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.502254 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.501300 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/38a844f5-ef21-4817-b365-3b852d56ca7c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.502254 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.501794 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef9e1e6f-f75a-466d-a03f-f27995d36263-multus-daemon-config\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.505035 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.505001 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 14:02:53.507051 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:53.506544 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:02:53.507051 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:53.506565 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:02:53.507051 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:53.506577 2581 projected.go:196] Error preparing data for projected volume kube-api-access-kdp66 for pod openshift-network-diagnostics/network-check-target-dwp56: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:02:53.507051 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:53.506656 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66 podName:2a03b990-06d4-4e07-8ef1-771f8b853040 nodeName:}" failed. No retries permitted until 2026-07-09 14:02:54.006637516 +0000 UTC m=+3.207137870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kdp66" (UniqueName: "kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66") pod "network-check-target-dwp56" (UID: "2a03b990-06d4-4e07-8ef1-771f8b853040") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:02:53.510101 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.510077 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fr52\" (UniqueName: \"kubernetes.io/projected/e3700ddc-af0f-48d6-81ff-d04001239309-kube-api-access-7fr52\") pod \"iptables-alerter-zdlqt\" (UID: \"e3700ddc-af0f-48d6-81ff-d04001239309\") " pod="openshift-network-operator/iptables-alerter-zdlqt" Jul 09 14:02:53.510529 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.510506 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pkrz\" (UniqueName: \"kubernetes.io/projected/38a844f5-ef21-4817-b365-3b852d56ca7c-kube-api-access-4pkrz\") pod \"multus-additional-cni-plugins-7bknr\" (UID: \"38a844f5-ef21-4817-b365-3b852d56ca7c\") " pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.510947 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.510915 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76x2n\" (UniqueName: \"kubernetes.io/projected/6cc0b610-de8c-45a6-862f-8c859f4c7777-kube-api-access-76x2n\") pod \"node-resolver-p8q9w\" (UID: \"6cc0b610-de8c-45a6-862f-8c859f4c7777\") " pod="openshift-dns/node-resolver-p8q9w" Jul 09 14:02:53.512517 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.512493 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2v2c\" (UniqueName: \"kubernetes.io/projected/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-kube-api-access-w2v2c\") pod \"network-metrics-daemon-sm7hq\" (UID: \"dd6bd814-79b7-4e7b-beeb-e04976f6d1d9\") " pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:02:53.512604 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.512493 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksc5d\" (UniqueName: \"kubernetes.io/projected/e4b0323a-b5d4-4ed7-82ef-c558ea06dc25-kube-api-access-ksc5d\") pod \"aws-ebs-csi-driver-node-dwxrs\" (UID: \"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.513258 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.513235 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwsdq\" (UniqueName: \"kubernetes.io/projected/ef9e1e6f-f75a-466d-a03f-f27995d36263-kube-api-access-qwsdq\") pod \"multus-nnvq7\" (UID: \"ef9e1e6f-f75a-466d-a03f-f27995d36263\") " pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.565623 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.565567 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-107.ec2.internal" event={"ID":"45fa6098de5cf9fb647d955c2c5b37d2","Type":"ContainerStarted","Data":"783bf6fce8443cf88cbf6e5b6078b267a8397c4c06b448e904fc7245a5cdefec"} Jul 09 14:02:53.567156 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.567117 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-107.ec2.internal" event={"ID":"6817e2e237c40714ab072889b9b23a38","Type":"ContainerStarted","Data":"fea0a8079abedfda12c90ccfe722b9fe331be0062dfc14bcb2470be3dfa296bf"} Jul 09 14:02:53.601586 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.601543 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m59x9\" (UniqueName: \"kubernetes.io/projected/99589261-6e32-45b6-8a5a-c3be040e781c-kube-api-access-m59x9\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.601586 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.601585 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-lib-modules\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.601822 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.601614 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrrvk\" (UniqueName: \"kubernetes.io/projected/848147ce-53d7-44e7-af03-f2ae7fc34fe7-kube-api-access-qrrvk\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.601822 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.601634 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd9909a6-9743-4756-83ac-19b7bbdb0a72-host\") pod \"node-ca-qdfgv\" (UID: \"dd9909a6-9743-4756-83ac-19b7bbdb0a72\") " pod="openshift-image-registry/node-ca-qdfgv" Jul 09 14:02:53.601822 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.601656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-etc-openvswitch\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.601822 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.601692 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-etc-systemd\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.601822 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.601712 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4pc2\" (UniqueName: \"kubernetes.io/projected/dd9909a6-9743-4756-83ac-19b7bbdb0a72-kube-api-access-c4pc2\") pod \"node-ca-qdfgv\" (UID: \"dd9909a6-9743-4756-83ac-19b7bbdb0a72\") " pod="openshift-image-registry/node-ca-qdfgv" Jul 09 14:02:53.601822 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.601774 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fbef93c8-131c-466f-a704-9afdd480b500-konnectivity-ca\") pod \"konnectivity-agent-mxk8s\" (UID: \"fbef93c8-131c-466f-a704-9afdd480b500\") " pod="kube-system/konnectivity-agent-mxk8s" Jul 09 14:02:53.601822 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.601799 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-etc-kubernetes\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.602140 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.601826 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-host-kubelet\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.602140 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.601850 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-systemd-units\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.602140 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.601874 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-host-run-netns\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.602140 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.601897 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-run-openvswitch\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.602140 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.601922 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.602140 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99589261-6e32-45b6-8a5a-c3be040e781c-env-overrides\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.602140 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602035 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-etc-sysctl-conf\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.602140 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602059 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd9909a6-9743-4756-83ac-19b7bbdb0a72-serviceca\") pod \"node-ca-qdfgv\" (UID: \"dd9909a6-9743-4756-83ac-19b7bbdb0a72\") " pod="openshift-image-registry/node-ca-qdfgv" Jul 09 14:02:53.602140 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602087 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-host-slash\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.602140 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602111 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99589261-6e32-45b6-8a5a-c3be040e781c-ovnkube-config\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.602140 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602136 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-var-lib-kubelet\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.602651 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602163 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-host-cni-netd\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.602651 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602183 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret\") pod \"global-pull-secret-syncer-clsk2\" (UID: \"37f5d43f-9abe-4758-bba1-59ae699d42ec\") " pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:02:53.602651 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602201 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-host\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.602651 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602276 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99589261-6e32-45b6-8a5a-c3be040e781c-ovnkube-script-lib\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.602651 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602295 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fbef93c8-131c-466f-a704-9afdd480b500-agent-certs\") pod \"konnectivity-agent-mxk8s\" (UID: \"fbef93c8-131c-466f-a704-9afdd480b500\") " pod="kube-system/konnectivity-agent-mxk8s" Jul 09 14:02:53.602651 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602334 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-node-log\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.602651 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602340 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-systemd-units\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.602651 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602351 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-host-run-ovn-kubernetes\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.602651 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-host-cni-bin\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.602651 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602388 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/848147ce-53d7-44e7-af03-f2ae7fc34fe7-etc-tuned\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.602651 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602404 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/848147ce-53d7-44e7-af03-f2ae7fc34fe7-tmp\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.602651 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602423 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-var-lib-openvswitch\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.602651 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602438 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/37f5d43f-9abe-4758-bba1-59ae699d42ec-kubelet-config\") pod \"global-pull-secret-syncer-clsk2\" (UID: \"37f5d43f-9abe-4758-bba1-59ae699d42ec\") " pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:02:53.602651 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602492 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/37f5d43f-9abe-4758-bba1-59ae699d42ec-dbus\") pod \"global-pull-secret-syncer-clsk2\" (UID: \"37f5d43f-9abe-4758-bba1-59ae699d42ec\") " pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:02:53.602651 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602515 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-run\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.602651 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-sys\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.602651 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602577 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-run-ovn\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.602651 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602601 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99589261-6e32-45b6-8a5a-c3be040e781c-ovn-node-metrics-cert\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.603793 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602624 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-etc-modprobe-d\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.603793 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602709 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-lib-modules\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.603793 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602848 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-etc-modprobe-d\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.603793 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602924 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd9909a6-9743-4756-83ac-19b7bbdb0a72-host\") pod \"node-ca-qdfgv\" (UID: \"dd9909a6-9743-4756-83ac-19b7bbdb0a72\") " pod="openshift-image-registry/node-ca-qdfgv" Jul 09 14:02:53.603793 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.602986 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-etc-openvswitch\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.603793 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.603038 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-etc-systemd\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.603793 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.603346 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99589261-6e32-45b6-8a5a-c3be040e781c-ovnkube-script-lib\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.603793 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.603396 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-etc-sysconfig\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.603793 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.603422 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-etc-sysctl-d\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.603793 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.603473 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-run-systemd\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.603793 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.603499 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-log-socket\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.603793 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.603583 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-log-socket\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.603793 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.603625 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-host-run-netns\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.603793 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.603665 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-run-openvswitch\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.603793 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.603719 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.603793 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.603742 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fbef93c8-131c-466f-a704-9afdd480b500-konnectivity-ca\") pod \"konnectivity-agent-mxk8s\" (UID: \"fbef93c8-131c-466f-a704-9afdd480b500\") " pod="kube-system/konnectivity-agent-mxk8s" Jul 09 14:02:53.604657 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.603895 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-etc-sysctl-conf\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.604657 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.603989 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-node-log\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.604657 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.604049 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-host-run-ovn-kubernetes\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.604657 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.604086 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99589261-6e32-45b6-8a5a-c3be040e781c-env-overrides\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.604657 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.604097 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-host-cni-bin\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.604657 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.604149 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-etc-kubernetes\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.604657 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.604191 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-host-kubelet\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.604657 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.604284 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/37f5d43f-9abe-4758-bba1-59ae699d42ec-dbus\") pod \"global-pull-secret-syncer-clsk2\" (UID: \"37f5d43f-9abe-4758-bba1-59ae699d42ec\") " pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:02:53.604657 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.604345 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd9909a6-9743-4756-83ac-19b7bbdb0a72-serviceca\") pod \"node-ca-qdfgv\" (UID: \"dd9909a6-9743-4756-83ac-19b7bbdb0a72\") " pod="openshift-image-registry/node-ca-qdfgv" Jul 09 14:02:53.604657 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.604407 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-host-slash\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.605118 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.604920 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99589261-6e32-45b6-8a5a-c3be040e781c-ovnkube-config\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.605118 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.604947 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-var-lib-openvswitch\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.605118 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.605009 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-var-lib-kubelet\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.605118 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.605029 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/37f5d43f-9abe-4758-bba1-59ae699d42ec-kubelet-config\") pod \"global-pull-secret-syncer-clsk2\" (UID: \"37f5d43f-9abe-4758-bba1-59ae699d42ec\") " pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:02:53.605118 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.605057 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-host-cni-netd\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.605365 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:53.605142 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:02:53.605365 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:53.605224 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret podName:37f5d43f-9abe-4758-bba1-59ae699d42ec nodeName:}" failed. No retries permitted until 2026-07-09 14:02:54.105205373 +0000 UTC m=+3.305705734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret") pod "global-pull-secret-syncer-clsk2" (UID: "37f5d43f-9abe-4758-bba1-59ae699d42ec") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:02:53.605487 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.605469 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-host\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.605543 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.605523 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-etc-sysconfig\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.606066 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.605627 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-etc-sysctl-d\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.606066 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.605643 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-run\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.606066 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.605692 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-run-systemd\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.606066 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.605691 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99589261-6e32-45b6-8a5a-c3be040e781c-run-ovn\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.606066 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.605745 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/848147ce-53d7-44e7-af03-f2ae7fc34fe7-sys\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.606066 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.605854 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fbef93c8-131c-466f-a704-9afdd480b500-agent-certs\") pod \"konnectivity-agent-mxk8s\" (UID: \"fbef93c8-131c-466f-a704-9afdd480b500\") " pod="kube-system/konnectivity-agent-mxk8s" Jul 09 14:02:53.606726 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.606659 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/848147ce-53d7-44e7-af03-f2ae7fc34fe7-tmp\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.606958 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.606938 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/848147ce-53d7-44e7-af03-f2ae7fc34fe7-etc-tuned\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.611452 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.611299 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m59x9\" (UniqueName: \"kubernetes.io/projected/99589261-6e32-45b6-8a5a-c3be040e781c-kube-api-access-m59x9\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.611989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.611858 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99589261-6e32-45b6-8a5a-c3be040e781c-ovn-node-metrics-cert\") pod \"ovnkube-node-rnqq6\" (UID: \"99589261-6e32-45b6-8a5a-c3be040e781c\") " pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.611989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.611885 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4pc2\" (UniqueName: \"kubernetes.io/projected/dd9909a6-9743-4756-83ac-19b7bbdb0a72-kube-api-access-c4pc2\") pod \"node-ca-qdfgv\" (UID: \"dd9909a6-9743-4756-83ac-19b7bbdb0a72\") " pod="openshift-image-registry/node-ca-qdfgv" Jul 09 14:02:53.611989 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.611960 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrrvk\" (UniqueName: \"kubernetes.io/projected/848147ce-53d7-44e7-af03-f2ae7fc34fe7-kube-api-access-qrrvk\") pod \"tuned-qs4b4\" (UID: \"848147ce-53d7-44e7-af03-f2ae7fc34fe7\") " pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.693120 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.693047 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zdlqt" Jul 09 14:02:53.706586 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.706554 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7bknr" Jul 09 14:02:53.716744 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.716720 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" Jul 09 14:02:53.724608 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.724577 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p8q9w" Jul 09 14:02:53.732528 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.732501 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nnvq7" Jul 09 14:02:53.742566 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.742537 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mxk8s" Jul 09 14:02:53.748605 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.748584 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" Jul 09 14:02:53.757534 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.757507 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:02:53.765761 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:53.765736 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qdfgv" Jul 09 14:02:54.006855 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:54.006775 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs\") pod \"network-metrics-daemon-sm7hq\" (UID: \"dd6bd814-79b7-4e7b-beeb-e04976f6d1d9\") " pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:02:54.006855 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:54.006820 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdp66\" (UniqueName: \"kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66\") pod \"network-check-target-dwp56\" (UID: \"2a03b990-06d4-4e07-8ef1-771f8b853040\") " pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:02:54.007071 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:54.006999 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:02:54.007071 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:54.007002 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:02:54.007071 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:54.007033 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:02:54.007071 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:54.007050 2581 projected.go:196] Error preparing data for projected volume kube-api-access-kdp66 for pod openshift-network-diagnostics/network-check-target-dwp56: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:02:54.007249 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:54.007186 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs podName:dd6bd814-79b7-4e7b-beeb-e04976f6d1d9 nodeName:}" failed. No retries permitted until 2026-07-09 14:02:55.007143466 +0000 UTC m=+4.207643822 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs") pod "network-metrics-daemon-sm7hq" (UID: "dd6bd814-79b7-4e7b-beeb-e04976f6d1d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:02:54.007304 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:54.007250 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66 podName:2a03b990-06d4-4e07-8ef1-771f8b853040 nodeName:}" failed. No retries permitted until 2026-07-09 14:02:55.007229752 +0000 UTC m=+4.207730118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kdp66" (UniqueName: "kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66") pod "network-check-target-dwp56" (UID: "2a03b990-06d4-4e07-8ef1-771f8b853040") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:02:54.107281 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:54.107247 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret\") pod \"global-pull-secret-syncer-clsk2\" (UID: \"37f5d43f-9abe-4758-bba1-59ae699d42ec\") " pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:02:54.107479 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:54.107449 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:02:54.107570 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:54.107556 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret podName:37f5d43f-9abe-4758-bba1-59ae699d42ec nodeName:}" failed. No retries permitted until 2026-07-09 14:02:55.10754002 +0000 UTC m=+4.308040373 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret") pod "global-pull-secret-syncer-clsk2" (UID: "37f5d43f-9abe-4758-bba1-59ae699d42ec") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:02:54.435638 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:54.435536 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 13:57:53 +0000 UTC" deadline="2028-01-29 15:46:47.246906752 +0000 UTC" Jul 09 14:02:54.435638 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:54.435587 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13657h43m52.811323505s" Jul 09 14:02:54.559203 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:54.559165 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:02:54.559402 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:54.559329 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sm7hq" podUID="dd6bd814-79b7-4e7b-beeb-e04976f6d1d9" Jul 09 14:02:54.654171 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:54.654130 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc0b610_de8c_45a6_862f_8c859f4c7777.slice/crio-e2fb2ee54a38f04a23bba5072a7645c56e83c534bf23f0c42e36efe8477bf0d9 WatchSource:0}: Error finding container e2fb2ee54a38f04a23bba5072a7645c56e83c534bf23f0c42e36efe8477bf0d9: Status 404 returned error can't find the container with id e2fb2ee54a38f04a23bba5072a7645c56e83c534bf23f0c42e36efe8477bf0d9 Jul 09 14:02:54.655713 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:54.655680 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3700ddc_af0f_48d6_81ff_d04001239309.slice/crio-06198f125eb1ba267b933c0aa85e548d7bf96e9e64e035cbbe13e48e9308a0ca WatchSource:0}: Error finding container 06198f125eb1ba267b933c0aa85e548d7bf96e9e64e035cbbe13e48e9308a0ca: Status 404 returned error can't find the container with id 06198f125eb1ba267b933c0aa85e548d7bf96e9e64e035cbbe13e48e9308a0ca Jul 09 14:02:54.656615 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:54.656595 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38a844f5_ef21_4817_b365_3b852d56ca7c.slice/crio-c6fcf42620e3c12d704b70e04ca5781e0fe84a51e5547a8a91a8915db50782ad WatchSource:0}: Error finding container c6fcf42620e3c12d704b70e04ca5781e0fe84a51e5547a8a91a8915db50782ad: Status 404 returned error can't find the container with id c6fcf42620e3c12d704b70e04ca5781e0fe84a51e5547a8a91a8915db50782ad Jul 09 14:02:54.661228 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:54.661205 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b0323a_b5d4_4ed7_82ef_c558ea06dc25.slice/crio-de36255b1e6edcb9df13d2e2c5c92ed854a82e15609a8dc89e88c226df9db005 WatchSource:0}: Error finding container de36255b1e6edcb9df13d2e2c5c92ed854a82e15609a8dc89e88c226df9db005: Status 404 returned error can't find the container with id de36255b1e6edcb9df13d2e2c5c92ed854a82e15609a8dc89e88c226df9db005 Jul 09 14:02:54.662912 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:54.662888 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbef93c8_131c_466f_a704_9afdd480b500.slice/crio-5ee7fccec6421b44ec924a0fb8d88e06e7e1af82f7cf6a7d6afe14e070d59736 WatchSource:0}: Error finding container 5ee7fccec6421b44ec924a0fb8d88e06e7e1af82f7cf6a7d6afe14e070d59736: Status 404 returned error can't find the container with id 5ee7fccec6421b44ec924a0fb8d88e06e7e1af82f7cf6a7d6afe14e070d59736 Jul 09 14:02:54.664747 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:54.664636 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod848147ce_53d7_44e7_af03_f2ae7fc34fe7.slice/crio-fe45083f720b135805a5bc1d4d0c38ed00c3b7cff7dd67800ea1f5a4297ac800 WatchSource:0}: Error finding container fe45083f720b135805a5bc1d4d0c38ed00c3b7cff7dd67800ea1f5a4297ac800: Status 404 returned error can't find the container with id fe45083f720b135805a5bc1d4d0c38ed00c3b7cff7dd67800ea1f5a4297ac800 Jul 09 14:02:54.666051 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:54.666021 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99589261_6e32_45b6_8a5a_c3be040e781c.slice/crio-da0ef96e20eb6d247a31b6fd185e223a72104ea2493c57940e59f6189512e62f WatchSource:0}: Error finding container da0ef96e20eb6d247a31b6fd185e223a72104ea2493c57940e59f6189512e62f: Status 404 returned error can't find the container with id da0ef96e20eb6d247a31b6fd185e223a72104ea2493c57940e59f6189512e62f Jul 09 14:02:54.668279 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:54.668256 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef9e1e6f_f75a_466d_a03f_f27995d36263.slice/crio-20074904a78f7a2ea67d44ea352739f8373b9d6d5fc14867b9d7db04a0e5066e WatchSource:0}: Error finding container 20074904a78f7a2ea67d44ea352739f8373b9d6d5fc14867b9d7db04a0e5066e: Status 404 returned error can't find the container with id 20074904a78f7a2ea67d44ea352739f8373b9d6d5fc14867b9d7db04a0e5066e Jul 09 14:02:54.669298 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:02:54.669277 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd9909a6_9743_4756_83ac_19b7bbdb0a72.slice/crio-cb003e0cbc5f4ea99a15ad94be5b0944183b312cbeb5c5169d6c2c01983f73ea WatchSource:0}: Error finding container cb003e0cbc5f4ea99a15ad94be5b0944183b312cbeb5c5169d6c2c01983f73ea: Status 404 returned error can't find the container with id cb003e0cbc5f4ea99a15ad94be5b0944183b312cbeb5c5169d6c2c01983f73ea Jul 09 14:02:55.014918 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:55.014611 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs\") pod \"network-metrics-daemon-sm7hq\" (UID: \"dd6bd814-79b7-4e7b-beeb-e04976f6d1d9\") " pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:02:55.014918 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:55.014872 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdp66\" (UniqueName: \"kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66\") pod \"network-check-target-dwp56\" (UID: \"2a03b990-06d4-4e07-8ef1-771f8b853040\") " pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:02:55.015133 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:55.014772 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:02:55.015133 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:55.015002 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs podName:dd6bd814-79b7-4e7b-beeb-e04976f6d1d9 nodeName:}" failed. No retries permitted until 2026-07-09 14:02:57.014984051 +0000 UTC m=+6.215484403 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs") pod "network-metrics-daemon-sm7hq" (UID: "dd6bd814-79b7-4e7b-beeb-e04976f6d1d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:02:55.015133 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:55.015055 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:02:55.015133 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:55.015076 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:02:55.015133 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:55.015089 2581 projected.go:196] Error preparing data for projected volume kube-api-access-kdp66 for pod openshift-network-diagnostics/network-check-target-dwp56: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:02:55.015485 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:55.015137 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66 podName:2a03b990-06d4-4e07-8ef1-771f8b853040 nodeName:}" failed. No retries permitted until 2026-07-09 14:02:57.015123315 +0000 UTC m=+6.215623673 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kdp66" (UniqueName: "kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66") pod "network-check-target-dwp56" (UID: "2a03b990-06d4-4e07-8ef1-771f8b853040") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:02:55.115912 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:55.115875 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret\") pod \"global-pull-secret-syncer-clsk2\" (UID: \"37f5d43f-9abe-4758-bba1-59ae699d42ec\") " pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:02:55.116105 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:55.116033 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:02:55.116105 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:55.116100 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret podName:37f5d43f-9abe-4758-bba1-59ae699d42ec nodeName:}" failed. No retries permitted until 2026-07-09 14:02:57.116082614 +0000 UTC m=+6.316582967 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret") pod "global-pull-secret-syncer-clsk2" (UID: "37f5d43f-9abe-4758-bba1-59ae699d42ec") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:02:55.436660 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:55.436539 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 13:57:53 +0000 UTC" deadline="2028-03-11 23:22:35.93728609 +0000 UTC" Jul 09 14:02:55.436660 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:55.436576 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14673h19m40.500715146s" Jul 09 14:02:55.560709 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:55.560437 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:02:55.560709 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:55.560572 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clsk2" podUID="37f5d43f-9abe-4758-bba1-59ae699d42ec" Jul 09 14:02:55.560709 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:55.560611 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:02:55.560709 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:55.560679 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwp56" podUID="2a03b990-06d4-4e07-8ef1-771f8b853040" Jul 09 14:02:55.595361 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:55.595238 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bknr" event={"ID":"38a844f5-ef21-4817-b365-3b852d56ca7c","Type":"ContainerStarted","Data":"c6fcf42620e3c12d704b70e04ca5781e0fe84a51e5547a8a91a8915db50782ad"} Jul 09 14:02:55.599177 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:55.598369 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zdlqt" event={"ID":"e3700ddc-af0f-48d6-81ff-d04001239309","Type":"ContainerStarted","Data":"06198f125eb1ba267b933c0aa85e548d7bf96e9e64e035cbbe13e48e9308a0ca"} Jul 09 14:02:55.600224 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:55.600194 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p8q9w" event={"ID":"6cc0b610-de8c-45a6-862f-8c859f4c7777","Type":"ContainerStarted","Data":"e2fb2ee54a38f04a23bba5072a7645c56e83c534bf23f0c42e36efe8477bf0d9"} Jul 09 14:02:55.607357 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:55.607326 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-107.ec2.internal" event={"ID":"6817e2e237c40714ab072889b9b23a38","Type":"ContainerStarted","Data":"e0563f50025ff3107f5cc0bfca02430911394694d387bfaff38f432a440afc52"} Jul 09 14:02:55.613560 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:55.613530 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nnvq7" event={"ID":"ef9e1e6f-f75a-466d-a03f-f27995d36263","Type":"ContainerStarted","Data":"20074904a78f7a2ea67d44ea352739f8373b9d6d5fc14867b9d7db04a0e5066e"} Jul 09 14:02:55.621137 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:55.621108 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" event={"ID":"99589261-6e32-45b6-8a5a-c3be040e781c","Type":"ContainerStarted","Data":"da0ef96e20eb6d247a31b6fd185e223a72104ea2493c57940e59f6189512e62f"} Jul 09 14:02:55.624606 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:55.624555 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-107.ec2.internal" podStartSLOduration=3.624534846 podStartE2EDuration="3.624534846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:02:55.623391489 +0000 UTC m=+4.823891863" watchObservedRunningTime="2026-07-09 14:02:55.624534846 +0000 UTC m=+4.825035223" Jul 09 14:02:55.632886 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:55.632843 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" event={"ID":"848147ce-53d7-44e7-af03-f2ae7fc34fe7","Type":"ContainerStarted","Data":"fe45083f720b135805a5bc1d4d0c38ed00c3b7cff7dd67800ea1f5a4297ac800"} Jul 09 14:02:55.636922 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:55.636853 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" event={"ID":"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25","Type":"ContainerStarted","Data":"de36255b1e6edcb9df13d2e2c5c92ed854a82e15609a8dc89e88c226df9db005"} Jul 09 14:02:55.644439 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:55.644410 2581 generic.go:356] "Generic (PLEG): container finished" podID="45fa6098de5cf9fb647d955c2c5b37d2" containerID="c6aec768a20e1bb7f489b0db557e0ea4a4e0ac3340d998a72a876acdf98ccc66" exitCode=0 Jul 09 14:02:55.644616 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:55.644590 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-107.ec2.internal" event={"ID":"45fa6098de5cf9fb647d955c2c5b37d2","Type":"ContainerDied","Data":"c6aec768a20e1bb7f489b0db557e0ea4a4e0ac3340d998a72a876acdf98ccc66"} Jul 09 14:02:55.669961 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:55.669897 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qdfgv" event={"ID":"dd9909a6-9743-4756-83ac-19b7bbdb0a72","Type":"ContainerStarted","Data":"cb003e0cbc5f4ea99a15ad94be5b0944183b312cbeb5c5169d6c2c01983f73ea"} Jul 09 14:02:55.691760 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:55.691634 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mxk8s" event={"ID":"fbef93c8-131c-466f-a704-9afdd480b500","Type":"ContainerStarted","Data":"5ee7fccec6421b44ec924a0fb8d88e06e7e1af82f7cf6a7d6afe14e070d59736"} Jul 09 14:02:56.559443 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:56.559408 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:02:56.559984 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:56.559550 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sm7hq" podUID="dd6bd814-79b7-4e7b-beeb-e04976f6d1d9" Jul 09 14:02:56.701669 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:56.701596 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-107.ec2.internal" event={"ID":"45fa6098de5cf9fb647d955c2c5b37d2","Type":"ContainerStarted","Data":"ece7e061655a0e9d205d0d77f7fb5f1d79e5a3c77ef54a176880786ca53305c4"} Jul 09 14:02:57.034497 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:57.033616 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs\") pod \"network-metrics-daemon-sm7hq\" (UID: \"dd6bd814-79b7-4e7b-beeb-e04976f6d1d9\") " pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:02:57.034497 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:57.033675 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdp66\" (UniqueName: \"kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66\") pod \"network-check-target-dwp56\" (UID: \"2a03b990-06d4-4e07-8ef1-771f8b853040\") " pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:02:57.034497 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:57.033856 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:02:57.034497 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:57.033877 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:02:57.034497 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:57.033889 2581 projected.go:196] Error preparing data for projected volume kube-api-access-kdp66 for pod openshift-network-diagnostics/network-check-target-dwp56: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:02:57.034497 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:57.033947 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66 podName:2a03b990-06d4-4e07-8ef1-771f8b853040 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:01.03392916 +0000 UTC m=+10.234429513 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kdp66" (UniqueName: "kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66") pod "network-check-target-dwp56" (UID: "2a03b990-06d4-4e07-8ef1-771f8b853040") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:02:57.034497 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:57.034363 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:02:57.034497 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:57.034416 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs podName:dd6bd814-79b7-4e7b-beeb-e04976f6d1d9 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:01.034398868 +0000 UTC m=+10.234899231 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs") pod "network-metrics-daemon-sm7hq" (UID: "dd6bd814-79b7-4e7b-beeb-e04976f6d1d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:02:57.134400 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:57.134361 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret\") pod \"global-pull-secret-syncer-clsk2\" (UID: \"37f5d43f-9abe-4758-bba1-59ae699d42ec\") " pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:02:57.134672 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:57.134650 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:02:57.134750 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:57.134718 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret podName:37f5d43f-9abe-4758-bba1-59ae699d42ec nodeName:}" failed. No retries permitted until 2026-07-09 14:03:01.134700096 +0000 UTC m=+10.335200452 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret") pod "global-pull-secret-syncer-clsk2" (UID: "37f5d43f-9abe-4758-bba1-59ae699d42ec") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:02:57.561467 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:57.561428 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:02:57.561910 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:57.561559 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clsk2" podUID="37f5d43f-9abe-4758-bba1-59ae699d42ec" Jul 09 14:02:57.561987 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:57.561922 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:02:57.562041 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:57.562026 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwp56" podUID="2a03b990-06d4-4e07-8ef1-771f8b853040" Jul 09 14:02:58.559704 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:58.559150 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:02:58.559704 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:58.559326 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sm7hq" podUID="dd6bd814-79b7-4e7b-beeb-e04976f6d1d9" Jul 09 14:02:59.559522 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:59.559485 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:02:59.559961 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:59.559610 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwp56" podUID="2a03b990-06d4-4e07-8ef1-771f8b853040" Jul 09 14:02:59.559961 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:02:59.559629 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:02:59.559961 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:02:59.559697 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clsk2" podUID="37f5d43f-9abe-4758-bba1-59ae699d42ec" Jul 09 14:03:00.559530 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:00.559486 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:00.559720 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:00.559643 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sm7hq" podUID="dd6bd814-79b7-4e7b-beeb-e04976f6d1d9" Jul 09 14:03:01.071526 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:01.071481 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs\") pod \"network-metrics-daemon-sm7hq\" (UID: \"dd6bd814-79b7-4e7b-beeb-e04976f6d1d9\") " pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:01.071720 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:01.071542 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdp66\" (UniqueName: \"kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66\") pod \"network-check-target-dwp56\" (UID: \"2a03b990-06d4-4e07-8ef1-771f8b853040\") " pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:03:01.071720 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:01.071704 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:03:01.071823 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:01.071728 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:03:01.071823 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:01.071742 2581 projected.go:196] Error preparing data for projected volume kube-api-access-kdp66 for pod openshift-network-diagnostics/network-check-target-dwp56: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:03:01.071823 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:01.071799 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66 podName:2a03b990-06d4-4e07-8ef1-771f8b853040 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:09.071779907 +0000 UTC m=+18.272280285 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kdp66" (UniqueName: "kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66") pod "network-check-target-dwp56" (UID: "2a03b990-06d4-4e07-8ef1-771f8b853040") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:03:01.071984 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:01.071870 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:03:01.071984 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:01.071902 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs podName:dd6bd814-79b7-4e7b-beeb-e04976f6d1d9 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:09.071889949 +0000 UTC m=+18.272390317 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs") pod "network-metrics-daemon-sm7hq" (UID: "dd6bd814-79b7-4e7b-beeb-e04976f6d1d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:03:01.172290 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:01.172234 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret\") pod \"global-pull-secret-syncer-clsk2\" (UID: \"37f5d43f-9abe-4758-bba1-59ae699d42ec\") " pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:03:01.172493 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:01.172422 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:03:01.172557 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:01.172500 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret podName:37f5d43f-9abe-4758-bba1-59ae699d42ec nodeName:}" failed. No retries permitted until 2026-07-09 14:03:09.17248076 +0000 UTC m=+18.372981125 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret") pod "global-pull-secret-syncer-clsk2" (UID: "37f5d43f-9abe-4758-bba1-59ae699d42ec") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:03:01.560242 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:01.560163 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:03:01.560687 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:01.560279 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clsk2" podUID="37f5d43f-9abe-4758-bba1-59ae699d42ec" Jul 09 14:03:01.560687 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:01.560673 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:03:01.560795 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:01.560759 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwp56" podUID="2a03b990-06d4-4e07-8ef1-771f8b853040" Jul 09 14:03:02.559683 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:02.559557 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:02.559854 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:02.559709 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sm7hq" podUID="dd6bd814-79b7-4e7b-beeb-e04976f6d1d9" Jul 09 14:03:03.560333 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:03.559661 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:03:03.560333 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:03.559662 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:03:03.560333 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:03.559808 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clsk2" podUID="37f5d43f-9abe-4758-bba1-59ae699d42ec" Jul 09 14:03:03.560333 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:03.559849 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwp56" podUID="2a03b990-06d4-4e07-8ef1-771f8b853040" Jul 09 14:03:04.559488 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:04.559451 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:04.559670 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:04.559577 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sm7hq" podUID="dd6bd814-79b7-4e7b-beeb-e04976f6d1d9" Jul 09 14:03:05.560753 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:05.560503 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:03:05.561233 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:05.560860 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwp56" podUID="2a03b990-06d4-4e07-8ef1-771f8b853040" Jul 09 14:03:05.561292 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:05.561265 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:03:05.561410 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:05.561385 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clsk2" podUID="37f5d43f-9abe-4758-bba1-59ae699d42ec" Jul 09 14:03:05.736859 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:05.736817 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qdfgv" event={"ID":"dd9909a6-9743-4756-83ac-19b7bbdb0a72","Type":"ContainerStarted","Data":"570fe6773693ff14af1fd23e1fadbb0638dce451a920a587f8e5fe2d64ca7107"} Jul 09 14:03:05.738495 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:05.738464 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mxk8s" event={"ID":"fbef93c8-131c-466f-a704-9afdd480b500","Type":"ContainerStarted","Data":"a1ce132e4f8279e3611431de8b79b6059b4be2baee17270f8db2022ab74156cd"} Jul 09 14:03:05.740297 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:05.740262 2581 generic.go:356] "Generic (PLEG): container finished" podID="38a844f5-ef21-4817-b365-3b852d56ca7c" containerID="63fae25f18feea56cbe1b4e427d5985a8391b26933bc832f3f45c139fab7bfa2" exitCode=0 Jul 09 14:03:05.740421 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:05.740347 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bknr" event={"ID":"38a844f5-ef21-4817-b365-3b852d56ca7c","Type":"ContainerDied","Data":"63fae25f18feea56cbe1b4e427d5985a8391b26933bc832f3f45c139fab7bfa2"} Jul 09 14:03:05.741938 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:05.741913 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p8q9w" event={"ID":"6cc0b610-de8c-45a6-862f-8c859f4c7777","Type":"ContainerStarted","Data":"5c8ecfa0d661be83eb7474c5f822af0fc17d1b6455ce3ed11065e4713cfae0cc"} Jul 09 14:03:05.743908 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:05.743881 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" event={"ID":"848147ce-53d7-44e7-af03-f2ae7fc34fe7","Type":"ContainerStarted","Data":"2f65bdf5e0955b6b0cc1f6be9421e0da0bcac84f98b101fa664c0952c7e24ad3"} Jul 09 14:03:05.745525 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:05.745504 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" event={"ID":"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25","Type":"ContainerStarted","Data":"10c12580712f3821c32199a9bd0b27f570975f4c6e55cdd840e48ded10cae2f4"} Jul 09 14:03:05.762274 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:05.762223 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qdfgv" podStartSLOduration=4.811311092 podStartE2EDuration="14.76220656s" totalImagesPullingTime="9.950895468s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:05.761850701 +0000 UTC m=+14.962351093" watchObservedRunningTime="2026-07-09 14:03:05.76220656 +0000 UTC m=+14.962706933" Jul 09 14:03:05.762428 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:05.762300 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-107.ec2.internal" podStartSLOduration=13.762294791 podStartE2EDuration="13.762294791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:02:56.71924524 +0000 UTC m=+5.919745629" watchObservedRunningTime="2026-07-09 14:03:05.762294791 +0000 UTC m=+14.962795165" Jul 09 14:03:05.806918 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:05.806865 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p8q9w" podStartSLOduration=4.838391615 podStartE2EDuration="14.806849378s" totalImagesPullingTime="9.968457763s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:05.80649573 +0000 UTC m=+15.006996106" watchObservedRunningTime="2026-07-09 14:03:05.806849378 +0000 UTC m=+15.007349751" Jul 09 14:03:05.822860 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:05.822763 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mxk8s" podStartSLOduration=4.888661314 podStartE2EDuration="14.822746053s" totalImagesPullingTime="9.934084739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:05.822350445 +0000 UTC m=+15.022850821" watchObservedRunningTime="2026-07-09 14:03:05.822746053 +0000 UTC m=+15.023246427" Jul 09 14:03:05.838926 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:05.838871 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qs4b4" podStartSLOduration=4.848139186 podStartE2EDuration="14.838856735s" totalImagesPullingTime="9.990717549s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:05.838517758 +0000 UTC m=+15.039018132" watchObservedRunningTime="2026-07-09 14:03:05.838856735 +0000 UTC m=+15.039357108" Jul 09 14:03:05.872795 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:05.872762 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:05.934991 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:05.934961 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:06.559825 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:06.559793 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:06.559968 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:06.559907 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sm7hq" podUID="dd6bd814-79b7-4e7b-beeb-e04976f6d1d9" Jul 09 14:03:06.749492 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:06.749457 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zdlqt" event={"ID":"e3700ddc-af0f-48d6-81ff-d04001239309","Type":"ContainerStarted","Data":"966a44ba9b9ceb7e80982eff8e197cd79143840ee705dcc18d718ccdd5612f6f"} Jul 09 14:03:06.766564 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:06.766505 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zdlqt" podStartSLOduration=5.821212736 podStartE2EDuration="15.766486608s" totalImagesPullingTime="9.945273872s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:06.766130012 +0000 UTC m=+15.966630387" watchObservedRunningTime="2026-07-09 14:03:06.766486608 +0000 UTC m=+15.966986987" Jul 09 14:03:06.892638 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:06.892573 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:06.954414 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:06.954378 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:07.559385 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:07.559357 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:03:07.559554 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:07.559357 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:03:07.559614 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:07.559487 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwp56" podUID="2a03b990-06d4-4e07-8ef1-771f8b853040" Jul 09 14:03:07.559664 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:07.559611 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clsk2" podUID="37f5d43f-9abe-4758-bba1-59ae699d42ec" Jul 09 14:03:07.907734 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:07.907653 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:08.559604 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:08.559569 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:08.559777 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:08.559716 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sm7hq" podUID="dd6bd814-79b7-4e7b-beeb-e04976f6d1d9" Jul 09 14:03:08.729531 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:08.729485 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mxk8s" Jul 09 14:03:09.130793 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:09.130760 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mxk8s" Jul 09 14:03:09.131669 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:09.131648 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mxk8s" Jul 09 14:03:09.137800 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:09.137764 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs\") pod \"network-metrics-daemon-sm7hq\" (UID: \"dd6bd814-79b7-4e7b-beeb-e04976f6d1d9\") " pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:09.137965 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:09.137814 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdp66\" (UniqueName: \"kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66\") pod \"network-check-target-dwp56\" (UID: \"2a03b990-06d4-4e07-8ef1-771f8b853040\") " pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:03:09.137965 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:09.137932 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:03:09.137965 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:09.137959 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:03:09.138088 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:09.137974 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:03:09.138088 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:09.137987 2581 projected.go:196] Error preparing data for projected volume kube-api-access-kdp66 for pod openshift-network-diagnostics/network-check-target-dwp56: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:03:09.138088 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:09.138010 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs podName:dd6bd814-79b7-4e7b-beeb-e04976f6d1d9 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:25.137989177 +0000 UTC m=+34.338489535 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs") pod "network-metrics-daemon-sm7hq" (UID: "dd6bd814-79b7-4e7b-beeb-e04976f6d1d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:03:09.138088 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:09.138030 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66 podName:2a03b990-06d4-4e07-8ef1-771f8b853040 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:25.13801959 +0000 UTC m=+34.338519944 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kdp66" (UniqueName: "kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66") pod "network-check-target-dwp56" (UID: "2a03b990-06d4-4e07-8ef1-771f8b853040") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:03:09.238189 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:09.238149 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret\") pod \"global-pull-secret-syncer-clsk2\" (UID: \"37f5d43f-9abe-4758-bba1-59ae699d42ec\") " pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:03:09.238396 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:09.238298 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:03:09.238396 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:09.238378 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret podName:37f5d43f-9abe-4758-bba1-59ae699d42ec nodeName:}" failed. No retries permitted until 2026-07-09 14:03:25.238359959 +0000 UTC m=+34.438860318 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret") pod "global-pull-secret-syncer-clsk2" (UID: "37f5d43f-9abe-4758-bba1-59ae699d42ec") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:03:09.559447 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:09.559402 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:03:09.559447 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:09.559439 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:03:09.559669 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:09.559531 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clsk2" podUID="37f5d43f-9abe-4758-bba1-59ae699d42ec" Jul 09 14:03:09.559735 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:09.559686 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwp56" podUID="2a03b990-06d4-4e07-8ef1-771f8b853040" Jul 09 14:03:09.756953 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:09.756924 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mxk8s" Jul 09 14:03:09.856685 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:09.856596 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:10.559841 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:10.559587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:10.560256 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:10.559961 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sm7hq" podUID="dd6bd814-79b7-4e7b-beeb-e04976f6d1d9" Jul 09 14:03:11.007942 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:11.007900 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:11.067351 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:11.067306 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:11.560402 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:11.560369 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:03:11.560784 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:11.560471 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwp56" podUID="2a03b990-06d4-4e07-8ef1-771f8b853040" Jul 09 14:03:11.560784 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:11.560542 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:03:11.560784 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:11.560659 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clsk2" podUID="37f5d43f-9abe-4758-bba1-59ae699d42ec" Jul 09 14:03:12.559348 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:12.559296 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:12.559523 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:12.559434 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sm7hq" podUID="dd6bd814-79b7-4e7b-beeb-e04976f6d1d9" Jul 09 14:03:13.559784 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:13.559748 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:03:13.560283 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:13.559887 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwp56" podUID="2a03b990-06d4-4e07-8ef1-771f8b853040" Jul 09 14:03:13.560283 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:13.559944 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:03:13.560283 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:13.560042 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clsk2" podUID="37f5d43f-9abe-4758-bba1-59ae699d42ec" Jul 09 14:03:14.559647 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:14.559609 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:14.559960 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:14.559731 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sm7hq" podUID="dd6bd814-79b7-4e7b-beeb-e04976f6d1d9" Jul 09 14:03:15.559691 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:15.559657 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:03:15.559872 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:15.559775 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clsk2" podUID="37f5d43f-9abe-4758-bba1-59ae699d42ec" Jul 09 14:03:15.559872 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:15.559850 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:03:15.559984 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:15.559939 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwp56" podUID="2a03b990-06d4-4e07-8ef1-771f8b853040" Jul 09 14:03:15.703753 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:15.703720 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 14:03:15.771301 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:15.771268 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nnvq7" event={"ID":"ef9e1e6f-f75a-466d-a03f-f27995d36263","Type":"ContainerStarted","Data":"012e311d4b436ba32852df78dbe59586e7c42ecabb42d4ee2f57ae3b3d12c1b8"} Jul 09 14:03:15.772802 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:15.772774 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" event={"ID":"99589261-6e32-45b6-8a5a-c3be040e781c","Type":"ContainerStarted","Data":"8020a46193527fe892e2c1a392d86d007ce13032f90bc8f1bf2b562aaedd18b4"} Jul 09 14:03:15.774731 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:15.774704 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" event={"ID":"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25","Type":"ContainerStarted","Data":"e995464411ebd4afe463387b4fdd4166f4b33a5df4587aed8cc55ad302b93ec0"} Jul 09 14:03:15.794606 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:15.792481 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nnvq7" podStartSLOduration=3.916757257 podStartE2EDuration="24.792459902s" totalImagesPullingTime="20.875702645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:15.790429197 +0000 UTC m=+24.990929571" watchObservedRunningTime="2026-07-09 14:03:15.792459902 +0000 UTC m=+24.992960277" Jul 09 14:03:15.912087 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:15.912053 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:16.011903 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:16.011722 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:16.459938 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:16.459831 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T14:03:15.703748678Z","UUID":"47bb2ec9-b0a6-4e5c-a35d-641afacc1fbb","Handler":null,"Name":"","Endpoint":""} Jul 09 14:03:16.461792 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:16.461771 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 14:03:16.461943 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:16.461812 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 14:03:16.559998 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:16.559968 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:16.560516 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:16.560087 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sm7hq" podUID="dd6bd814-79b7-4e7b-beeb-e04976f6d1d9" Jul 09 14:03:16.778950 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:16.778916 2581 generic.go:356] "Generic (PLEG): container finished" podID="38a844f5-ef21-4817-b365-3b852d56ca7c" containerID="7337aab5af565de8608d7b5c17a0494ba89ee47513b656666d8b3b4078b10f38" exitCode=0 Jul 09 14:03:16.779137 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:16.778994 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bknr" event={"ID":"38a844f5-ef21-4817-b365-3b852d56ca7c","Type":"ContainerDied","Data":"7337aab5af565de8608d7b5c17a0494ba89ee47513b656666d8b3b4078b10f38"} Jul 09 14:03:16.782153 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:16.782129 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" event={"ID":"99589261-6e32-45b6-8a5a-c3be040e781c","Type":"ContainerStarted","Data":"b47a7ec19ea46e9a50e661ec4b6022fc695514792d2338166570ff2d28a8ba74"} Jul 09 14:03:16.782261 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:16.782214 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" event={"ID":"99589261-6e32-45b6-8a5a-c3be040e781c","Type":"ContainerStarted","Data":"98f01efb8e8b71046a5cb944a3787413168345545f31a7d46d65335781a466cc"} Jul 09 14:03:16.782341 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:16.782267 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" event={"ID":"99589261-6e32-45b6-8a5a-c3be040e781c","Type":"ContainerStarted","Data":"4f51caa6f6037b82dabc250f0566a46e5238c245770a9053bcd37f573530d727"} Jul 09 14:03:16.782341 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:16.782332 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" event={"ID":"99589261-6e32-45b6-8a5a-c3be040e781c","Type":"ContainerStarted","Data":"58fcf793d0a3cd74965af568aa9739b9eb491c2d1ebe6115e8099ed988355055"} Jul 09 14:03:16.782444 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:16.782380 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" event={"ID":"99589261-6e32-45b6-8a5a-c3be040e781c","Type":"ContainerStarted","Data":"cf5bd928b7b6ffd3f58a2a76cb1743372c76aae73d072d1766892025273d1e3a"} Jul 09 14:03:17.559393 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:17.559353 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:03:17.559602 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:17.559353 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:03:17.559602 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:17.559505 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clsk2" podUID="37f5d43f-9abe-4758-bba1-59ae699d42ec" Jul 09 14:03:17.559602 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:17.559535 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwp56" podUID="2a03b990-06d4-4e07-8ef1-771f8b853040" Jul 09 14:03:17.786199 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:17.786161 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" event={"ID":"e4b0323a-b5d4-4ed7-82ef-c558ea06dc25","Type":"ContainerStarted","Data":"3f65077117a60d2c3b925178f802f36944cfeed0a334dc5fa04bc42a4c2ee8b0"} Jul 09 14:03:17.805439 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:17.805391 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dwxrs" podStartSLOduration=4.830699697 podStartE2EDuration="26.805368984s" totalImagesPullingTime="21.974669287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:17.804778918 +0000 UTC m=+27.005279291" watchObservedRunningTime="2026-07-09 14:03:17.805368984 +0000 UTC m=+27.005869358" Jul 09 14:03:18.559438 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:18.559401 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:18.559593 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:18.559513 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sm7hq" podUID="dd6bd814-79b7-4e7b-beeb-e04976f6d1d9" Jul 09 14:03:18.790622 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:18.790538 2581 generic.go:356] "Generic (PLEG): container finished" podID="38a844f5-ef21-4817-b365-3b852d56ca7c" containerID="f1b8518bc2eaf7e708b88b7b6e0d2ee36bdc8ea92018be607647fe92f2be69d7" exitCode=0 Jul 09 14:03:18.791034 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:18.790626 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bknr" event={"ID":"38a844f5-ef21-4817-b365-3b852d56ca7c","Type":"ContainerDied","Data":"f1b8518bc2eaf7e708b88b7b6e0d2ee36bdc8ea92018be607647fe92f2be69d7"} Jul 09 14:03:18.793892 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:18.793867 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" event={"ID":"99589261-6e32-45b6-8a5a-c3be040e781c","Type":"ContainerStarted","Data":"86bb28402d91635e50f13955280685984fa072dcb77546a358dc1d6b97290b05"} Jul 09 14:03:19.559204 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:19.559166 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:03:19.559204 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:19.559204 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:03:19.559426 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:19.559289 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clsk2" podUID="37f5d43f-9abe-4758-bba1-59ae699d42ec" Jul 09 14:03:19.559426 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:19.559396 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwp56" podUID="2a03b990-06d4-4e07-8ef1-771f8b853040" Jul 09 14:03:20.218482 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:20.218453 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:20.278983 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:20.278950 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:20.559171 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:20.559094 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:20.559334 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:20.559191 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sm7hq" podUID="dd6bd814-79b7-4e7b-beeb-e04976f6d1d9" Jul 09 14:03:20.802744 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:20.802547 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" event={"ID":"99589261-6e32-45b6-8a5a-c3be040e781c","Type":"ContainerStarted","Data":"f7cb8f5d6a6454fb438c2b7cc06a6254a9232902cd2293645dfd2097fd10ca33"} Jul 09 14:03:20.802985 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:20.802838 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:03:20.806798 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:20.805573 2581 generic.go:356] "Generic (PLEG): container finished" podID="38a844f5-ef21-4817-b365-3b852d56ca7c" containerID="184c8431238ce6b63e38a54a2c6a7f49c2aeedc6511c7ff97c03f29b977a41b3" exitCode=0 Jul 09 14:03:20.806798 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:20.805621 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bknr" event={"ID":"38a844f5-ef21-4817-b365-3b852d56ca7c","Type":"ContainerDied","Data":"184c8431238ce6b63e38a54a2c6a7f49c2aeedc6511c7ff97c03f29b977a41b3"} Jul 09 14:03:20.819596 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:20.819507 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:03:20.833607 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:20.833558 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" podStartSLOduration=8.901389032 podStartE2EDuration="29.833544562s" totalImagesPullingTime="20.93215553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:20.832174098 +0000 UTC m=+30.032674490" watchObservedRunningTime="2026-07-09 14:03:20.833544562 +0000 UTC m=+30.034044936" Jul 09 14:03:21.560627 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:21.560590 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:03:21.561127 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:21.560712 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clsk2" podUID="37f5d43f-9abe-4758-bba1-59ae699d42ec" Jul 09 14:03:21.561127 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:21.560772 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:03:21.561127 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:21.560892 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwp56" podUID="2a03b990-06d4-4e07-8ef1-771f8b853040" Jul 09 14:03:21.808723 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:21.808689 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:03:21.808882 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:21.808774 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:03:21.826947 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:21.826877 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:03:22.019193 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:22.019113 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:22.091296 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:22.091212 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:22.560109 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:22.560066 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:22.560248 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:22.560190 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sm7hq" podUID="dd6bd814-79b7-4e7b-beeb-e04976f6d1d9" Jul 09 14:03:22.614693 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:22.614632 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-clsk2"] Jul 09 14:03:22.615104 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:22.614772 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:03:22.615104 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:22.614882 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clsk2" podUID="37f5d43f-9abe-4758-bba1-59ae699d42ec" Jul 09 14:03:22.617288 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:22.617261 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dwp56"] Jul 09 14:03:22.617447 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:22.617397 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:03:22.617521 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:22.617498 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwp56" podUID="2a03b990-06d4-4e07-8ef1-771f8b853040" Jul 09 14:03:22.629741 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:22.629709 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sm7hq"] Jul 09 14:03:22.810809 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:22.810782 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:22.810961 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:22.810896 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sm7hq" podUID="dd6bd814-79b7-4e7b-beeb-e04976f6d1d9" Jul 09 14:03:23.108843 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:23.108757 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:24.559714 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:24.559684 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:03:24.559714 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:24.559716 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:24.560219 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:24.559691 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:03:24.560219 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:24.559796 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clsk2" podUID="37f5d43f-9abe-4758-bba1-59ae699d42ec" Jul 09 14:03:24.560219 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:24.559899 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwp56" podUID="2a03b990-06d4-4e07-8ef1-771f8b853040" Jul 09 14:03:24.560219 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:24.559979 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sm7hq" podUID="dd6bd814-79b7-4e7b-beeb-e04976f6d1d9" Jul 09 14:03:25.164396 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:25.164356 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs\") pod \"network-metrics-daemon-sm7hq\" (UID: \"dd6bd814-79b7-4e7b-beeb-e04976f6d1d9\") " pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:25.164578 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:25.164499 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:03:25.164578 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:25.164506 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdp66\" (UniqueName: \"kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66\") pod \"network-check-target-dwp56\" (UID: \"2a03b990-06d4-4e07-8ef1-771f8b853040\") " pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:03:25.164578 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:25.164572 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs podName:dd6bd814-79b7-4e7b-beeb-e04976f6d1d9 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:57.16454982 +0000 UTC m=+66.365050189 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs") pod "network-metrics-daemon-sm7hq" (UID: "dd6bd814-79b7-4e7b-beeb-e04976f6d1d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:03:25.164742 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:25.164613 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:03:25.164742 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:25.164633 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:03:25.164742 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:25.164644 2581 projected.go:196] Error preparing data for projected volume kube-api-access-kdp66 for pod openshift-network-diagnostics/network-check-target-dwp56: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:03:25.164742 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:25.164680 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66 podName:2a03b990-06d4-4e07-8ef1-771f8b853040 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:57.164668569 +0000 UTC m=+66.365168922 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kdp66" (UniqueName: "kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66") pod "network-check-target-dwp56" (UID: "2a03b990-06d4-4e07-8ef1-771f8b853040") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:03:25.256374 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:25.256149 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:25.265854 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:25.265823 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret\") pod \"global-pull-secret-syncer-clsk2\" (UID: \"37f5d43f-9abe-4758-bba1-59ae699d42ec\") " pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:03:25.266009 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:25.265985 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:03:25.266077 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:25.266063 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret podName:37f5d43f-9abe-4758-bba1-59ae699d42ec nodeName:}" failed. No retries permitted until 2026-07-09 14:03:57.266042274 +0000 UTC m=+66.466542642 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret") pod "global-pull-secret-syncer-clsk2" (UID: "37f5d43f-9abe-4758-bba1-59ae699d42ec") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:03:25.356655 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:25.356607 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:26.559842 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:26.559789 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:03:26.559842 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:26.559820 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:03:26.559842 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:26.559820 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:26.560303 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:26.559918 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-clsk2" podUID="37f5d43f-9abe-4758-bba1-59ae699d42ec" Jul 09 14:03:26.560303 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:26.560001 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dwp56" podUID="2a03b990-06d4-4e07-8ef1-771f8b853040" Jul 09 14:03:26.560303 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:26.560081 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sm7hq" podUID="dd6bd814-79b7-4e7b-beeb-e04976f6d1d9" Jul 09 14:03:27.824306 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:27.824270 2581 generic.go:356] "Generic (PLEG): container finished" podID="38a844f5-ef21-4817-b365-3b852d56ca7c" containerID="86aefcabbcca6664a0e1ddf7c0ebcabdde1c4e34ad4403f129bcc59376ca2fcd" exitCode=0 Jul 09 14:03:27.824801 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:27.824347 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bknr" event={"ID":"38a844f5-ef21-4817-b365-3b852d56ca7c","Type":"ContainerDied","Data":"86aefcabbcca6664a0e1ddf7c0ebcabdde1c4e34ad4403f129bcc59376ca2fcd"} Jul 09 14:03:28.079686 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.079562 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-107.ec2.internal" event="NodeReady" Jul 09 14:03:28.079854 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.079733 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 14:03:28.123855 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.123789 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zcddz"] Jul 09 14:03:28.131027 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.130999 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hbdrf"] Jul 09 14:03:28.131168 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.131112 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zcddz" Jul 09 14:03:28.133801 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.133781 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 14:03:28.133935 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.133866 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 14:03:28.133935 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.133903 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s5w7z\"" Jul 09 14:03:28.140070 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.139422 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zcddz"] Jul 09 14:03:28.140070 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.139558 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hbdrf" Jul 09 14:03:28.143502 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.143476 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 14:03:28.143635 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.143507 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 14:03:28.143635 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.143614 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xwx6q\"" Jul 09 14:03:28.144456 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.144434 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hbdrf"] Jul 09 14:03:28.144456 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.144452 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 14:03:28.242754 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.242718 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:28.287902 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.287864 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c93815c9-e9c5-4115-98f2-1ff14b09553a-cert\") pod \"ingress-canary-hbdrf\" (UID: \"c93815c9-e9c5-4115-98f2-1ff14b09553a\") " pod="openshift-ingress-canary/ingress-canary-hbdrf" Jul 09 14:03:28.288060 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.287907 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ngn9\" (UniqueName: \"kubernetes.io/projected/c93815c9-e9c5-4115-98f2-1ff14b09553a-kube-api-access-4ngn9\") pod \"ingress-canary-hbdrf\" (UID: \"c93815c9-e9c5-4115-98f2-1ff14b09553a\") " pod="openshift-ingress-canary/ingress-canary-hbdrf" Jul 09 14:03:28.288060 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.287928 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4104855-f579-461e-98de-900889c4b962-metrics-tls\") pod \"dns-default-zcddz\" (UID: \"e4104855-f579-461e-98de-900889c4b962\") " pod="openshift-dns/dns-default-zcddz" Jul 09 14:03:28.288060 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.288013 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl6mz\" (UniqueName: \"kubernetes.io/projected/e4104855-f579-461e-98de-900889c4b962-kube-api-access-tl6mz\") pod \"dns-default-zcddz\" (UID: \"e4104855-f579-461e-98de-900889c4b962\") " pod="openshift-dns/dns-default-zcddz" Jul 09 14:03:28.288060 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.288042 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e4104855-f579-461e-98de-900889c4b962-config-volume\") pod \"dns-default-zcddz\" (UID: \"e4104855-f579-461e-98de-900889c4b962\") " pod="openshift-dns/dns-default-zcddz" Jul 09 14:03:28.288249 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.288144 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4104855-f579-461e-98de-900889c4b962-tmp-dir\") pod \"dns-default-zcddz\" (UID: \"e4104855-f579-461e-98de-900889c4b962\") " pod="openshift-dns/dns-default-zcddz" Jul 09 14:03:28.388573 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.388492 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4104855-f579-461e-98de-900889c4b962-tmp-dir\") pod \"dns-default-zcddz\" (UID: \"e4104855-f579-461e-98de-900889c4b962\") " pod="openshift-dns/dns-default-zcddz" Jul 09 14:03:28.388573 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.388541 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c93815c9-e9c5-4115-98f2-1ff14b09553a-cert\") pod \"ingress-canary-hbdrf\" (UID: \"c93815c9-e9c5-4115-98f2-1ff14b09553a\") " pod="openshift-ingress-canary/ingress-canary-hbdrf" Jul 09 14:03:28.388573 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.388565 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ngn9\" (UniqueName: \"kubernetes.io/projected/c93815c9-e9c5-4115-98f2-1ff14b09553a-kube-api-access-4ngn9\") pod \"ingress-canary-hbdrf\" (UID: \"c93815c9-e9c5-4115-98f2-1ff14b09553a\") " pod="openshift-ingress-canary/ingress-canary-hbdrf" Jul 09 14:03:28.388873 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.388583 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4104855-f579-461e-98de-900889c4b962-metrics-tls\") pod \"dns-default-zcddz\" (UID: \"e4104855-f579-461e-98de-900889c4b962\") " pod="openshift-dns/dns-default-zcddz" Jul 09 14:03:28.388873 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.388602 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl6mz\" (UniqueName: \"kubernetes.io/projected/e4104855-f579-461e-98de-900889c4b962-kube-api-access-tl6mz\") pod \"dns-default-zcddz\" (UID: \"e4104855-f579-461e-98de-900889c4b962\") " pod="openshift-dns/dns-default-zcddz" Jul 09 14:03:28.388873 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.388619 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e4104855-f579-461e-98de-900889c4b962-config-volume\") pod \"dns-default-zcddz\" (UID: \"e4104855-f579-461e-98de-900889c4b962\") " pod="openshift-dns/dns-default-zcddz" Jul 09 14:03:28.388873 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:28.388689 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:03:28.388873 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:28.388772 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4104855-f579-461e-98de-900889c4b962-metrics-tls podName:e4104855-f579-461e-98de-900889c4b962 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:28.888752399 +0000 UTC m=+38.089252756 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4104855-f579-461e-98de-900889c4b962-metrics-tls") pod "dns-default-zcddz" (UID: "e4104855-f579-461e-98de-900889c4b962") : secret "dns-default-metrics-tls" not found Jul 09 14:03:28.389082 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.388897 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e4104855-f579-461e-98de-900889c4b962-tmp-dir\") pod \"dns-default-zcddz\" (UID: \"e4104855-f579-461e-98de-900889c4b962\") " pod="openshift-dns/dns-default-zcddz" Jul 09 14:03:28.389160 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.389139 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e4104855-f579-461e-98de-900889c4b962-config-volume\") pod \"dns-default-zcddz\" (UID: \"e4104855-f579-461e-98de-900889c4b962\") " pod="openshift-dns/dns-default-zcddz" Jul 09 14:03:28.392849 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.392824 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c93815c9-e9c5-4115-98f2-1ff14b09553a-cert\") pod \"ingress-canary-hbdrf\" (UID: \"c93815c9-e9c5-4115-98f2-1ff14b09553a\") " pod="openshift-ingress-canary/ingress-canary-hbdrf" Jul 09 14:03:28.398733 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.398708 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl6mz\" (UniqueName: \"kubernetes.io/projected/e4104855-f579-461e-98de-900889c4b962-kube-api-access-tl6mz\") pod \"dns-default-zcddz\" (UID: \"e4104855-f579-461e-98de-900889c4b962\") " pod="openshift-dns/dns-default-zcddz" Jul 09 14:03:28.398852 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.398759 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ngn9\" (UniqueName: \"kubernetes.io/projected/c93815c9-e9c5-4115-98f2-1ff14b09553a-kube-api-access-4ngn9\") pod \"ingress-canary-hbdrf\" (UID: \"c93815c9-e9c5-4115-98f2-1ff14b09553a\") " pod="openshift-ingress-canary/ingress-canary-hbdrf" Jul 09 14:03:28.450741 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.450704 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hbdrf" Jul 09 14:03:28.559381 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.559347 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:03:28.559381 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.559380 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:03:28.559576 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.559380 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:28.562578 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.562543 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 14:03:28.562741 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.562723 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-27nh2\"" Jul 09 14:03:28.562844 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.562811 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 14:03:28.563751 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.563719 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wp6bz\"" Jul 09 14:03:28.563862 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.563815 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 14:03:28.563921 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.563867 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 14:03:28.649509 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.649228 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hbdrf"] Jul 09 14:03:28.653447 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:03:28.653415 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc93815c9_e9c5_4115_98f2_1ff14b09553a.slice/crio-e1a543505ee30d27ddbcd93738b895bcc37234de6f6551aa5ca7899dd00a43e6 WatchSource:0}: Error finding container e1a543505ee30d27ddbcd93738b895bcc37234de6f6551aa5ca7899dd00a43e6: Status 404 returned error can't find the container with id e1a543505ee30d27ddbcd93738b895bcc37234de6f6551aa5ca7899dd00a43e6 Jul 09 14:03:28.671236 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.671204 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5wkg5"] Jul 09 14:03:28.680244 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.680217 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5wkg5" Jul 09 14:03:28.683420 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.683337 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rppg2\"" Jul 09 14:03:28.683613 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.683338 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 09 14:03:28.683722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.683392 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 09 14:03:28.684186 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.684164 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5wkg5"] Jul 09 14:03:28.790898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.790862 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vmkj\" (UniqueName: \"kubernetes.io/projected/173baa95-f293-41a1-8cde-b7bda4be5f3a-kube-api-access-9vmkj\") pod \"migrator-7f59b54f6c-5wkg5\" (UID: \"173baa95-f293-41a1-8cde-b7bda4be5f3a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5wkg5" Jul 09 14:03:28.830126 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.830091 2581 generic.go:356] "Generic (PLEG): container finished" podID="38a844f5-ef21-4817-b365-3b852d56ca7c" containerID="a24aa8af29ba6fd842eafb2c80983dfc65e92b95fe1ee5b09ebf2a704004a85a" exitCode=0 Jul 09 14:03:28.830855 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.830141 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bknr" event={"ID":"38a844f5-ef21-4817-b365-3b852d56ca7c","Type":"ContainerDied","Data":"a24aa8af29ba6fd842eafb2c80983dfc65e92b95fe1ee5b09ebf2a704004a85a"} Jul 09 14:03:28.831418 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.831392 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hbdrf" event={"ID":"c93815c9-e9c5-4115-98f2-1ff14b09553a","Type":"ContainerStarted","Data":"e1a543505ee30d27ddbcd93738b895bcc37234de6f6551aa5ca7899dd00a43e6"} Jul 09 14:03:28.891212 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.891178 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vmkj\" (UniqueName: \"kubernetes.io/projected/173baa95-f293-41a1-8cde-b7bda4be5f3a-kube-api-access-9vmkj\") pod \"migrator-7f59b54f6c-5wkg5\" (UID: \"173baa95-f293-41a1-8cde-b7bda4be5f3a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5wkg5" Jul 09 14:03:28.891361 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.891330 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4104855-f579-461e-98de-900889c4b962-metrics-tls\") pod \"dns-default-zcddz\" (UID: \"e4104855-f579-461e-98de-900889c4b962\") " pod="openshift-dns/dns-default-zcddz" Jul 09 14:03:28.891443 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:28.891430 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:03:28.891490 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:28.891481 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4104855-f579-461e-98de-900889c4b962-metrics-tls podName:e4104855-f579-461e-98de-900889c4b962 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:29.891468182 +0000 UTC m=+39.091968534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4104855-f579-461e-98de-900889c4b962-metrics-tls") pod "dns-default-zcddz" (UID: "e4104855-f579-461e-98de-900889c4b962") : secret "dns-default-metrics-tls" not found Jul 09 14:03:28.900191 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.900126 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vmkj\" (UniqueName: \"kubernetes.io/projected/173baa95-f293-41a1-8cde-b7bda4be5f3a-kube-api-access-9vmkj\") pod \"migrator-7f59b54f6c-5wkg5\" (UID: \"173baa95-f293-41a1-8cde-b7bda4be5f3a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5wkg5" Jul 09 14:03:28.990051 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:28.990018 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5wkg5" Jul 09 14:03:29.123896 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:29.123862 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5wkg5"] Jul 09 14:03:29.127998 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:03:29.127966 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod173baa95_f293_41a1_8cde_b7bda4be5f3a.slice/crio-34553e8526996ae188c8944b0d22718ed84e37fc361556f189705180bed6d4e8 WatchSource:0}: Error finding container 34553e8526996ae188c8944b0d22718ed84e37fc361556f189705180bed6d4e8: Status 404 returned error can't find the container with id 34553e8526996ae188c8944b0d22718ed84e37fc361556f189705180bed6d4e8 Jul 09 14:03:29.844382 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:29.844347 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7bknr" event={"ID":"38a844f5-ef21-4817-b365-3b852d56ca7c","Type":"ContainerStarted","Data":"201ea237366a33b13bc992dc8ab8e2e5055b46ed9570edb4c4ef8ac91aa07f5e"} Jul 09 14:03:29.846359 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:29.846302 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5wkg5" event={"ID":"173baa95-f293-41a1-8cde-b7bda4be5f3a","Type":"ContainerStarted","Data":"34553e8526996ae188c8944b0d22718ed84e37fc361556f189705180bed6d4e8"} Jul 09 14:03:29.870469 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:29.870300 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7bknr" podStartSLOduration=10.315424935 podStartE2EDuration="38.870276796s" totalImagesPullingTime="28.554851861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:29.868245488 +0000 UTC m=+39.068745861" watchObservedRunningTime="2026-07-09 14:03:29.870276796 +0000 UTC m=+39.070777172" Jul 09 14:03:29.897963 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:29.897922 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4104855-f579-461e-98de-900889c4b962-metrics-tls\") pod \"dns-default-zcddz\" (UID: \"e4104855-f579-461e-98de-900889c4b962\") " pod="openshift-dns/dns-default-zcddz" Jul 09 14:03:29.898136 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:29.898088 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:03:29.898206 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:29.898170 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4104855-f579-461e-98de-900889c4b962-metrics-tls podName:e4104855-f579-461e-98de-900889c4b962 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:31.898147618 +0000 UTC m=+41.098647990 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4104855-f579-461e-98de-900889c4b962-metrics-tls") pod "dns-default-zcddz" (UID: "e4104855-f579-461e-98de-900889c4b962") : secret "dns-default-metrics-tls" not found Jul 09 14:03:30.481252 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.481219 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:30.583324 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.583284 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:30.627877 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.627843 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bx4d4"] Jul 09 14:03:30.646212 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.646185 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bx4d4"] Jul 09 14:03:30.646392 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.646294 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:30.649294 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.649047 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 14:03:30.649294 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.649052 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 14:03:30.649294 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.649111 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zvwkr\"" Jul 09 14:03:30.649294 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.649111 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 14:03:30.650165 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.650146 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 14:03:30.667651 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.667619 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:30.805062 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.804981 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5104694c-794d-4177-8593-82b31d38f9fd-data-volume\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:30.805062 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.805034 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5104694c-794d-4177-8593-82b31d38f9fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:30.805062 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.805065 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72t2n\" (UniqueName: \"kubernetes.io/projected/5104694c-794d-4177-8593-82b31d38f9fd-kube-api-access-72t2n\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:30.805348 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.805171 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5104694c-794d-4177-8593-82b31d38f9fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:30.805348 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.805216 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5104694c-794d-4177-8593-82b31d38f9fd-crio-socket\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:30.906504 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.906464 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5104694c-794d-4177-8593-82b31d38f9fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:30.906976 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.906518 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5104694c-794d-4177-8593-82b31d38f9fd-crio-socket\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:30.906976 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.906559 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5104694c-794d-4177-8593-82b31d38f9fd-data-volume\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:30.906976 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.906580 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5104694c-794d-4177-8593-82b31d38f9fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:30.906976 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.906604 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72t2n\" (UniqueName: \"kubernetes.io/projected/5104694c-794d-4177-8593-82b31d38f9fd-kube-api-access-72t2n\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:30.906976 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:30.906623 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:03:30.906976 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:30.906711 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5104694c-794d-4177-8593-82b31d38f9fd-kube-rbac-proxy-cm podName:5104694c-794d-4177-8593-82b31d38f9fd nodeName:}" failed. No retries permitted until 2026-07-09 14:03:31.406689563 +0000 UTC m=+40.607189915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5104694c-794d-4177-8593-82b31d38f9fd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bx4d4" (UID: "5104694c-794d-4177-8593-82b31d38f9fd") : configmap "kube-rbac-proxy" not found Jul 09 14:03:30.906976 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:30.906900 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:03:30.906976 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:30.906945 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5104694c-794d-4177-8593-82b31d38f9fd-insights-runtime-extractor-tls podName:5104694c-794d-4177-8593-82b31d38f9fd nodeName:}" failed. No retries permitted until 2026-07-09 14:03:31.40693135 +0000 UTC m=+40.607431703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5104694c-794d-4177-8593-82b31d38f9fd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bx4d4" (UID: "5104694c-794d-4177-8593-82b31d38f9fd") : secret "insights-runtime-extractor-tls" not found Jul 09 14:03:30.906976 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.906945 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5104694c-794d-4177-8593-82b31d38f9fd-data-volume\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:30.907482 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.907174 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5104694c-794d-4177-8593-82b31d38f9fd-crio-socket\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:30.919349 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:30.919190 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72t2n\" (UniqueName: \"kubernetes.io/projected/5104694c-794d-4177-8593-82b31d38f9fd-kube-api-access-72t2n\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:31.411073 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:31.411031 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5104694c-794d-4177-8593-82b31d38f9fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:31.411248 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:31.411092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5104694c-794d-4177-8593-82b31d38f9fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:31.411248 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:31.411171 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:03:31.411248 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:31.411226 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:03:31.411248 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:31.411241 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5104694c-794d-4177-8593-82b31d38f9fd-kube-rbac-proxy-cm podName:5104694c-794d-4177-8593-82b31d38f9fd nodeName:}" failed. No retries permitted until 2026-07-09 14:03:32.411224446 +0000 UTC m=+41.611724797 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5104694c-794d-4177-8593-82b31d38f9fd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bx4d4" (UID: "5104694c-794d-4177-8593-82b31d38f9fd") : configmap "kube-rbac-proxy" not found Jul 09 14:03:31.411413 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:31.411265 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5104694c-794d-4177-8593-82b31d38f9fd-insights-runtime-extractor-tls podName:5104694c-794d-4177-8593-82b31d38f9fd nodeName:}" failed. No retries permitted until 2026-07-09 14:03:32.411254531 +0000 UTC m=+41.611754883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5104694c-794d-4177-8593-82b31d38f9fd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bx4d4" (UID: "5104694c-794d-4177-8593-82b31d38f9fd") : secret "insights-runtime-extractor-tls" not found Jul 09 14:03:31.853767 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:31.853730 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hbdrf" event={"ID":"c93815c9-e9c5-4115-98f2-1ff14b09553a","Type":"ContainerStarted","Data":"da73ae658868871252c2d75c10bce5a0215549060d58f5635e5fc86f127b9da6"} Jul 09 14:03:31.855199 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:31.855167 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5wkg5" event={"ID":"173baa95-f293-41a1-8cde-b7bda4be5f3a","Type":"ContainerStarted","Data":"d73a207d2f8b0fadd682ecc5821ac9aad7885524b6f31af5ba76bca4e0787e3f"} Jul 09 14:03:31.858497 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:31.858474 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:31.916642 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:31.916609 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4104855-f579-461e-98de-900889c4b962-metrics-tls\") pod \"dns-default-zcddz\" (UID: \"e4104855-f579-461e-98de-900889c4b962\") " pod="openshift-dns/dns-default-zcddz" Jul 09 14:03:31.917168 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:31.916755 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:03:31.917168 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:31.916815 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4104855-f579-461e-98de-900889c4b962-metrics-tls podName:e4104855-f579-461e-98de-900889c4b962 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:35.916798631 +0000 UTC m=+45.117298983 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4104855-f579-461e-98de-900889c4b962-metrics-tls") pod "dns-default-zcddz" (UID: "e4104855-f579-461e-98de-900889c4b962") : secret "dns-default-metrics-tls" not found Jul 09 14:03:31.923878 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:31.923840 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:32.421577 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:32.421480 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5104694c-794d-4177-8593-82b31d38f9fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:32.421714 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:32.421639 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:03:32.421714 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:32.421665 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5104694c-794d-4177-8593-82b31d38f9fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:32.421714 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:32.421701 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5104694c-794d-4177-8593-82b31d38f9fd-insights-runtime-extractor-tls podName:5104694c-794d-4177-8593-82b31d38f9fd nodeName:}" failed. No retries permitted until 2026-07-09 14:03:34.42168416 +0000 UTC m=+43.622184515 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5104694c-794d-4177-8593-82b31d38f9fd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bx4d4" (UID: "5104694c-794d-4177-8593-82b31d38f9fd") : secret "insights-runtime-extractor-tls" not found Jul 09 14:03:32.421841 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:32.421738 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:03:32.421841 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:32.421782 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5104694c-794d-4177-8593-82b31d38f9fd-kube-rbac-proxy-cm podName:5104694c-794d-4177-8593-82b31d38f9fd nodeName:}" failed. No retries permitted until 2026-07-09 14:03:34.421770991 +0000 UTC m=+43.622271343 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5104694c-794d-4177-8593-82b31d38f9fd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bx4d4" (UID: "5104694c-794d-4177-8593-82b31d38f9fd") : configmap "kube-rbac-proxy" not found Jul 09 14:03:32.756587 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:32.756555 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:32.859962 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:32.859926 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5wkg5" event={"ID":"173baa95-f293-41a1-8cde-b7bda4be5f3a","Type":"ContainerStarted","Data":"5a4342b52ad87af601576ece3fc9711f38139be84237c70480edc0a1ee9d374e"} Jul 09 14:03:32.885351 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:32.885285 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hbdrf" podStartSLOduration=1.8246655170000001 podStartE2EDuration="4.885270707s" totalImagesPullingTime="3.06060519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:32.884383322 +0000 UTC m=+42.084883709" watchObservedRunningTime="2026-07-09 14:03:32.885270707 +0000 UTC m=+42.085771081" Jul 09 14:03:32.904008 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:32.903959 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-5wkg5" podStartSLOduration=2.316726965 podStartE2EDuration="4.903941822s" totalImagesPullingTime="2.587214857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:32.903479651 +0000 UTC m=+42.103980025" watchObservedRunningTime="2026-07-09 14:03:32.903941822 +0000 UTC m=+42.104442190" Jul 09 14:03:33.416476 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:33.416448 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p8q9w_6cc0b610-de8c-45a6-862f-8c859f4c7777/dns-node-resolver/0.log" Jul 09 14:03:34.437422 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:34.437388 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5104694c-794d-4177-8593-82b31d38f9fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:34.437820 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:34.437445 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5104694c-794d-4177-8593-82b31d38f9fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:34.437820 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:34.437503 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:03:34.437820 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:34.437543 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:03:34.437820 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:34.437564 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5104694c-794d-4177-8593-82b31d38f9fd-kube-rbac-proxy-cm podName:5104694c-794d-4177-8593-82b31d38f9fd nodeName:}" failed. No retries permitted until 2026-07-09 14:03:38.437548832 +0000 UTC m=+47.638049184 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5104694c-794d-4177-8593-82b31d38f9fd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bx4d4" (UID: "5104694c-794d-4177-8593-82b31d38f9fd") : configmap "kube-rbac-proxy" not found Jul 09 14:03:34.437820 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:34.437580 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5104694c-794d-4177-8593-82b31d38f9fd-insights-runtime-extractor-tls podName:5104694c-794d-4177-8593-82b31d38f9fd nodeName:}" failed. No retries permitted until 2026-07-09 14:03:38.43756981 +0000 UTC m=+47.638070163 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5104694c-794d-4177-8593-82b31d38f9fd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bx4d4" (UID: "5104694c-794d-4177-8593-82b31d38f9fd") : secret "insights-runtime-extractor-tls" not found Jul 09 14:03:34.615386 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:34.615363 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qdfgv_dd9909a6-9743-4756-83ac-19b7bbdb0a72/node-ca/0.log" Jul 09 14:03:35.215696 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:35.215650 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hbdrf_c93815c9-e9c5-4115-98f2-1ff14b09553a/serve-healthcheck-canary/0.log" Jul 09 14:03:35.616082 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:35.616007 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-5wkg5_173baa95-f293-41a1-8cde-b7bda4be5f3a/migrator/0.log" Jul 09 14:03:35.816192 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:35.816166 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-5wkg5_173baa95-f293-41a1-8cde-b7bda4be5f3a/graceful-termination/0.log" Jul 09 14:03:35.948627 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:35.948544 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4104855-f579-461e-98de-900889c4b962-metrics-tls\") pod \"dns-default-zcddz\" (UID: \"e4104855-f579-461e-98de-900889c4b962\") " pod="openshift-dns/dns-default-zcddz" Jul 09 14:03:35.948763 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:35.948695 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:03:35.948763 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:35.948758 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4104855-f579-461e-98de-900889c4b962-metrics-tls podName:e4104855-f579-461e-98de-900889c4b962 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:43.948740678 +0000 UTC m=+53.149241040 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e4104855-f579-461e-98de-900889c4b962-metrics-tls") pod "dns-default-zcddz" (UID: "e4104855-f579-461e-98de-900889c4b962") : secret "dns-default-metrics-tls" not found Jul 09 14:03:36.372830 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:36.372798 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:36.532838 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:36.532793 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:36.636326 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:36.636236 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:36.734387 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:36.734360 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:36.812229 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:36.812202 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:37.006252 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:37.006226 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:37.111337 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:37.111291 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:37.217050 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:37.217014 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:37.317049 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:37.316970 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:38.074273 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:38.074241 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:38.280572 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:38.280542 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:38.465566 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:38.465534 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5104694c-794d-4177-8593-82b31d38f9fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:38.465721 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:38.465601 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5104694c-794d-4177-8593-82b31d38f9fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:38.465721 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:38.465652 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:03:38.465721 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:38.465713 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:03:38.465815 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:38.465743 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5104694c-794d-4177-8593-82b31d38f9fd-kube-rbac-proxy-cm podName:5104694c-794d-4177-8593-82b31d38f9fd nodeName:}" failed. No retries permitted until 2026-07-09 14:03:46.465727109 +0000 UTC m=+55.666227462 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/5104694c-794d-4177-8593-82b31d38f9fd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-bx4d4" (UID: "5104694c-794d-4177-8593-82b31d38f9fd") : configmap "kube-rbac-proxy" not found Jul 09 14:03:38.465815 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:38.465768 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5104694c-794d-4177-8593-82b31d38f9fd-insights-runtime-extractor-tls podName:5104694c-794d-4177-8593-82b31d38f9fd nodeName:}" failed. No retries permitted until 2026-07-09 14:03:46.465755891 +0000 UTC m=+55.666256244 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5104694c-794d-4177-8593-82b31d38f9fd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bx4d4" (UID: "5104694c-794d-4177-8593-82b31d38f9fd") : secret "insights-runtime-extractor-tls" not found Jul 09 14:03:38.477447 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:38.477422 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:38.877554 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:38.877293 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:39.258187 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:39.258155 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:39.359469 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:39.359423 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:39.478289 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:39.478255 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:39.876661 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:39.876631 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:40.072672 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:40.072638 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:40.132898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:40.132821 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:40.464133 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:40.464101 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:40.753357 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:40.753254 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:41.070842 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:41.070763 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:41.129454 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:41.129412 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:41.470657 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:41.470632 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:42.041638 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:42.041599 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:42.143242 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:42.143208 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:42.283330 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:42.283280 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:42.476294 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:42.476261 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:42.656840 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:42.656804 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:42.713266 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:42.713235 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:43.518764 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:43.518721 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:43.751633 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:43.751602 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:43.879034 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:43.878963 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:44.007329 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:44.007270 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4104855-f579-461e-98de-900889c4b962-metrics-tls\") pod \"dns-default-zcddz\" (UID: \"e4104855-f579-461e-98de-900889c4b962\") " pod="openshift-dns/dns-default-zcddz" Jul 09 14:03:44.010346 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:44.010305 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4104855-f579-461e-98de-900889c4b962-metrics-tls\") pod \"dns-default-zcddz\" (UID: \"e4104855-f579-461e-98de-900889c4b962\") " pod="openshift-dns/dns-default-zcddz" Jul 09 14:03:44.045903 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:44.045869 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zcddz" Jul 09 14:03:44.071882 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:44.071853 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:44.178002 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:44.177970 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zcddz"] Jul 09 14:03:44.181135 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:03:44.181110 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4104855_f579_461e_98de_900889c4b962.slice/crio-57a67d8d6329b3f2bc4d972b7e3bb237ea318a011aa790fcf2f0270152d049d1 WatchSource:0}: Error finding container 57a67d8d6329b3f2bc4d972b7e3bb237ea318a011aa790fcf2f0270152d049d1: Status 404 returned error can't find the container with id 57a67d8d6329b3f2bc4d972b7e3bb237ea318a011aa790fcf2f0270152d049d1 Jul 09 14:03:44.676043 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:44.676011 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:44.890303 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:44.890269 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zcddz" event={"ID":"e4104855-f579-461e-98de-900889c4b962","Type":"ContainerStarted","Data":"57a67d8d6329b3f2bc4d972b7e3bb237ea318a011aa790fcf2f0270152d049d1"} Jul 09 14:03:45.099066 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:45.099034 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:45.166731 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:45.166700 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:45.276003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:45.275951 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:45.475074 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:45.475041 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:45.875854 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:45.875774 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:46.074713 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:46.074679 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:46.273696 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:46.273666 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:46.526965 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:46.526883 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5104694c-794d-4177-8593-82b31d38f9fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:46.526965 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:46.526943 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5104694c-794d-4177-8593-82b31d38f9fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:46.527159 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:46.527045 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:03:46.527159 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:03:46.527101 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5104694c-794d-4177-8593-82b31d38f9fd-insights-runtime-extractor-tls podName:5104694c-794d-4177-8593-82b31d38f9fd nodeName:}" failed. No retries permitted until 2026-07-09 14:04:02.527086773 +0000 UTC m=+71.727587125 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/5104694c-794d-4177-8593-82b31d38f9fd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-bx4d4" (UID: "5104694c-794d-4177-8593-82b31d38f9fd") : secret "insights-runtime-extractor-tls" not found Jul 09 14:03:46.527503 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:46.527482 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5104694c-794d-4177-8593-82b31d38f9fd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:03:46.876820 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:46.876732 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:46.897620 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:46.897586 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zcddz" event={"ID":"e4104855-f579-461e-98de-900889c4b962","Type":"ContainerStarted","Data":"6f9993d33356f673cf3a94cd59b46e7866163755ed46abeefef4f85b904f9c34"} Jul 09 14:03:46.897771 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:46.897661 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zcddz" event={"ID":"e4104855-f579-461e-98de-900889c4b962","Type":"ContainerStarted","Data":"33ccac9272d59945ff1558e4d79394de9b93f04b89c18280e2b49b975f842fef"} Jul 09 14:03:46.897771 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:46.897735 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zcddz" Jul 09 14:03:46.920537 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:46.920475 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zcddz" podStartSLOduration=16.564055372 podStartE2EDuration="18.920452225s" totalImagesPullingTime="2.356396853s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:46.91973591 +0000 UTC m=+56.120236317" watchObservedRunningTime="2026-07-09 14:03:46.920452225 +0000 UTC m=+56.120952600" Jul 09 14:03:47.077450 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:47.077411 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:53.823699 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:53.823670 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rnqq6" Jul 09 14:03:54.833996 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.833963 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-749484968d-qm7k4"] Jul 09 14:03:54.836757 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.836737 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749484968d-qm7k4" Jul 09 14:03:54.839416 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.839390 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2"] Jul 09 14:03:54.840339 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.840299 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 09 14:03:54.840450 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.840363 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 09 14:03:54.841181 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.841165 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 09 14:03:54.841264 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.841189 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 09 14:03:54.841974 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.841957 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" Jul 09 14:03:54.844869 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.844822 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 09 14:03:54.845092 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.845077 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 09 14:03:54.845302 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.845276 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 09 14:03:54.845629 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.845612 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 09 14:03:54.854682 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.854658 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-749484968d-qm7k4"] Jul 09 14:03:54.871534 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.871506 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2"] Jul 09 14:03:54.884992 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.884957 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8eba532d-c84b-432f-885a-d8c945473235-tmp\") pod \"klusterlet-addon-workmgr-749484968d-qm7k4\" (UID: \"8eba532d-c84b-432f-885a-d8c945473235\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749484968d-qm7k4" Jul 09 14:03:54.885143 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.884999 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c5f946bbc-9p2z2\" (UID: \"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" Jul 09 14:03:54.885143 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.885018 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg76c\" (UniqueName: \"kubernetes.io/projected/9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd-kube-api-access-mg76c\") pod \"cluster-proxy-proxy-agent-c5f946bbc-9p2z2\" (UID: \"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" Jul 09 14:03:54.885143 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.885111 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c5f946bbc-9p2z2\" (UID: \"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" Jul 09 14:03:54.885143 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.885136 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c5f946bbc-9p2z2\" (UID: \"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" Jul 09 14:03:54.885273 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.885175 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd-hub\") pod \"cluster-proxy-proxy-agent-c5f946bbc-9p2z2\" (UID: \"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" Jul 09 14:03:54.885273 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.885196 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd-ca\") pod \"cluster-proxy-proxy-agent-c5f946bbc-9p2z2\" (UID: \"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" Jul 09 14:03:54.885273 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.885211 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ljxk\" (UniqueName: \"kubernetes.io/projected/8eba532d-c84b-432f-885a-d8c945473235-kube-api-access-6ljxk\") pod \"klusterlet-addon-workmgr-749484968d-qm7k4\" (UID: \"8eba532d-c84b-432f-885a-d8c945473235\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749484968d-qm7k4" Jul 09 14:03:54.885424 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.885282 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8eba532d-c84b-432f-885a-d8c945473235-klusterlet-config\") pod \"klusterlet-addon-workmgr-749484968d-qm7k4\" (UID: \"8eba532d-c84b-432f-885a-d8c945473235\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749484968d-qm7k4" Jul 09 14:03:54.924095 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.924061 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:54.986561 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.986527 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c5f946bbc-9p2z2\" (UID: \"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" Jul 09 14:03:54.986561 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.986564 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c5f946bbc-9p2z2\" (UID: \"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" Jul 09 14:03:54.986768 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.986588 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd-hub\") pod \"cluster-proxy-proxy-agent-c5f946bbc-9p2z2\" (UID: \"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" Jul 09 14:03:54.986768 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.986613 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd-ca\") pod \"cluster-proxy-proxy-agent-c5f946bbc-9p2z2\" (UID: \"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" Jul 09 14:03:54.986768 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.986738 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ljxk\" (UniqueName: \"kubernetes.io/projected/8eba532d-c84b-432f-885a-d8c945473235-kube-api-access-6ljxk\") pod \"klusterlet-addon-workmgr-749484968d-qm7k4\" (UID: \"8eba532d-c84b-432f-885a-d8c945473235\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749484968d-qm7k4" Jul 09 14:03:54.986892 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.986802 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8eba532d-c84b-432f-885a-d8c945473235-klusterlet-config\") pod \"klusterlet-addon-workmgr-749484968d-qm7k4\" (UID: \"8eba532d-c84b-432f-885a-d8c945473235\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749484968d-qm7k4" Jul 09 14:03:54.986892 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.986863 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8eba532d-c84b-432f-885a-d8c945473235-tmp\") pod \"klusterlet-addon-workmgr-749484968d-qm7k4\" (UID: \"8eba532d-c84b-432f-885a-d8c945473235\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749484968d-qm7k4" Jul 09 14:03:54.986995 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.986905 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c5f946bbc-9p2z2\" (UID: \"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" Jul 09 14:03:54.986995 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.986952 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg76c\" (UniqueName: \"kubernetes.io/projected/9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd-kube-api-access-mg76c\") pod \"cluster-proxy-proxy-agent-c5f946bbc-9p2z2\" (UID: \"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" Jul 09 14:03:54.987353 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.987303 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8eba532d-c84b-432f-885a-d8c945473235-tmp\") pod \"klusterlet-addon-workmgr-749484968d-qm7k4\" (UID: \"8eba532d-c84b-432f-885a-d8c945473235\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749484968d-qm7k4" Jul 09 14:03:54.987513 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.987490 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd-additional-service-ca\") pod \"cluster-proxy-proxy-agent-c5f946bbc-9p2z2\" (UID: \"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" Jul 09 14:03:54.989134 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.989112 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd-hub\") pod \"cluster-proxy-proxy-agent-c5f946bbc-9p2z2\" (UID: \"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" Jul 09 14:03:54.989259 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.989238 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-c5f946bbc-9p2z2\" (UID: \"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" Jul 09 14:03:54.989425 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.989407 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd-ca\") pod \"cluster-proxy-proxy-agent-c5f946bbc-9p2z2\" (UID: \"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" Jul 09 14:03:54.989501 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.989446 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8eba532d-c84b-432f-885a-d8c945473235-klusterlet-config\") pod \"klusterlet-addon-workmgr-749484968d-qm7k4\" (UID: \"8eba532d-c84b-432f-885a-d8c945473235\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749484968d-qm7k4" Jul 09 14:03:54.989671 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:54.989654 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-c5f946bbc-9p2z2\" (UID: \"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" Jul 09 14:03:55.000404 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:55.000381 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg76c\" (UniqueName: \"kubernetes.io/projected/9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd-kube-api-access-mg76c\") pod \"cluster-proxy-proxy-agent-c5f946bbc-9p2z2\" (UID: \"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" Jul 09 14:03:55.000404 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:55.000401 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ljxk\" (UniqueName: \"kubernetes.io/projected/8eba532d-c84b-432f-885a-d8c945473235-kube-api-access-6ljxk\") pod \"klusterlet-addon-workmgr-749484968d-qm7k4\" (UID: \"8eba532d-c84b-432f-885a-d8c945473235\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749484968d-qm7k4" Jul 09 14:03:55.026954 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:55.026924 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:55.127212 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:55.127124 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:55.147057 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:55.147025 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749484968d-qm7k4" Jul 09 14:03:55.165043 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:55.165017 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" Jul 09 14:03:55.278427 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:55.278397 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-749484968d-qm7k4"] Jul 09 14:03:55.281453 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:03:55.281285 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8eba532d_c84b_432f_885a_d8c945473235.slice/crio-0f38a90277c2135456a4e3e3f24fc42fa412e2cb05c0637824edf5c85c12af91 WatchSource:0}: Error finding container 0f38a90277c2135456a4e3e3f24fc42fa412e2cb05c0637824edf5c85c12af91: Status 404 returned error can't find the container with id 0f38a90277c2135456a4e3e3f24fc42fa412e2cb05c0637824edf5c85c12af91 Jul 09 14:03:55.295809 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:55.295785 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2"] Jul 09 14:03:55.298140 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:03:55.298118 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9f81c0fc_5cf7_4dfb_a2ce_f55f394e99fd.slice/crio-43b0a12c77169fe523c36e1c54f12c343f720e86899257362f8b07dcf183a462 WatchSource:0}: Error finding container 43b0a12c77169fe523c36e1c54f12c343f720e86899257362f8b07dcf183a462: Status 404 returned error can't find the container with id 43b0a12c77169fe523c36e1c54f12c343f720e86899257362f8b07dcf183a462 Jul 09 14:03:55.920743 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:55.920704 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" event={"ID":"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd","Type":"ContainerStarted","Data":"43b0a12c77169fe523c36e1c54f12c343f720e86899257362f8b07dcf183a462"} Jul 09 14:03:55.922139 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:55.922108 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749484968d-qm7k4" event={"ID":"8eba532d-c84b-432f-885a-d8c945473235","Type":"ContainerStarted","Data":"0f38a90277c2135456a4e3e3f24fc42fa412e2cb05c0637824edf5c85c12af91"} Jul 09 14:03:56.165228 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:56.165126 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:56.902858 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:56.902827 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zcddz" Jul 09 14:03:57.206590 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:57.206490 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs\") pod \"network-metrics-daemon-sm7hq\" (UID: \"dd6bd814-79b7-4e7b-beeb-e04976f6d1d9\") " pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:57.206590 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:57.206554 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdp66\" (UniqueName: \"kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66\") pod \"network-check-target-dwp56\" (UID: \"2a03b990-06d4-4e07-8ef1-771f8b853040\") " pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:03:57.209404 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:57.209376 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 14:03:57.209554 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:57.209449 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 14:03:57.219664 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:57.219452 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 14:03:57.220226 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:57.220203 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd6bd814-79b7-4e7b-beeb-e04976f6d1d9-metrics-certs\") pod \"network-metrics-daemon-sm7hq\" (UID: \"dd6bd814-79b7-4e7b-beeb-e04976f6d1d9\") " pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:57.230700 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:57.230668 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdp66\" (UniqueName: \"kubernetes.io/projected/2a03b990-06d4-4e07-8ef1-771f8b853040-kube-api-access-kdp66\") pod \"network-check-target-dwp56\" (UID: \"2a03b990-06d4-4e07-8ef1-771f8b853040\") " pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:03:57.307156 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:57.307111 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret\") pod \"global-pull-secret-syncer-clsk2\" (UID: \"37f5d43f-9abe-4758-bba1-59ae699d42ec\") " pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:03:57.309999 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:57.309970 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 14:03:57.321186 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:57.321155 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/37f5d43f-9abe-4758-bba1-59ae699d42ec-original-pull-secret\") pod \"global-pull-secret-syncer-clsk2\" (UID: \"37f5d43f-9abe-4758-bba1-59ae699d42ec\") " pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:03:57.372848 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:57.372810 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-clsk2" Jul 09 14:03:57.381660 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:57.381440 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wp6bz\"" Jul 09 14:03:57.389587 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:57.388978 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:03:57.389587 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:57.389428 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-27nh2\"" Jul 09 14:03:57.397972 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:57.397742 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sm7hq" Jul 09 14:03:57.991016 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:57.990901 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-clsk2"] Jul 09 14:03:57.995194 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:03:57.995105 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37f5d43f_9abe_4758_bba1_59ae699d42ec.slice/crio-cc916a8ab2e7e2b160758bb594e86d2d283f860fcf8eaf09c4daa24346a9d491 WatchSource:0}: Error finding container cc916a8ab2e7e2b160758bb594e86d2d283f860fcf8eaf09c4daa24346a9d491: Status 404 returned error can't find the container with id cc916a8ab2e7e2b160758bb594e86d2d283f860fcf8eaf09c4daa24346a9d491 Jul 09 14:03:58.011854 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:58.011827 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sm7hq"] Jul 09 14:03:58.015637 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:03:58.015607 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd6bd814_79b7_4e7b_beeb_e04976f6d1d9.slice/crio-dcd7f1b41c02b04b1ca1f57530ec599e947b949b89113585fc5b0ebf43ce3397 WatchSource:0}: Error finding container dcd7f1b41c02b04b1ca1f57530ec599e947b949b89113585fc5b0ebf43ce3397: Status 404 returned error can't find the container with id dcd7f1b41c02b04b1ca1f57530ec599e947b949b89113585fc5b0ebf43ce3397 Jul 09 14:03:58.035984 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:58.035920 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dwp56"] Jul 09 14:03:58.039606 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:03:58.039577 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a03b990_06d4_4e07_8ef1_771f8b853040.slice/crio-8aa166cf532a53b6c9b8369c9805fec64a364201a6af15060847a77486c9ab94 WatchSource:0}: Error finding container 8aa166cf532a53b6c9b8369c9805fec64a364201a6af15060847a77486c9ab94: Status 404 returned error can't find the container with id 8aa166cf532a53b6c9b8369c9805fec64a364201a6af15060847a77486c9ab94 Jul 09 14:03:58.744998 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:58.744964 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:58.817200 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:58.817156 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:03:58.933626 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:58.933578 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dwp56" event={"ID":"2a03b990-06d4-4e07-8ef1-771f8b853040","Type":"ContainerStarted","Data":"8aa166cf532a53b6c9b8369c9805fec64a364201a6af15060847a77486c9ab94"} Jul 09 14:03:58.934858 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:58.934833 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sm7hq" event={"ID":"dd6bd814-79b7-4e7b-beeb-e04976f6d1d9","Type":"ContainerStarted","Data":"dcd7f1b41c02b04b1ca1f57530ec599e947b949b89113585fc5b0ebf43ce3397"} Jul 09 14:03:58.938239 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:03:58.938212 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-clsk2" event={"ID":"37f5d43f-9abe-4758-bba1-59ae699d42ec","Type":"ContainerStarted","Data":"cc916a8ab2e7e2b160758bb594e86d2d283f860fcf8eaf09c4daa24346a9d491"} Jul 09 14:04:00.947785 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:00.947741 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" event={"ID":"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd","Type":"ContainerStarted","Data":"ec27401708dd36fde5bb5175a490eae3e95483ef146c4bc62a38e783525347a1"} Jul 09 14:04:00.948276 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:00.947802 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" event={"ID":"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd","Type":"ContainerStarted","Data":"5f125404424b4029fafcccec26903fa7c22d4e369294ff54e3c9944655aa6fb6"} Jul 09 14:04:00.948276 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:00.947824 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" event={"ID":"9f81c0fc-5cf7-4dfb-a2ce-f55f394e99fd","Type":"ContainerStarted","Data":"dc94a4c2e3d5ca5eeea00b86aa984604e40b7d13a43618332e4d46d64aecf3f2"} Jul 09 14:04:00.950601 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:00.950555 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749484968d-qm7k4" event={"ID":"8eba532d-c84b-432f-885a-d8c945473235","Type":"ContainerStarted","Data":"423f030750ade44ea9222f4ab404bf9004faa16fd77a8a145b74d766642b9646"} Jul 09 14:04:00.950810 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:00.950782 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749484968d-qm7k4" Jul 09 14:04:00.952603 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:00.952581 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749484968d-qm7k4" Jul 09 14:04:00.967332 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:00.967254 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-c5f946bbc-9p2z2" podStartSLOduration=1.8640920890000001 podStartE2EDuration="6.967232869s" totalImagesPullingTime="5.10314078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:00.96647743 +0000 UTC m=+70.166977807" watchObservedRunningTime="2026-07-09 14:04:00.967232869 +0000 UTC m=+70.167733243" Jul 09 14:04:00.982943 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:00.982886 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-749484968d-qm7k4" podStartSLOduration=1.86383777 podStartE2EDuration="6.982868336s" totalImagesPullingTime="5.119030566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:00.982743843 +0000 UTC m=+70.183244217" watchObservedRunningTime="2026-07-09 14:04:00.982868336 +0000 UTC m=+70.183368754" Jul 09 14:04:01.957948 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:01.957837 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sm7hq" event={"ID":"dd6bd814-79b7-4e7b-beeb-e04976f6d1d9","Type":"ContainerStarted","Data":"327a61eb2464fe8739da18cd949ee11d1663e53bb56cc37569d8867478996253"} Jul 09 14:04:01.957948 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:01.957908 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sm7hq" event={"ID":"dd6bd814-79b7-4e7b-beeb-e04976f6d1d9","Type":"ContainerStarted","Data":"7ae9d287441f79ed543e97e48d07d0ea4b9be62c36a54e60977c4ecc5ba3a068"} Jul 09 14:04:01.976427 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:01.976366 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sm7hq" podStartSLOduration=67.858171468 podStartE2EDuration="1m10.976343364s" totalImagesPullingTime="3.118171896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:01.974919731 +0000 UTC m=+71.175420118" watchObservedRunningTime="2026-07-09 14:04:01.976343364 +0000 UTC m=+71.176843738" Jul 09 14:04:02.125574 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:02.125526 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:02.216088 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:02.216051 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:02.553864 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:02.553769 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5104694c-794d-4177-8593-82b31d38f9fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:04:02.556762 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:02.556697 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5104694c-794d-4177-8593-82b31d38f9fd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bx4d4\" (UID: \"5104694c-794d-4177-8593-82b31d38f9fd\") " pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:04:02.760531 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:02.760501 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zvwkr\"" Jul 09 14:04:02.768003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:02.767965 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bx4d4" Jul 09 14:04:03.335157 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:03.335118 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bx4d4"] Jul 09 14:04:03.338402 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:04:03.338371 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5104694c_794d_4177_8593_82b31d38f9fd.slice/crio-521be6f9da3a7e014ecfa8617c4bea82ccc5e6d38f9e299a80866d5232a77bf7 WatchSource:0}: Error finding container 521be6f9da3a7e014ecfa8617c4bea82ccc5e6d38f9e299a80866d5232a77bf7: Status 404 returned error can't find the container with id 521be6f9da3a7e014ecfa8617c4bea82ccc5e6d38f9e299a80866d5232a77bf7 Jul 09 14:04:03.848868 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:03.848828 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:03.902622 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:03.902589 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:03.968094 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:03.967326 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dwp56" event={"ID":"2a03b990-06d4-4e07-8ef1-771f8b853040","Type":"ContainerStarted","Data":"1aab340797825f73717290eac7dfa9bba5b8c744392e590c32a27a0b002ac6b5"} Jul 09 14:04:03.968094 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:03.968043 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:04:03.969790 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:03.969675 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bx4d4" event={"ID":"5104694c-794d-4177-8593-82b31d38f9fd","Type":"ContainerStarted","Data":"521be6f9da3a7e014ecfa8617c4bea82ccc5e6d38f9e299a80866d5232a77bf7"} Jul 09 14:04:03.985572 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:03.984760 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dwp56" podStartSLOduration=67.6192084 podStartE2EDuration="1m12.98473484s" totalImagesPullingTime="5.36552644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:03.984421709 +0000 UTC m=+73.184922085" watchObservedRunningTime="2026-07-09 14:04:03.98473484 +0000 UTC m=+73.185235217" Jul 09 14:04:04.068675 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:04.068628 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:04.142220 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:04.142132 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:04.420728 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:04.420585 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:06.031390 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:06.031342 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:08.310724 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:08.310636 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:08.990227 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:08.990189 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bx4d4" event={"ID":"5104694c-794d-4177-8593-82b31d38f9fd","Type":"ContainerStarted","Data":"0bed27948f83c2a59c9afeecd9f2fb90068565cc4d8cb26a3ab25db97b8dca15"} Jul 09 14:04:08.991925 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:08.991896 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-clsk2" event={"ID":"37f5d43f-9abe-4758-bba1-59ae699d42ec","Type":"ContainerStarted","Data":"d8253d1c6502d6d3b51ed2257d827f16efaf4df556e1196cf8ecdd6ea7eb8169"} Jul 09 14:04:09.016128 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:09.016079 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-clsk2" podStartSLOduration=67.997815257 podStartE2EDuration="1m18.016062118s" totalImagesPullingTime="10.018246861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:09.015216524 +0000 UTC m=+78.215716918" watchObservedRunningTime="2026-07-09 14:04:09.016062118 +0000 UTC m=+78.216562492" Jul 09 14:04:09.999053 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:09.999015 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bx4d4" event={"ID":"5104694c-794d-4177-8593-82b31d38f9fd","Type":"ContainerStarted","Data":"2693a675b7231b2e3f899d519388e3eb0a0c34f81846aacfcdb2173314a7763f"} Jul 09 14:04:10.262636 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:10.262553 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:12.008278 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.008238 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bx4d4" event={"ID":"5104694c-794d-4177-8593-82b31d38f9fd","Type":"ContainerStarted","Data":"350e158dadd2e1fefb45a3637d38c28648c5970bd48dd113949a5407f22e3e80"} Jul 09 14:04:12.032327 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.032242 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bx4d4" podStartSLOduration=33.704366414 podStartE2EDuration="42.03222442s" totalImagesPullingTime="8.327858006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:03:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:12.031131518 +0000 UTC m=+81.231631913" watchObservedRunningTime="2026-07-09 14:04:12.03222442 +0000 UTC m=+81.232724794" Jul 09 14:04:12.208486 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.208405 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:12.470541 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.470507 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:12.505520 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.505482 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2kswm"] Jul 09 14:04:12.508695 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.508669 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.511461 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.511417 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 14:04:12.511597 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.511578 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 14:04:12.511667 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.511654 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 14:04:12.512532 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.512515 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 14:04:12.512802 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.512786 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t8b2p\"" Jul 09 14:04:12.512875 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.512790 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 14:04:12.512875 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.512850 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 14:04:12.554242 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.554209 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:12.615893 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.615859 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:12.634950 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.634911 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-root\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.634950 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.634951 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-sys\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.635144 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.634973 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f77kj\" (UniqueName: \"kubernetes.io/projected/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-kube-api-access-f77kj\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.635144 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.635031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-node-exporter-tls\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.635144 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.635069 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.635144 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.635114 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-node-exporter-textfile\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.635144 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.635135 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.635298 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.635160 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-metrics-client-ca\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.635298 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.635176 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-node-exporter-wtmp\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.735643 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.735551 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f77kj\" (UniqueName: \"kubernetes.io/projected/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-kube-api-access-f77kj\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.735643 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.735601 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-node-exporter-tls\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.735869 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.735775 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.735869 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.735830 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-node-exporter-textfile\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.735976 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.735871 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.735976 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.735901 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-metrics-client-ca\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.735976 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.735926 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-node-exporter-wtmp\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.736295 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.736020 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-root\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.736295 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.736167 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-node-exporter-textfile\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.736295 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.736173 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-sys\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.736295 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.736174 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-node-exporter-wtmp\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.736295 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.736254 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-root\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.736295 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.736253 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-sys\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.736624 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.736601 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-metrics-client-ca\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.736700 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.736683 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.738599 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.738569 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.738693 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.738656 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-node-exporter-tls\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.744365 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.744342 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f77kj\" (UniqueName: \"kubernetes.io/projected/2f6cea8e-94c6-4d10-9cc7-e9555a0253e1-kube-api-access-f77kj\") pod \"node-exporter-2kswm\" (UID: \"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1\") " pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.800755 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.800711 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:12.818128 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.818096 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2kswm" Jul 09 14:04:12.829828 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:04:12.829798 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f6cea8e_94c6_4d10_9cc7_e9555a0253e1.slice/crio-4d3cded2f881bd745255b29deab364a79a6bf77531903383f5eff5dbbe23b4dc WatchSource:0}: Error finding container 4d3cded2f881bd745255b29deab364a79a6bf77531903383f5eff5dbbe23b4dc: Status 404 returned error can't find the container with id 4d3cded2f881bd745255b29deab364a79a6bf77531903383f5eff5dbbe23b4dc Jul 09 14:04:12.902424 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.902390 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:12.968786 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:12.968752 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:13.013150 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:13.013069 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2kswm" event={"ID":"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1","Type":"ContainerStarted","Data":"4d3cded2f881bd745255b29deab364a79a6bf77531903383f5eff5dbbe23b4dc"} Jul 09 14:04:13.142338 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:13.142293 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:13.556112 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:13.556080 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:13.682807 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:13.682775 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:13.794914 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:13.794870 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:13.894691 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:13.894614 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:14.018931 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:14.018897 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2kswm" event={"ID":"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1","Type":"ContainerStarted","Data":"65ff8a5a808562c5df02d301acc670d881f85dd674301412928d93600593d6d5"} Jul 09 14:04:14.048557 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:14.048528 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:14.150553 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:14.150466 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:14.410130 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:14.410047 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:14.509747 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:14.509493 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:15.024369 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:15.024337 2581 generic.go:356] "Generic (PLEG): container finished" podID="2f6cea8e-94c6-4d10-9cc7-e9555a0253e1" containerID="65ff8a5a808562c5df02d301acc670d881f85dd674301412928d93600593d6d5" exitCode=0 Jul 09 14:04:15.024862 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:15.024417 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2kswm" event={"ID":"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1","Type":"ContainerDied","Data":"65ff8a5a808562c5df02d301acc670d881f85dd674301412928d93600593d6d5"} Jul 09 14:04:15.095611 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:15.095584 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:15.159125 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:15.159095 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:15.365124 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:15.365047 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:15.425565 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:15.425533 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:15.545583 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:15.545552 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:15.647026 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:15.646945 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:15.764997 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:15.764961 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:15.967648 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:15.967623 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:16.030548 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:16.030519 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2kswm" event={"ID":"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1","Type":"ContainerStarted","Data":"0b5580494e43a5491d00925f8b8db96d7dac1b4d606051f3d3c4f6d20dfcea9f"} Jul 09 14:04:16.030906 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:16.030570 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2kswm" event={"ID":"2f6cea8e-94c6-4d10-9cc7-e9555a0253e1","Type":"ContainerStarted","Data":"c127f2632c045246bfff2d222ba7b869b8764fcbfeae6d9e7dda64e14ed232c6"} Jul 09 14:04:16.060740 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:16.060687 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2kswm" podStartSLOduration=2.926440897 podStartE2EDuration="4.060668663s" totalImagesPullingTime="1.069172229s" totalInitContainerRuntime="65.055537ms" isStatefulPod=true podCreationTimestamp="2026-07-09 14:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:16.05888467 +0000 UTC m=+85.259385055" watchObservedRunningTime="2026-07-09 14:04:16.060668663 +0000 UTC m=+85.261169072" Jul 09 14:04:16.140094 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:16.140054 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:16.870767 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:16.870721 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:16.981214 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:16.981184 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:17.064119 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:17.064081 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:17.225862 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:17.225834 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:17.298528 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:17.298498 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:17.434238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:17.434202 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:17.535557 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:17.535432 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:18.146533 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:18.146499 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:18.730032 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:18.729966 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:20.480539 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:20.480505 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:20.579121 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:20.579091 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:26.271979 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:26.271948 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:26.334018 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:26.333989 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:28.663799 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:28.663761 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:28.767275 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:28.767245 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:29.476074 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:29.476044 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:29.576988 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:29.576952 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:29.632922 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:29.632895 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:29.686165 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:29.686137 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:30.087435 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:30.087375 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:30.188769 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:30.188737 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:31.978180 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:31.978143 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:32.078094 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:32.078031 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:33.751733 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:33.751681 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:35.979892 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:35.979859 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dwp56" Jul 09 14:04:36.223611 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:36.223573 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:38.193614 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:38.193545 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:40.588285 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:40.588250 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:40.641402 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:40.641367 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:42.403155 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:42.403116 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:42.560024 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:42.559989 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:43.186169 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:43.186104 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:43.247564 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:43.247532 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:44.587287 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:44.587239 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:45.051097 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:45.051069 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:45.148451 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:45.148421 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:45.165190 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:45.165165 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2kswm_2f6cea8e-94c6-4d10-9cc7-e9555a0253e1/init-textfile/0.log" Jul 09 14:04:45.248903 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:45.248860 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:04:45.365824 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:45.365758 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2kswm_2f6cea8e-94c6-4d10-9cc7-e9555a0253e1/node-exporter/0.log" Jul 09 14:04:45.565937 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:45.565910 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2kswm_2f6cea8e-94c6-4d10-9cc7-e9555a0253e1/kube-rbac-proxy/0.log" Jul 09 14:04:52.365883 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:04:52.365859 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hbdrf_c93815c9-e9c5-4115-98f2-1ff14b09553a/serve-healthcheck-canary/0.log" Jul 09 14:05:00.090051 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:05:00.090003 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:00.154636 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:05:00.154583 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:01.548435 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:05:01.548398 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:01.657601 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:05:01.657566 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:01.831543 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:05:01.831446 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:31.724917 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:05:31.724884 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:31.824027 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:05:31.823994 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:40.952785 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:05:40.952753 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:41.014229 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:05:41.014198 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:41.164099 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:05:41.164064 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:41.269837 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:05:41.269804 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:41.701046 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:05:41.700944 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:41.803277 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:05:41.803244 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:52.036530 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:05:52.036451 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:52.136148 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:05:52.136102 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:52.236363 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:05:52.236305 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:52.303551 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:05:52.303488 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:05:53.516513 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:05:53.516484 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:11.872595 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:06:11.872553 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:11.947812 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:06:11.947770 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:41.546647 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:06:41.546594 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:46.975296 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:06:46.975263 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:47.045524 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:06:47.045485 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:58.971971 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:06:58.971938 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:06:59.048901 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:06:59.048872 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:13.937827 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:07:13.937724 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:13.997986 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:07:13.997956 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:14.085428 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:07:14.085379 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:14.141075 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:07:14.141044 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:14.701973 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:07:14.701938 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:14.754300 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:07:14.754266 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:15.098704 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:07:15.098668 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:15.198418 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:07:15.198384 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:24.424455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:07:24.424414 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:24.526186 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:07:24.526154 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:24.584761 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:07:24.584726 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:39.559672 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:07:39.559621 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:39.656063 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:07:39.656030 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:07:51.399807 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:07:51.399779 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 14:08:06.277238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:06.277210 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:09.021228 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:09.021194 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:09.891662 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:09.891603 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:09.996626 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:09.996596 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:14.684773 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:14.684726 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:15.976699 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:15.976662 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:25.996114 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:25.996048 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:26.102998 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:26.102958 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:26.296900 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:26.296794 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:26.393798 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:26.393757 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:27.235750 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:27.235718 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-b45lg"] Jul 09 14:08:27.237602 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:27.237587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-b45lg" Jul 09 14:08:27.240232 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:27.240210 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 14:08:27.240352 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:27.240222 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-x7ln4\"" Jul 09 14:08:27.241445 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:27.241429 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 14:08:27.247427 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:27.247405 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-b45lg"] Jul 09 14:08:27.308904 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:27.308859 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ded51425-8395-406d-8428-d92c2286d9ba-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-b45lg\" (UID: \"ded51425-8395-406d-8428-d92c2286d9ba\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b45lg" Jul 09 14:08:27.308904 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:27.308907 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr62w\" (UniqueName: \"kubernetes.io/projected/ded51425-8395-406d-8428-d92c2286d9ba-kube-api-access-nr62w\") pod \"cert-manager-webhook-6486ffd997-b45lg\" (UID: \"ded51425-8395-406d-8428-d92c2286d9ba\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b45lg" Jul 09 14:08:27.410084 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:27.410051 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ded51425-8395-406d-8428-d92c2286d9ba-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-b45lg\" (UID: \"ded51425-8395-406d-8428-d92c2286d9ba\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b45lg" Jul 09 14:08:27.410187 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:27.410091 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr62w\" (UniqueName: \"kubernetes.io/projected/ded51425-8395-406d-8428-d92c2286d9ba-kube-api-access-nr62w\") pod \"cert-manager-webhook-6486ffd997-b45lg\" (UID: \"ded51425-8395-406d-8428-d92c2286d9ba\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b45lg" Jul 09 14:08:27.419143 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:27.419109 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ded51425-8395-406d-8428-d92c2286d9ba-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-b45lg\" (UID: \"ded51425-8395-406d-8428-d92c2286d9ba\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b45lg" Jul 09 14:08:27.419292 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:27.419273 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr62w\" (UniqueName: \"kubernetes.io/projected/ded51425-8395-406d-8428-d92c2286d9ba-kube-api-access-nr62w\") pod \"cert-manager-webhook-6486ffd997-b45lg\" (UID: \"ded51425-8395-406d-8428-d92c2286d9ba\") " pod="cert-manager/cert-manager-webhook-6486ffd997-b45lg" Jul 09 14:08:27.546450 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:27.546356 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-b45lg" Jul 09 14:08:27.671060 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:27.671031 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-b45lg"] Jul 09 14:08:27.674146 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:08:27.674121 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podded51425_8395_406d_8428_d92c2286d9ba.slice/crio-c40bbf8075eea062706db2ae61b056200d26711b5db017a75d1b1b65346e34ce WatchSource:0}: Error finding container c40bbf8075eea062706db2ae61b056200d26711b5db017a75d1b1b65346e34ce: Status 404 returned error can't find the container with id c40bbf8075eea062706db2ae61b056200d26711b5db017a75d1b1b65346e34ce Jul 09 14:08:27.675901 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:27.675882 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:08:27.818025 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:27.817945 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-b45lg" event={"ID":"ded51425-8395-406d-8428-d92c2286d9ba","Type":"ContainerStarted","Data":"c40bbf8075eea062706db2ae61b056200d26711b5db017a75d1b1b65346e34ce"} Jul 09 14:08:28.663788 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:28.663760 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:28.859408 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:28.859376 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:32.835779 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:32.835745 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-b45lg" event={"ID":"ded51425-8395-406d-8428-d92c2286d9ba","Type":"ContainerStarted","Data":"de3cb09ceb1cb68f2bbd6ef9f5cc5d0fd844baf56205c059239ad2eb4182adfb"} Jul 09 14:08:32.836186 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:32.835808 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-b45lg" Jul 09 14:08:32.852190 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:32.852054 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-b45lg" podStartSLOduration=1.216261751 podStartE2EDuration="5.852036153s" totalImagesPullingTime="4.635774402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:08:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:08:32.851840649 +0000 UTC m=+342.052341042" watchObservedRunningTime="2026-07-09 14:08:32.852036153 +0000 UTC m=+342.052536527" Jul 09 14:08:34.224849 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:34.224814 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:36.368004 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:36.367972 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:36.470877 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:36.470827 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:36.580563 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:36.580519 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:38.843248 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:38.843219 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-b45lg" Jul 09 14:08:44.954354 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:44.954248 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:46.496756 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:46.496719 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:46.942324 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:46.942201 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:57.148733 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.148680 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:57.205898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.205862 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f"] Jul 09 14:08:57.208284 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.208256 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f" Jul 09 14:08:57.212245 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.212224 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 14:08:57.212245 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.212236 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 14:08:57.212456 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.212274 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:08:57.212456 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.212331 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 14:08:57.212456 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.212226 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9js8j\"" Jul 09 14:08:57.212612 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.212486 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 14:08:57.218907 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.218882 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f"] Jul 09 14:08:57.227996 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.227973 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:08:57.307729 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.307691 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a-manager-config\") pod \"lws-controller-manager-677b74f79f-fwm7f\" (UID: \"bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f" Jul 09 14:08:57.307925 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.307735 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a-metrics-cert\") pod \"lws-controller-manager-677b74f79f-fwm7f\" (UID: \"bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f" Jul 09 14:08:57.307925 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.307771 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvc9k\" (UniqueName: \"kubernetes.io/projected/bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a-kube-api-access-xvc9k\") pod \"lws-controller-manager-677b74f79f-fwm7f\" (UID: \"bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f" Jul 09 14:08:57.307925 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.307809 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a-cert\") pod \"lws-controller-manager-677b74f79f-fwm7f\" (UID: \"bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f" Jul 09 14:08:57.408686 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.408600 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a-manager-config\") pod \"lws-controller-manager-677b74f79f-fwm7f\" (UID: \"bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f" Jul 09 14:08:57.408686 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.408637 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a-metrics-cert\") pod \"lws-controller-manager-677b74f79f-fwm7f\" (UID: \"bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f" Jul 09 14:08:57.408686 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.408659 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvc9k\" (UniqueName: \"kubernetes.io/projected/bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a-kube-api-access-xvc9k\") pod \"lws-controller-manager-677b74f79f-fwm7f\" (UID: \"bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f" Jul 09 14:08:57.408898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.408694 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a-cert\") pod \"lws-controller-manager-677b74f79f-fwm7f\" (UID: \"bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f" Jul 09 14:08:57.409268 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.409237 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a-manager-config\") pod \"lws-controller-manager-677b74f79f-fwm7f\" (UID: \"bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f" Jul 09 14:08:57.411219 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.411198 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a-cert\") pod \"lws-controller-manager-677b74f79f-fwm7f\" (UID: \"bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f" Jul 09 14:08:57.411433 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.411418 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a-metrics-cert\") pod \"lws-controller-manager-677b74f79f-fwm7f\" (UID: \"bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f" Jul 09 14:08:57.424669 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.424635 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvc9k\" (UniqueName: \"kubernetes.io/projected/bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a-kube-api-access-xvc9k\") pod \"lws-controller-manager-677b74f79f-fwm7f\" (UID: \"bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f" Jul 09 14:08:57.517491 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.517458 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f" Jul 09 14:08:57.651058 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.651023 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f"] Jul 09 14:08:57.654024 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:08:57.653991 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd0e5246_8aef_4a90_ad1a_4744b0d1cb6a.slice/crio-4c8192d50eb2a8f323ba863453a2308ae1083d6757a2efbfeccd4439a6dfee54 WatchSource:0}: Error finding container 4c8192d50eb2a8f323ba863453a2308ae1083d6757a2efbfeccd4439a6dfee54: Status 404 returned error can't find the container with id 4c8192d50eb2a8f323ba863453a2308ae1083d6757a2efbfeccd4439a6dfee54 Jul 09 14:08:57.917660 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:08:57.917625 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f" event={"ID":"bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a","Type":"ContainerStarted","Data":"4c8192d50eb2a8f323ba863453a2308ae1083d6757a2efbfeccd4439a6dfee54"} Jul 09 14:09:01.932475 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:01.932436 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f" event={"ID":"bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a","Type":"ContainerStarted","Data":"64b4e030ee9f9e644b7191ac248fe9cad3e9b21abbedf1341b4587275f60cf9e"} Jul 09 14:09:01.932955 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:01.932567 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f" Jul 09 14:09:01.951565 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:01.951465 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f" podStartSLOduration=0.904976555 podStartE2EDuration="4.951448698s" totalImagesPullingTime="4.046472143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:09:01.949872587 +0000 UTC m=+371.150372961" watchObservedRunningTime="2026-07-09 14:09:01.951448698 +0000 UTC m=+371.151949071" Jul 09 14:09:05.794082 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:05.794051 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:05.888332 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:05.888288 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:05.992496 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:05.992469 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq"] Jul 09 14:09:05.997554 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:05.997536 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" Jul 09 14:09:06.003653 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.003626 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 14:09:06.003996 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.003981 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 14:09:06.004087 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.004068 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 14:09:06.005106 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.005085 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qwmbp\"" Jul 09 14:09:06.005765 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.005748 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 14:09:06.024162 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.024125 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq"] Jul 09 14:09:06.080078 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.079992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1af7c5dd-633a-40cf-b479-6a96810ee3d9-tmp\") pod \"opendatahub-operator-controller-manager-6f67568454-d6nzq\" (UID: \"1af7c5dd-633a-40cf-b479-6a96810ee3d9\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" Jul 09 14:09:06.080078 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.080033 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kgjz\" (UniqueName: \"kubernetes.io/projected/1af7c5dd-633a-40cf-b479-6a96810ee3d9-kube-api-access-6kgjz\") pod \"opendatahub-operator-controller-manager-6f67568454-d6nzq\" (UID: \"1af7c5dd-633a-40cf-b479-6a96810ee3d9\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" Jul 09 14:09:06.080078 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.080055 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1af7c5dd-633a-40cf-b479-6a96810ee3d9-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f67568454-d6nzq\" (UID: \"1af7c5dd-633a-40cf-b479-6a96810ee3d9\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" Jul 09 14:09:06.080290 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.080123 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1af7c5dd-633a-40cf-b479-6a96810ee3d9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f67568454-d6nzq\" (UID: \"1af7c5dd-633a-40cf-b479-6a96810ee3d9\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" Jul 09 14:09:06.080290 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.080163 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1af7c5dd-633a-40cf-b479-6a96810ee3d9-manifests\") pod \"opendatahub-operator-controller-manager-6f67568454-d6nzq\" (UID: \"1af7c5dd-633a-40cf-b479-6a96810ee3d9\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" Jul 09 14:09:06.170760 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.170729 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:06.180855 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.180822 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1af7c5dd-633a-40cf-b479-6a96810ee3d9-manifests\") pod \"opendatahub-operator-controller-manager-6f67568454-d6nzq\" (UID: \"1af7c5dd-633a-40cf-b479-6a96810ee3d9\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" Jul 09 14:09:06.180995 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.180867 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1af7c5dd-633a-40cf-b479-6a96810ee3d9-tmp\") pod \"opendatahub-operator-controller-manager-6f67568454-d6nzq\" (UID: \"1af7c5dd-633a-40cf-b479-6a96810ee3d9\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" Jul 09 14:09:06.180995 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.180906 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kgjz\" (UniqueName: \"kubernetes.io/projected/1af7c5dd-633a-40cf-b479-6a96810ee3d9-kube-api-access-6kgjz\") pod \"opendatahub-operator-controller-manager-6f67568454-d6nzq\" (UID: \"1af7c5dd-633a-40cf-b479-6a96810ee3d9\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" Jul 09 14:09:06.180995 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.180927 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1af7c5dd-633a-40cf-b479-6a96810ee3d9-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f67568454-d6nzq\" (UID: \"1af7c5dd-633a-40cf-b479-6a96810ee3d9\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" Jul 09 14:09:06.180995 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.180950 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1af7c5dd-633a-40cf-b479-6a96810ee3d9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f67568454-d6nzq\" (UID: \"1af7c5dd-633a-40cf-b479-6a96810ee3d9\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" Jul 09 14:09:06.181263 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.181243 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1af7c5dd-633a-40cf-b479-6a96810ee3d9-manifests\") pod \"opendatahub-operator-controller-manager-6f67568454-d6nzq\" (UID: \"1af7c5dd-633a-40cf-b479-6a96810ee3d9\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" Jul 09 14:09:06.183227 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.183202 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1af7c5dd-633a-40cf-b479-6a96810ee3d9-tmp\") pod \"opendatahub-operator-controller-manager-6f67568454-d6nzq\" (UID: \"1af7c5dd-633a-40cf-b479-6a96810ee3d9\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" Jul 09 14:09:06.183471 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.183453 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1af7c5dd-633a-40cf-b479-6a96810ee3d9-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f67568454-d6nzq\" (UID: \"1af7c5dd-633a-40cf-b479-6a96810ee3d9\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" Jul 09 14:09:06.183553 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.183526 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1af7c5dd-633a-40cf-b479-6a96810ee3d9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f67568454-d6nzq\" (UID: \"1af7c5dd-633a-40cf-b479-6a96810ee3d9\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" Jul 09 14:09:06.189648 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.189625 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kgjz\" (UniqueName: \"kubernetes.io/projected/1af7c5dd-633a-40cf-b479-6a96810ee3d9-kube-api-access-6kgjz\") pod \"opendatahub-operator-controller-manager-6f67568454-d6nzq\" (UID: \"1af7c5dd-633a-40cf-b479-6a96810ee3d9\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" Jul 09 14:09:06.271853 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.271824 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:06.307713 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.307685 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" Jul 09 14:09:06.374529 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.374497 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:06.443004 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.442971 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq"] Jul 09 14:09:06.445965 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:09:06.445927 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1af7c5dd_633a_40cf_b479_6a96810ee3d9.slice/crio-94d21a8675ca5e8d211cf1244d261f321c2ecb61c38918051850b21bff250e3b WatchSource:0}: Error finding container 94d21a8675ca5e8d211cf1244d261f321c2ecb61c38918051850b21bff250e3b: Status 404 returned error can't find the container with id 94d21a8675ca5e8d211cf1244d261f321c2ecb61c38918051850b21bff250e3b Jul 09 14:09:06.449134 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.449110 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:06.950450 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:06.950415 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" event={"ID":"1af7c5dd-633a-40cf-b479-6a96810ee3d9","Type":"ContainerStarted","Data":"94d21a8675ca5e8d211cf1244d261f321c2ecb61c38918051850b21bff250e3b"} Jul 09 14:09:08.222670 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:08.222635 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:08.323861 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:08.323826 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:09.966023 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:09.965989 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" event={"ID":"1af7c5dd-633a-40cf-b479-6a96810ee3d9","Type":"ContainerStarted","Data":"89cbf5c4bc688e31a379bc2e3333a8e156acdbad621e9258588c6221b0a10310"} Jul 09 14:09:10.971270 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:10.971233 2581 generic.go:356] "Generic (PLEG): container finished" podID="1af7c5dd-633a-40cf-b479-6a96810ee3d9" containerID="89cbf5c4bc688e31a379bc2e3333a8e156acdbad621e9258588c6221b0a10310" exitCode=0 Jul 09 14:09:10.971653 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:10.971333 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" event={"ID":"1af7c5dd-633a-40cf-b479-6a96810ee3d9","Type":"ContainerDied","Data":"89cbf5c4bc688e31a379bc2e3333a8e156acdbad621e9258588c6221b0a10310"} Jul 09 14:09:12.937975 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:12.937945 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-677b74f79f-fwm7f" Jul 09 14:09:12.981154 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:12.981116 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" event={"ID":"1af7c5dd-633a-40cf-b479-6a96810ee3d9","Type":"ContainerStarted","Data":"aa0e6fd4d7377f8feb4a83396824d20be90a71941cdf0af0967f0744eb1c44e0"} Jul 09 14:09:12.981360 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:12.981236 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" Jul 09 14:09:13.002531 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:13.002483 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" podStartSLOduration=2.796816577 podStartE2EDuration="8.002466222s" totalImagesPullingTime="4.127373071s" totalInitContainerRuntime="1.078276574s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:09:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:09:13.001065972 +0000 UTC m=+382.201566367" watchObservedRunningTime="2026-07-09 14:09:13.002466222 +0000 UTC m=+382.202966595" Jul 09 14:09:23.987291 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:23.987261 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-d6nzq" Jul 09 14:09:26.960151 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:26.960115 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:28.183377 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:28.183345 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:28.282806 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:28.282769 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:28.394808 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:28.394766 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:28.815607 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:28.815578 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:28.950277 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:28.950242 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:29.007270 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:29.007237 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:29.957610 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:29.957568 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:34.578504 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:34.578474 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:34.645021 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:34.644991 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:35.314230 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.314199 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh"] Jul 09 14:09:35.320903 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.320887 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.324459 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.324430 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 14:09:35.324629 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.324610 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 14:09:35.324706 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.324642 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 14:09:35.324812 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.324797 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-dr9hv\"" Jul 09 14:09:35.349711 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.349673 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh"] Jul 09 14:09:35.363042 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.363016 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:35.395741 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.395703 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d69dfb3-cbce-4854-a972-d35b9080a52d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.395741 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.395743 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d69dfb3-cbce-4854-a972-d35b9080a52d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.395946 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.395798 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d69dfb3-cbce-4854-a972-d35b9080a52d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.395946 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.395833 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d69dfb3-cbce-4854-a972-d35b9080a52d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.395946 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.395882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d69dfb3-cbce-4854-a972-d35b9080a52d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.395946 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.395922 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d69dfb3-cbce-4854-a972-d35b9080a52d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.396073 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.395953 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d69dfb3-cbce-4854-a972-d35b9080a52d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.396073 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.396006 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fncdw\" (UniqueName: \"kubernetes.io/projected/2d69dfb3-cbce-4854-a972-d35b9080a52d-kube-api-access-fncdw\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.396073 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.396040 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d69dfb3-cbce-4854-a972-d35b9080a52d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.497345 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.497288 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d69dfb3-cbce-4854-a972-d35b9080a52d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.497345 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.497345 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d69dfb3-cbce-4854-a972-d35b9080a52d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.497558 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.497366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d69dfb3-cbce-4854-a972-d35b9080a52d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.497558 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.497399 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fncdw\" (UniqueName: \"kubernetes.io/projected/2d69dfb3-cbce-4854-a972-d35b9080a52d-kube-api-access-fncdw\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.497558 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.497419 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d69dfb3-cbce-4854-a972-d35b9080a52d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.497558 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.497467 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d69dfb3-cbce-4854-a972-d35b9080a52d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.497558 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.497494 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d69dfb3-cbce-4854-a972-d35b9080a52d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.497558 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.497556 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d69dfb3-cbce-4854-a972-d35b9080a52d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.497831 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.497641 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d69dfb3-cbce-4854-a972-d35b9080a52d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.497831 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.497749 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d69dfb3-cbce-4854-a972-d35b9080a52d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.497943 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.497919 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2d69dfb3-cbce-4854-a972-d35b9080a52d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.497998 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.497971 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2d69dfb3-cbce-4854-a972-d35b9080a52d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.498075 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.498051 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2d69dfb3-cbce-4854-a972-d35b9080a52d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.498244 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.498228 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2d69dfb3-cbce-4854-a972-d35b9080a52d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.499876 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.499847 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2d69dfb3-cbce-4854-a972-d35b9080a52d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.499988 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.499952 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2d69dfb3-cbce-4854-a972-d35b9080a52d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.507084 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.507063 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2d69dfb3-cbce-4854-a972-d35b9080a52d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.507431 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.507412 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fncdw\" (UniqueName: \"kubernetes.io/projected/2d69dfb3-cbce-4854-a972-d35b9080a52d-kube-api-access-fncdw\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4kzmmh\" (UID: \"2d69dfb3-cbce-4854-a972-d35b9080a52d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.541159 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.541126 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:35.631279 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.631197 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:35.638483 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.638458 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:35.769013 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:35.768879 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh"] Jul 09 14:09:35.771573 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:09:35.771549 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d69dfb3_cbce_4854_a972_d35b9080a52d.slice/crio-9c3c569dbc578b364bae85cae7fa5ba5c3365a4e2cc7fbf6a89ee60b9b495740 WatchSource:0}: Error finding container 9c3c569dbc578b364bae85cae7fa5ba5c3365a4e2cc7fbf6a89ee60b9b495740: Status 404 returned error can't find the container with id 9c3c569dbc578b364bae85cae7fa5ba5c3365a4e2cc7fbf6a89ee60b9b495740 Jul 09 14:09:36.065292 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:36.065261 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" event={"ID":"2d69dfb3-cbce-4854-a972-d35b9080a52d","Type":"ContainerStarted","Data":"9c3c569dbc578b364bae85cae7fa5ba5c3365a4e2cc7fbf6a89ee60b9b495740"} Jul 09 14:09:37.711238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.711205 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd"] Jul 09 14:09:37.716190 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.716170 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:37.718990 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.718969 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 14:09:37.719115 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.719016 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 14:09:37.719115 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.719052 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vpkhx\"" Jul 09 14:09:37.719323 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.719293 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 14:09:37.728115 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.728096 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd"] Jul 09 14:09:37.816102 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.816065 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b886bb7f-2e6e-4182-a2d5-c7b6efc076e9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-ngwnd\" (UID: \"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:37.816102 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.816103 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b886bb7f-2e6e-4182-a2d5-c7b6efc076e9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-ngwnd\" (UID: \"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:37.816354 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.816132 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b886bb7f-2e6e-4182-a2d5-c7b6efc076e9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ngwnd\" (UID: \"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:37.816354 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.816164 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b886bb7f-2e6e-4182-a2d5-c7b6efc076e9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-ngwnd\" (UID: \"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:37.816354 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.816251 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn9lx\" (UniqueName: \"kubernetes.io/projected/b886bb7f-2e6e-4182-a2d5-c7b6efc076e9-kube-api-access-xn9lx\") pod \"istiod-openshift-gateway-94bb8fbfd-ngwnd\" (UID: \"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:37.816354 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.816286 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b886bb7f-2e6e-4182-a2d5-c7b6efc076e9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-ngwnd\" (UID: \"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:37.816354 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.816330 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b886bb7f-2e6e-4182-a2d5-c7b6efc076e9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-ngwnd\" (UID: \"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:37.917628 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.917593 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b886bb7f-2e6e-4182-a2d5-c7b6efc076e9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-ngwnd\" (UID: \"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:37.917628 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.917630 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b886bb7f-2e6e-4182-a2d5-c7b6efc076e9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-ngwnd\" (UID: \"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:37.917858 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.917656 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b886bb7f-2e6e-4182-a2d5-c7b6efc076e9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ngwnd\" (UID: \"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:37.917858 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.917683 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b886bb7f-2e6e-4182-a2d5-c7b6efc076e9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-ngwnd\" (UID: \"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:37.917858 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.917714 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn9lx\" (UniqueName: \"kubernetes.io/projected/b886bb7f-2e6e-4182-a2d5-c7b6efc076e9-kube-api-access-xn9lx\") pod \"istiod-openshift-gateway-94bb8fbfd-ngwnd\" (UID: \"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:37.917858 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.917752 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b886bb7f-2e6e-4182-a2d5-c7b6efc076e9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-ngwnd\" (UID: \"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:37.917858 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.917785 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b886bb7f-2e6e-4182-a2d5-c7b6efc076e9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-ngwnd\" (UID: \"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:37.918770 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.918740 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b886bb7f-2e6e-4182-a2d5-c7b6efc076e9-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-ngwnd\" (UID: \"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:37.920782 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.920636 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b886bb7f-2e6e-4182-a2d5-c7b6efc076e9-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-ngwnd\" (UID: \"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:37.920782 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.920724 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b886bb7f-2e6e-4182-a2d5-c7b6efc076e9-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-ngwnd\" (UID: \"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:37.920782 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.920732 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b886bb7f-2e6e-4182-a2d5-c7b6efc076e9-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ngwnd\" (UID: \"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:37.920974 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.920826 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b886bb7f-2e6e-4182-a2d5-c7b6efc076e9-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-ngwnd\" (UID: \"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:37.936604 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.936578 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b886bb7f-2e6e-4182-a2d5-c7b6efc076e9-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-ngwnd\" (UID: \"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:37.936961 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:37.936938 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn9lx\" (UniqueName: \"kubernetes.io/projected/b886bb7f-2e6e-4182-a2d5-c7b6efc076e9-kube-api-access-xn9lx\") pod \"istiod-openshift-gateway-94bb8fbfd-ngwnd\" (UID: \"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:38.027964 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:38.027926 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:38.488571 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:38.488527 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:09:38.488658 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:38.488624 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:09:38.488695 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:38.488672 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:09:38.589025 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:38.588996 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd"] Jul 09 14:09:38.591332 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:09:38.591288 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb886bb7f_2e6e_4182_a2d5_c7b6efc076e9.slice/crio-6b1093910abd6bd1a7b9621c698906ed4da2fd063b2c706828b59601497e9b7a WatchSource:0}: Error finding container 6b1093910abd6bd1a7b9621c698906ed4da2fd063b2c706828b59601497e9b7a: Status 404 returned error can't find the container with id 6b1093910abd6bd1a7b9621c698906ed4da2fd063b2c706828b59601497e9b7a Jul 09 14:09:39.054043 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:39.054009 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:39.082120 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:39.082078 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" event={"ID":"2d69dfb3-cbce-4854-a972-d35b9080a52d","Type":"ContainerStarted","Data":"639407ae513b446e0458ef35449bd42c09345b2d5e88a408dac93fcf6d02ebe5"} Jul 09 14:09:39.083579 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:39.083482 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" event={"ID":"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9","Type":"ContainerStarted","Data":"6b1093910abd6bd1a7b9621c698906ed4da2fd063b2c706828b59601497e9b7a"} Jul 09 14:09:39.105764 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:39.105673 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" podStartSLOduration=1.390993401 podStartE2EDuration="4.105650202s" totalImagesPullingTime="2.714656801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:09:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:09:39.104697168 +0000 UTC m=+408.305197544" watchObservedRunningTime="2026-07-09 14:09:39.105650202 +0000 UTC m=+408.306150579" Jul 09 14:09:39.143475 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:39.143441 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:39.206037 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:39.206003 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:39.300455 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:39.300418 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:39.632042 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:39.632002 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:39.637397 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:39.637374 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:40.088055 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:40.088027 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:40.089217 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:40.089199 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4kzmmh" Jul 09 14:09:40.358439 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:40.358362 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:40.462034 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:40.461998 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:40.576092 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:40.576061 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:09:40.841369 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:40.841338 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:09:40.841454 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:40.841397 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:09:41.093439 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:41.093344 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" event={"ID":"b886bb7f-2e6e-4182-a2d5-c7b6efc076e9","Type":"ContainerStarted","Data":"6cd67c716b3d01d10213c18a59fc1c50e469bb01138f83dc949d7432708b4a0a"} Jul 09 14:09:41.137102 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:41.137057 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" podStartSLOduration=1.8894409680000002 podStartE2EDuration="4.13703566s" totalImagesPullingTime="2.247594692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:09:41.118484645 +0000 UTC m=+410.318985020" watchObservedRunningTime="2026-07-09 14:09:41.13703566 +0000 UTC m=+410.337536034" Jul 09 14:09:42.097129 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:42.097091 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:09:42.098823 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:09:42.098804 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ngwnd" Jul 09 14:10:28.612812 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:10:28.612728 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:10:28.721535 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:10:28.721505 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:10:28.811856 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:10:28.811825 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:10:51.054328 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:10:51.054269 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:10:51.155084 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:10:51.155050 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:01.710198 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:01.710120 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:01.816592 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:01.816541 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:03.825270 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:03.825235 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:04.626931 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:04.626902 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:09.249468 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:09.249430 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:11.879690 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:11.879653 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:11.970735 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:11.970703 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:12.264947 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:12.264877 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:13.397493 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:13.397460 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:13.495708 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:13.495655 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:13.889887 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:13.889856 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:15.032660 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:15.032630 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:15.143555 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:15.143523 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:16.871101 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:16.871056 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:19.956578 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:19.956542 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:20.056618 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:20.056583 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:20.158921 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:20.158890 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:20.285065 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:20.285031 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:21.253008 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:21.252975 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:24.040038 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:24.039990 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:24.281088 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:24.281052 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:27.033290 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:27.033254 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:27.087102 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:27.087069 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:28.903905 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:28.903873 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:29.354260 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:29.354225 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:31.375921 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:31.375890 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:31.476737 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:31.476704 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:31.576445 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:31.576405 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:40.042919 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:40.042888 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:40.156900 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:40.156865 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:43.220953 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:43.220866 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:43.321275 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:43.321244 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:45.799640 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:45.799605 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:45.859038 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:45.859014 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:50.192782 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:50.192746 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:50.293493 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:50.293459 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:11:57.032736 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:11:57.032705 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:08.300073 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:08.300040 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:08.562675 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:08.562596 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:13.681031 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:13.681000 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:24.801082 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:24.801026 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:24.911870 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:24.911836 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:24.977427 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:24.977395 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:25.230733 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:25.230699 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:12:25.232718 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:25.232701 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wxw9l" Jul 09 14:12:25.235602 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:25.235583 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 14:12:25.236867 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:25.236832 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7nrjf\"" Jul 09 14:12:25.236867 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:25.236858 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 14:12:25.237034 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:25.236907 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 14:12:25.244531 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:25.244509 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:12:25.264357 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:25.261107 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:12:25.298044 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:25.298009 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4e99df6f-f7a3-4719-9d5f-c9218a191dce-config-file\") pod \"limitador-limitador-54d6d988d5-wxw9l\" (UID: \"4e99df6f-f7a3-4719-9d5f-c9218a191dce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wxw9l" Jul 09 14:12:25.298225 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:25.298072 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2pcm\" (UniqueName: \"kubernetes.io/projected/4e99df6f-f7a3-4719-9d5f-c9218a191dce-kube-api-access-d2pcm\") pod \"limitador-limitador-54d6d988d5-wxw9l\" (UID: \"4e99df6f-f7a3-4719-9d5f-c9218a191dce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wxw9l" Jul 09 14:12:25.398452 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:25.398418 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2pcm\" (UniqueName: \"kubernetes.io/projected/4e99df6f-f7a3-4719-9d5f-c9218a191dce-kube-api-access-d2pcm\") pod \"limitador-limitador-54d6d988d5-wxw9l\" (UID: \"4e99df6f-f7a3-4719-9d5f-c9218a191dce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wxw9l" Jul 09 14:12:25.398617 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:25.398474 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4e99df6f-f7a3-4719-9d5f-c9218a191dce-config-file\") pod \"limitador-limitador-54d6d988d5-wxw9l\" (UID: \"4e99df6f-f7a3-4719-9d5f-c9218a191dce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wxw9l" Jul 09 14:12:25.399089 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:25.399068 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4e99df6f-f7a3-4719-9d5f-c9218a191dce-config-file\") pod \"limitador-limitador-54d6d988d5-wxw9l\" (UID: \"4e99df6f-f7a3-4719-9d5f-c9218a191dce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wxw9l" Jul 09 14:12:25.407527 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:25.407502 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2pcm\" (UniqueName: \"kubernetes.io/projected/4e99df6f-f7a3-4719-9d5f-c9218a191dce-kube-api-access-d2pcm\") pod \"limitador-limitador-54d6d988d5-wxw9l\" (UID: \"4e99df6f-f7a3-4719-9d5f-c9218a191dce\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wxw9l" Jul 09 14:12:25.542426 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:25.542331 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wxw9l" Jul 09 14:12:25.675613 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:25.675582 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:12:25.678422 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:25.678391 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:25.678743 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:12:25.678723 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e99df6f_f7a3_4719_9d5f_c9218a191dce.slice/crio-f126e4db3dff1858d35bb73bd04da42d31190702d0c10d4c2f600f3deba030dd WatchSource:0}: Error finding container f126e4db3dff1858d35bb73bd04da42d31190702d0c10d4c2f600f3deba030dd: Status 404 returned error can't find the container with id f126e4db3dff1858d35bb73bd04da42d31190702d0c10d4c2f600f3deba030dd Jul 09 14:12:25.734371 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:25.734302 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:26.673206 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:26.673171 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wxw9l" event={"ID":"4e99df6f-f7a3-4719-9d5f-c9218a191dce","Type":"ContainerStarted","Data":"f126e4db3dff1858d35bb73bd04da42d31190702d0c10d4c2f600f3deba030dd"} Jul 09 14:12:28.684132 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:28.684101 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wxw9l" event={"ID":"4e99df6f-f7a3-4719-9d5f-c9218a191dce","Type":"ContainerStarted","Data":"9edc765671bfb39c17d24b127b9faf521ad5995190439e56777312296b5933ff"} Jul 09 14:12:28.684540 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:28.684202 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wxw9l" Jul 09 14:12:28.702289 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:28.702241 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-wxw9l" podStartSLOduration=1.354701898 podStartE2EDuration="3.702224077s" totalImagesPullingTime="2.347522179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:12:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:12:28.701462712 +0000 UTC m=+577.901963112" watchObservedRunningTime="2026-07-09 14:12:28.702224077 +0000 UTC m=+577.902724451" Jul 09 14:12:39.688867 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:39.688837 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wxw9l" Jul 09 14:12:44.606553 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:44.606518 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:44.705173 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:44.705139 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:45.159296 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:45.159258 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:57.679121 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:57.679063 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:12:57.820397 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:12:57.820365 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:03.602096 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:13:03.602062 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:03.701289 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:13:03.701240 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:03.788418 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:13:03.788374 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:03.976171 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:13:03.976140 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:06.653697 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:13:06.653667 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:06.803950 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:13:06.803917 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:12.548840 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:13:12.548760 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:39.053858 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:13:39.053825 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:39.151941 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:13:39.151905 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:39.563926 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:13:39.563889 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:40.007520 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:13:40.007475 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:40.109898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:13:40.109867 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:40.208378 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:13:40.208340 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:13:40.210389 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:13:40.210363 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:50.713913 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:13:50.713881 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:13:50.833992 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:13:50.833964 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:14:01.650857 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:01.650819 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:14:02.118742 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:02.118709 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:14:05.384248 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:05.384213 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:14:07.364453 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:07.364420 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:14:08.114822 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:08.114789 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:14:21.568224 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:21.568195 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:14:22.522046 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:22.522012 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:14:29.564891 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:29.564856 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:14:31.224543 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:31.224504 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:14:32.224698 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.224660 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x"] Jul 09 14:14:32.230592 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.230565 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:32.233737 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.233714 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 14:14:32.234835 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.234817 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 14:14:32.234943 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.234819 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f6xmw\"" Jul 09 14:14:32.234943 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.234885 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 09 14:14:32.241205 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.241182 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x"] Jul 09 14:14:32.332851 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.332819 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:14:32.365249 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.365215 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee4d4379-a6f6-4747-8913-98aa9a9a44f3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9l4x\" (UID: \"ee4d4379-a6f6-4747-8913-98aa9a9a44f3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:32.365443 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.365261 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee4d4379-a6f6-4747-8913-98aa9a9a44f3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9l4x\" (UID: \"ee4d4379-a6f6-4747-8913-98aa9a9a44f3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:32.365443 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.365290 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rql9p\" (UniqueName: \"kubernetes.io/projected/ee4d4379-a6f6-4747-8913-98aa9a9a44f3-kube-api-access-rql9p\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9l4x\" (UID: \"ee4d4379-a6f6-4747-8913-98aa9a9a44f3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:32.365443 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.365396 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee4d4379-a6f6-4747-8913-98aa9a9a44f3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9l4x\" (UID: \"ee4d4379-a6f6-4747-8913-98aa9a9a44f3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:32.365443 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.365426 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee4d4379-a6f6-4747-8913-98aa9a9a44f3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9l4x\" (UID: \"ee4d4379-a6f6-4747-8913-98aa9a9a44f3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:32.365591 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.365447 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee4d4379-a6f6-4747-8913-98aa9a9a44f3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9l4x\" (UID: \"ee4d4379-a6f6-4747-8913-98aa9a9a44f3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:32.465998 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.465967 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rql9p\" (UniqueName: \"kubernetes.io/projected/ee4d4379-a6f6-4747-8913-98aa9a9a44f3-kube-api-access-rql9p\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9l4x\" (UID: \"ee4d4379-a6f6-4747-8913-98aa9a9a44f3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:32.466175 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.466012 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee4d4379-a6f6-4747-8913-98aa9a9a44f3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9l4x\" (UID: \"ee4d4379-a6f6-4747-8913-98aa9a9a44f3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:32.466175 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.466034 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee4d4379-a6f6-4747-8913-98aa9a9a44f3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9l4x\" (UID: \"ee4d4379-a6f6-4747-8913-98aa9a9a44f3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:32.466175 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.466062 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee4d4379-a6f6-4747-8913-98aa9a9a44f3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9l4x\" (UID: \"ee4d4379-a6f6-4747-8913-98aa9a9a44f3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:32.466175 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.466105 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee4d4379-a6f6-4747-8913-98aa9a9a44f3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9l4x\" (UID: \"ee4d4379-a6f6-4747-8913-98aa9a9a44f3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:32.466175 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.466151 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee4d4379-a6f6-4747-8913-98aa9a9a44f3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9l4x\" (UID: \"ee4d4379-a6f6-4747-8913-98aa9a9a44f3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:32.466515 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.466494 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ee4d4379-a6f6-4747-8913-98aa9a9a44f3-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9l4x\" (UID: \"ee4d4379-a6f6-4747-8913-98aa9a9a44f3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:32.466574 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.466532 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ee4d4379-a6f6-4747-8913-98aa9a9a44f3-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9l4x\" (UID: \"ee4d4379-a6f6-4747-8913-98aa9a9a44f3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:32.466574 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.466562 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ee4d4379-a6f6-4747-8913-98aa9a9a44f3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9l4x\" (UID: \"ee4d4379-a6f6-4747-8913-98aa9a9a44f3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:32.468399 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.468382 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ee4d4379-a6f6-4747-8913-98aa9a9a44f3-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9l4x\" (UID: \"ee4d4379-a6f6-4747-8913-98aa9a9a44f3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:32.468467 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.468451 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ee4d4379-a6f6-4747-8913-98aa9a9a44f3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9l4x\" (UID: \"ee4d4379-a6f6-4747-8913-98aa9a9a44f3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:32.478470 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.478444 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rql9p\" (UniqueName: \"kubernetes.io/projected/ee4d4379-a6f6-4747-8913-98aa9a9a44f3-kube-api-access-rql9p\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-w9l4x\" (UID: \"ee4d4379-a6f6-4747-8913-98aa9a9a44f3\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:32.541920 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.541869 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:32.671597 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.671571 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x"] Jul 09 14:14:32.674172 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:14:32.674148 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4d4379_a6f6_4747_8913_98aa9a9a44f3.slice/crio-475053cee4c4a28495144eb951a45057d65dbab6745072fd131ea96dd70b2433 WatchSource:0}: Error finding container 475053cee4c4a28495144eb951a45057d65dbab6745072fd131ea96dd70b2433: Status 404 returned error can't find the container with id 475053cee4c4a28495144eb951a45057d65dbab6745072fd131ea96dd70b2433 Jul 09 14:14:32.675552 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:32.675537 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:14:33.133003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:33.132958 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" event={"ID":"ee4d4379-a6f6-4747-8913-98aa9a9a44f3","Type":"ContainerStarted","Data":"475053cee4c4a28495144eb951a45057d65dbab6745072fd131ea96dd70b2433"} Jul 09 14:14:34.137963 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:34.137878 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" event={"ID":"ee4d4379-a6f6-4747-8913-98aa9a9a44f3","Type":"ContainerStarted","Data":"320c33b625828dc5a2c2abea11defc8b45ef40c3db023b99c0c7cf828e3106e8"} Jul 09 14:14:34.161048 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:34.157661 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" podStartSLOduration=1.063651204 podStartE2EDuration="2.157636124s" totalImagesPullingTime="1.09398492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:14:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:14:34.155543098 +0000 UTC m=+703.356043494" watchObservedRunningTime="2026-07-09 14:14:34.157636124 +0000 UTC m=+703.358136500" Jul 09 14:14:36.474675 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:36.474637 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:14:38.312366 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:38.312328 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:14:42.542668 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:42.542575 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:42.543042 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:42.542678 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:42.554995 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:42.554963 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:14:43.181574 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:14:43.181544 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-w9l4x" Jul 09 14:15:00.143324 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:15:00.143269 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726775-m5m6t"] Jul 09 14:15:00.146436 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:15:00.146417 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-m5m6t" Jul 09 14:15:00.149211 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:15:00.149187 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lbp2r\"" Jul 09 14:15:00.155749 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:15:00.155726 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-m5m6t" Jul 09 14:15:00.157778 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:15:00.157747 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726775-m5m6t"] Jul 09 14:15:00.297541 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:15:00.297511 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726775-m5m6t"] Jul 09 14:15:01.241026 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:15:01.240990 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-m5m6t" event={"ID":"53d2e811-506e-449f-b934-bc1b4eb80791","Type":"ContainerStarted","Data":"53f3b9cdc6ef8abb570b73236d91f447611eda1a714aa4fe090fdfc67215afc1"} Jul 09 14:15:04.254481 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:15:04.254446 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-m5m6t" event={"ID":"53d2e811-506e-449f-b934-bc1b4eb80791","Type":"ContainerStarted","Data":"39ad05dc3d00c27126ada9563585548b7b6bad3dc1348762c2c050f28f5fb725"} Jul 09 14:15:04.269860 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:15:04.269802 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-m5m6t" podStartSLOduration=0.971370299 podStartE2EDuration="4.269780457s" totalImagesPullingTime="3.298410158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:15:04.268623314 +0000 UTC m=+733.469123687" watchObservedRunningTime="2026-07-09 14:15:04.269780457 +0000 UTC m=+733.470280831" Jul 09 14:15:05.259488 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:15:05.259453 2581 generic.go:356] "Generic (PLEG): container finished" podID="53d2e811-506e-449f-b934-bc1b4eb80791" containerID="39ad05dc3d00c27126ada9563585548b7b6bad3dc1348762c2c050f28f5fb725" exitCode=0 Jul 09 14:15:05.259869 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:15:05.259512 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-m5m6t" event={"ID":"53d2e811-506e-449f-b934-bc1b4eb80791","Type":"ContainerDied","Data":"39ad05dc3d00c27126ada9563585548b7b6bad3dc1348762c2c050f28f5fb725"} Jul 09 14:15:06.387156 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:15:06.387128 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-m5m6t" Jul 09 14:15:07.268178 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:15:07.268144 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-m5m6t" event={"ID":"53d2e811-506e-449f-b934-bc1b4eb80791","Type":"ContainerDied","Data":"53f3b9cdc6ef8abb570b73236d91f447611eda1a714aa4fe090fdfc67215afc1"} Jul 09 14:15:07.268178 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:15:07.268164 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726775-m5m6t" Jul 09 14:15:07.268411 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:15:07.268192 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53f3b9cdc6ef8abb570b73236d91f447611eda1a714aa4fe090fdfc67215afc1" Jul 09 14:15:22.244008 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:15:22.243972 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:15:22.367008 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:15:22.366971 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:15:23.343510 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:15:23.343479 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:15:23.435757 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:15:23.435723 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:16:18.925279 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:16:18.925197 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:16:28.226426 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:16:28.226392 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:16:39.923544 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:16:39.923505 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:16:48.817298 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:16:48.817254 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:16:51.159856 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:16:51.159822 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:16:56.600302 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:16:56.600266 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:16:56.742852 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:16:56.742807 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:16:59.222126 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:16:59.222082 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:17:01.998001 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:01.997962 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:17:03.731395 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:03.731354 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:17:03.850377 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:03.850341 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-65dbd89dd4-4bgrt"] Jul 09 14:17:03.850630 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:03.850618 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53d2e811-506e-449f-b934-bc1b4eb80791" containerName="cleanup" Jul 09 14:17:03.850674 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:03.850631 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="53d2e811-506e-449f-b934-bc1b4eb80791" containerName="cleanup" Jul 09 14:17:03.850707 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:03.850679 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="53d2e811-506e-449f-b934-bc1b4eb80791" containerName="cleanup" Jul 09 14:17:03.853507 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:03.853489 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65dbd89dd4-4bgrt" Jul 09 14:17:03.857591 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:03.857564 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-q5klz\"" Jul 09 14:17:03.857591 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:03.857579 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 09 14:17:03.857591 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:03.857578 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 09 14:17:03.862146 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:03.862113 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65dbd89dd4-4bgrt"] Jul 09 14:17:03.943752 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:03.943715 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcvpv\" (UniqueName: \"kubernetes.io/projected/fafedb38-92d4-46c7-b18b-0fc061a3c529-kube-api-access-rcvpv\") pod \"maas-controller-65dbd89dd4-4bgrt\" (UID: \"fafedb38-92d4-46c7-b18b-0fc061a3c529\") " pod="opendatahub/maas-controller-65dbd89dd4-4bgrt" Jul 09 14:17:03.943752 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:03.943763 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fafedb38-92d4-46c7-b18b-0fc061a3c529-webhook-cert\") pod \"maas-controller-65dbd89dd4-4bgrt\" (UID: \"fafedb38-92d4-46c7-b18b-0fc061a3c529\") " pod="opendatahub/maas-controller-65dbd89dd4-4bgrt" Jul 09 14:17:04.044763 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:04.044664 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcvpv\" (UniqueName: \"kubernetes.io/projected/fafedb38-92d4-46c7-b18b-0fc061a3c529-kube-api-access-rcvpv\") pod \"maas-controller-65dbd89dd4-4bgrt\" (UID: \"fafedb38-92d4-46c7-b18b-0fc061a3c529\") " pod="opendatahub/maas-controller-65dbd89dd4-4bgrt" Jul 09 14:17:04.044763 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:04.044715 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fafedb38-92d4-46c7-b18b-0fc061a3c529-webhook-cert\") pod \"maas-controller-65dbd89dd4-4bgrt\" (UID: \"fafedb38-92d4-46c7-b18b-0fc061a3c529\") " pod="opendatahub/maas-controller-65dbd89dd4-4bgrt" Jul 09 14:17:04.047272 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:04.047242 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fafedb38-92d4-46c7-b18b-0fc061a3c529-webhook-cert\") pod \"maas-controller-65dbd89dd4-4bgrt\" (UID: \"fafedb38-92d4-46c7-b18b-0fc061a3c529\") " pod="opendatahub/maas-controller-65dbd89dd4-4bgrt" Jul 09 14:17:04.054508 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:04.054487 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcvpv\" (UniqueName: \"kubernetes.io/projected/fafedb38-92d4-46c7-b18b-0fc061a3c529-kube-api-access-rcvpv\") pod \"maas-controller-65dbd89dd4-4bgrt\" (UID: \"fafedb38-92d4-46c7-b18b-0fc061a3c529\") " pod="opendatahub/maas-controller-65dbd89dd4-4bgrt" Jul 09 14:17:04.164885 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:04.164853 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-65dbd89dd4-4bgrt" Jul 09 14:17:04.293556 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:04.293521 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-65dbd89dd4-4bgrt"] Jul 09 14:17:04.296589 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:17:04.296522 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfafedb38_92d4_46c7_b18b_0fc061a3c529.slice/crio-de063c1cfe262c6d5c456363cafdbdef99ddeb73be8fa0f0a46375e4d667e930 WatchSource:0}: Error finding container de063c1cfe262c6d5c456363cafdbdef99ddeb73be8fa0f0a46375e4d667e930: Status 404 returned error can't find the container with id de063c1cfe262c6d5c456363cafdbdef99ddeb73be8fa0f0a46375e4d667e930 Jul 09 14:17:04.728091 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:04.728056 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65dbd89dd4-4bgrt" event={"ID":"fafedb38-92d4-46c7-b18b-0fc061a3c529","Type":"ContainerStarted","Data":"de063c1cfe262c6d5c456363cafdbdef99ddeb73be8fa0f0a46375e4d667e930"} Jul 09 14:17:06.740486 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:06.740452 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-65dbd89dd4-4bgrt" event={"ID":"fafedb38-92d4-46c7-b18b-0fc061a3c529","Type":"ContainerStarted","Data":"54389dcaa17f040ccb7c5fb2a21e59826be97a6fea6df07deabbeab8fe99f757"} Jul 09 14:17:06.740861 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:06.740558 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-65dbd89dd4-4bgrt" Jul 09 14:17:06.760504 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:06.760454 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-65dbd89dd4-4bgrt" podStartSLOduration=1.812711787 podStartE2EDuration="3.760437129s" totalImagesPullingTime="1.947725342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:17:06.758033966 +0000 UTC m=+855.958534340" watchObservedRunningTime="2026-07-09 14:17:06.760437129 +0000 UTC m=+855.960937502" Jul 09 14:17:17.747297 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:17.747260 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-65dbd89dd4-4bgrt" Jul 09 14:17:28.324877 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:28.324840 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:17:39.715357 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:39.715306 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:17:45.118163 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:45.118079 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:17:49.144260 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:49.144228 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:17:49.244669 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:49.244642 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:17:49.369377 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:49.369341 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:17:49.429891 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:49.429813 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:17:55.703207 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:55.703160 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:17:55.762875 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:17:55.762844 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:18:01.983717 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:18:01.983677 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:18:02.075306 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:18:02.075252 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:18:18.418403 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:18:18.418366 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:18:28.019940 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:18:28.019901 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:18:36.318013 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:18:36.317977 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:18:45.718328 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:18:45.714835 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:18:56.414762 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:18:56.414726 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:19:06.021431 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:19:06.021393 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:19:17.028574 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:19:17.028490 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:19:26.823478 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:19:26.823442 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:19:49.132045 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:19:49.132007 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:19:59.520128 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:19:59.520088 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:20:23.036951 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:20:23.036916 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:20:23.432216 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:20:23.432126 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:20:33.636099 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:20:33.636059 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:20:48.730128 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:20:48.730042 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:20:59.020013 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:20:59.019978 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:20:59.387852 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:20:59.387736 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:20:59.488759 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:20:59.488724 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:21:08.225538 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:21:08.225501 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:21:17.421532 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:21:17.421489 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:21:27.119349 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:21:27.119285 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:23:19.619294 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:23:19.619256 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:23:26.086987 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:23:26.086952 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:23:30.723527 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:23:30.723486 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:23:39.320161 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:23:39.320122 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:23:51.330376 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:23:51.330285 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:24:02.828979 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:24:02.828944 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:24:13.031140 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:24:13.031100 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:24:21.915266 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:24:21.915229 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:24:32.721598 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:24:32.721562 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:24:44.119241 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:24:44.119196 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:24:52.620196 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:24:52.620158 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:25:05.420747 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:25:05.420710 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:25:23.520404 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:25:23.520322 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:25:32.236098 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:25:32.236058 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:25:40.194400 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:25:40.194363 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:25:44.426863 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:25:44.426826 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:25:56.623541 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:25:56.623500 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:26:12.826974 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:26:12.826936 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:26:26.224199 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:26:26.224160 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:26:35.327679 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:26:35.327638 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:26:41.128029 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:26:41.127992 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:26:50.524935 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:26:50.524858 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:26:59.726066 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:26:59.726031 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:27:13.329171 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:27:13.329133 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:27:19.469739 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:27:19.469703 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:21.713881 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:27:21.713854 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:22.225521 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:27:22.225488 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:27:30.717333 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:27:30.717280 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:27:32.523302 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:27:32.523265 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:27:41.727347 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:27:41.727305 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:27:54.024051 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:27:54.024016 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:28:01.233866 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:01.233832 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:01.336250 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:01.336217 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:01.724786 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:01.724748 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:28:13.520365 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:13.520276 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:28:24.927472 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:24.927435 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:28:34.419491 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:34.419451 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:28:39.546193 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:39.546156 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:39.641990 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:39.641957 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:40.010472 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:40.010438 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:46.286101 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.286068 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:46.386173 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.386137 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:46.449616 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.449575 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4"] Jul 09 14:28:46.452556 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.452535 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.456197 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.456171 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-61b35f5d-openshift-default-dockercfg-t8vwp\"" Jul 09 14:28:46.483381 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.483346 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4"] Jul 09 14:28:46.491738 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.491668 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:46.555902 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.555828 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-credential-socket\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.555902 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.555860 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-workload-certs\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.556083 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.555958 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45pdc\" (UniqueName: \"kubernetes.io/projected/376817ff-0c7a-41a5-8621-b4b63392f8b4-kube-api-access-45pdc\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.556083 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.556009 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-envoy\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.556083 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.556027 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-podinfo\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.556083 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.556059 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-token\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.556083 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.556076 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/376817ff-0c7a-41a5-8621-b4b63392f8b4-istiod-ca-cert\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.556246 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.556105 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-workload-socket\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.556246 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.556150 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-data\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.656710 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.656666 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-workload-socket\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.656913 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.656724 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-data\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.656913 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.656763 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-credential-socket\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.656913 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.656784 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-workload-certs\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.657078 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.656934 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45pdc\" (UniqueName: \"kubernetes.io/projected/376817ff-0c7a-41a5-8621-b4b63392f8b4-kube-api-access-45pdc\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.657078 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.657001 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-envoy\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.657078 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.657025 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-podinfo\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.657239 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.657086 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-workload-socket\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.657239 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.657066 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-token\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.657239 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.657136 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-workload-certs\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.657239 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.657152 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/376817ff-0c7a-41a5-8621-b4b63392f8b4-istiod-ca-cert\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.657239 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.657182 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-credential-socket\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.657239 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.657236 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-data\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.657865 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.657847 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/376817ff-0c7a-41a5-8621-b4b63392f8b4-istiod-ca-cert\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.659208 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.659188 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-envoy\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.659463 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.659444 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-podinfo\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.666149 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.666118 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-token\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.666513 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.666495 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45pdc\" (UniqueName: \"kubernetes.io/projected/376817ff-0c7a-41a5-8621-b4b63392f8b4-kube-api-access-45pdc\") pod \"e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.685008 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.684979 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:46.763062 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.763023 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:46.900234 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.900126 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4"] Jul 09 14:28:46.902888 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:28:46.902860 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod376817ff_0c7a_41a5_8621_b4b63392f8b4.slice/crio-eb9d5b62673599a74d6f106437f64928c916b089258092fb9964e1f21053913c WatchSource:0}: Error finding container eb9d5b62673599a74d6f106437f64928c916b089258092fb9964e1f21053913c: Status 404 returned error can't find the container with id eb9d5b62673599a74d6f106437f64928c916b089258092fb9964e1f21053913c Jul 09 14:28:46.904922 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.904888 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:28:46.905024 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.904974 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:28:46.905084 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:46.905019 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:28:47.518289 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:47.518257 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" event={"ID":"376817ff-0c7a-41a5-8621-b4b63392f8b4","Type":"ContainerStarted","Data":"e2864429ecd19daa522b0716ecf1fb2469d1c898f3fde26c657a86b8ff243abf"} Jul 09 14:28:47.518688 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:47.518350 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" event={"ID":"376817ff-0c7a-41a5-8621-b4b63392f8b4","Type":"ContainerStarted","Data":"eb9d5b62673599a74d6f106437f64928c916b089258092fb9964e1f21053913c"} Jul 09 14:28:47.548958 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:47.548906 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" podStartSLOduration=1.548889585 podStartE2EDuration="1.548889585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:28:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:28:47.546563402 +0000 UTC m=+1556.747063780" watchObservedRunningTime="2026-07-09 14:28:47.548889585 +0000 UTC m=+1556.749389958" Jul 09 14:28:47.732962 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:47.732923 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:47.763531 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:47.763502 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:47.768138 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:47.768104 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:47.808052 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:47.807969 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:47.999431 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:47.999389 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:48.474875 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:48.474838 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:48.522022 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:48.521985 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:48.522969 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:48.522952 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:48.581866 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:48.581831 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:50.324828 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:50.324790 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:28:50.687710 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:50.687676 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:28:58.563198 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:58.563116 2581 generic.go:356] "Generic (PLEG): container finished" podID="376817ff-0c7a-41a5-8621-b4b63392f8b4" containerID="e2864429ecd19daa522b0716ecf1fb2469d1c898f3fde26c657a86b8ff243abf" exitCode=0 Jul 09 14:28:58.563602 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:58.563201 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" event={"ID":"376817ff-0c7a-41a5-8621-b4b63392f8b4","Type":"ContainerDied","Data":"e2864429ecd19daa522b0716ecf1fb2469d1c898f3fde26c657a86b8ff243abf"} Jul 09 14:28:58.563602 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:58.563592 2581 scope.go:117] "RemoveContainer" containerID="e2864429ecd19daa522b0716ecf1fb2469d1c898f3fde26c657a86b8ff243abf" Jul 09 14:28:58.564628 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:58.564601 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:28:58.564710 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:58.564686 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:28:58.564765 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:58.564752 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:28:59.567945 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:59.567913 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" event={"ID":"376817ff-0c7a-41a5-8621-b4b63392f8b4","Type":"ContainerStarted","Data":"c400af65d79c8eec21a722fc40a9af1a2e4f741a66ae6b2f633d41b9ab016426"} Jul 09 14:28:59.763805 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:59.763451 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:28:59.765233 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:59.764875 2581 patch_prober.go:28] interesting pod/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body= Jul 09 14:28:59.765233 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:28:59.764941 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" podUID="376817ff-0c7a-41a5-8621-b4b63392f8b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" Jul 09 14:29:00.763766 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:00.763724 2581 patch_prober.go:28] interesting pod/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body= Jul 09 14:29:00.764413 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:00.764375 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" podUID="376817ff-0c7a-41a5-8621-b4b63392f8b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" Jul 09 14:29:01.763820 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:01.763782 2581 patch_prober.go:28] interesting pod/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body= Jul 09 14:29:01.764471 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:01.764433 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" podUID="376817ff-0c7a-41a5-8621-b4b63392f8b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" Jul 09 14:29:02.763849 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:02.763808 2581 patch_prober.go:28] interesting pod/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body= Jul 09 14:29:02.764520 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:02.764483 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" podUID="376817ff-0c7a-41a5-8621-b4b63392f8b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" Jul 09 14:29:03.522654 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:03.522611 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:29:03.763763 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:03.763722 2581 patch_prober.go:28] interesting pod/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" start-of-body= Jul 09 14:29:03.763966 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:03.763795 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" podUID="376817ff-0c7a-41a5-8621-b4b63392f8b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.21:15021/healthz/ready\": dial tcp 10.134.0.21:15021: connect: connection refused" Jul 09 14:29:04.767498 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:04.767459 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:29:04.768329 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:04.768288 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:29:52.800724 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:52.800651 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4"] Jul 09 14:29:52.801225 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:52.800906 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" podUID="376817ff-0c7a-41a5-8621-b4b63392f8b4" containerName="istio-proxy" containerID="cri-o://c400af65d79c8eec21a722fc40a9af1a2e4f741a66ae6b2f633d41b9ab016426" gracePeriod=30 Jul 09 14:29:52.830628 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:52.830597 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:52.951463 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:52.951427 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:55.820517 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:55.820480 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:29:58.051536 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.051510 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:29:58.156375 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.156347 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-token\") pod \"376817ff-0c7a-41a5-8621-b4b63392f8b4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " Jul 09 14:29:58.156598 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.156381 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-podinfo\") pod \"376817ff-0c7a-41a5-8621-b4b63392f8b4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " Jul 09 14:29:58.156598 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.156419 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-envoy\") pod \"376817ff-0c7a-41a5-8621-b4b63392f8b4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " Jul 09 14:29:58.156598 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.156435 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45pdc\" (UniqueName: \"kubernetes.io/projected/376817ff-0c7a-41a5-8621-b4b63392f8b4-kube-api-access-45pdc\") pod \"376817ff-0c7a-41a5-8621-b4b63392f8b4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " Jul 09 14:29:58.156598 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.156458 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-credential-socket\") pod \"376817ff-0c7a-41a5-8621-b4b63392f8b4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " Jul 09 14:29:58.156598 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.156477 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-workload-certs\") pod \"376817ff-0c7a-41a5-8621-b4b63392f8b4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " Jul 09 14:29:58.156598 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.156523 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-data\") pod \"376817ff-0c7a-41a5-8621-b4b63392f8b4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " Jul 09 14:29:58.156598 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.156552 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-workload-socket\") pod \"376817ff-0c7a-41a5-8621-b4b63392f8b4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " Jul 09 14:29:58.156598 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.156591 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/376817ff-0c7a-41a5-8621-b4b63392f8b4-istiod-ca-cert\") pod \"376817ff-0c7a-41a5-8621-b4b63392f8b4\" (UID: \"376817ff-0c7a-41a5-8621-b4b63392f8b4\") " Jul 09 14:29:58.157002 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.156772 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "376817ff-0c7a-41a5-8621-b4b63392f8b4" (UID: "376817ff-0c7a-41a5-8621-b4b63392f8b4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:29:58.157002 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.156800 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "376817ff-0c7a-41a5-8621-b4b63392f8b4" (UID: "376817ff-0c7a-41a5-8621-b4b63392f8b4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:29:58.157002 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.156856 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-credential-socket\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:29:58.157165 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.157007 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "376817ff-0c7a-41a5-8621-b4b63392f8b4" (UID: "376817ff-0c7a-41a5-8621-b4b63392f8b4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:29:58.157165 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.157073 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/376817ff-0c7a-41a5-8621-b4b63392f8b4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "376817ff-0c7a-41a5-8621-b4b63392f8b4" (UID: "376817ff-0c7a-41a5-8621-b4b63392f8b4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:29:58.157490 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.157452 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-data" (OuterVolumeSpecName: "istio-data") pod "376817ff-0c7a-41a5-8621-b4b63392f8b4" (UID: "376817ff-0c7a-41a5-8621-b4b63392f8b4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:29:58.158755 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.158726 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "376817ff-0c7a-41a5-8621-b4b63392f8b4" (UID: "376817ff-0c7a-41a5-8621-b4b63392f8b4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:29:58.158836 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.158786 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "376817ff-0c7a-41a5-8621-b4b63392f8b4" (UID: "376817ff-0c7a-41a5-8621-b4b63392f8b4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 14:29:58.158836 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.158803 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-token" (OuterVolumeSpecName: "istio-token") pod "376817ff-0c7a-41a5-8621-b4b63392f8b4" (UID: "376817ff-0c7a-41a5-8621-b4b63392f8b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:29:58.158836 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.158803 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/376817ff-0c7a-41a5-8621-b4b63392f8b4-kube-api-access-45pdc" (OuterVolumeSpecName: "kube-api-access-45pdc") pod "376817ff-0c7a-41a5-8621-b4b63392f8b4" (UID: "376817ff-0c7a-41a5-8621-b4b63392f8b4"). InnerVolumeSpecName "kube-api-access-45pdc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:29:58.257960 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.257913 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-token\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:29:58.257960 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.257951 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-podinfo\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:29:58.257960 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.257964 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-envoy\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:29:58.258193 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.257975 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45pdc\" (UniqueName: \"kubernetes.io/projected/376817ff-0c7a-41a5-8621-b4b63392f8b4-kube-api-access-45pdc\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:29:58.258193 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.257988 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-workload-certs\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:29:58.258193 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.257998 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-istio-data\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:29:58.258193 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.258008 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/376817ff-0c7a-41a5-8621-b4b63392f8b4-workload-socket\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:29:58.258193 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.258018 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/376817ff-0c7a-41a5-8621-b4b63392f8b4-istiod-ca-cert\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:29:58.651968 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.651940 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:58.806193 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.806160 2581 generic.go:356] "Generic (PLEG): container finished" podID="376817ff-0c7a-41a5-8621-b4b63392f8b4" containerID="c400af65d79c8eec21a722fc40a9af1a2e4f741a66ae6b2f633d41b9ab016426" exitCode=0 Jul 09 14:29:58.806373 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.806208 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" Jul 09 14:29:58.806373 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.806205 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" event={"ID":"376817ff-0c7a-41a5-8621-b4b63392f8b4","Type":"ContainerDied","Data":"c400af65d79c8eec21a722fc40a9af1a2e4f741a66ae6b2f633d41b9ab016426"} Jul 09 14:29:58.806373 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.806265 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4" event={"ID":"376817ff-0c7a-41a5-8621-b4b63392f8b4","Type":"ContainerDied","Data":"eb9d5b62673599a74d6f106437f64928c916b089258092fb9964e1f21053913c"} Jul 09 14:29:58.806373 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.806291 2581 scope.go:117] "RemoveContainer" containerID="c400af65d79c8eec21a722fc40a9af1a2e4f741a66ae6b2f633d41b9ab016426" Jul 09 14:29:58.815056 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.815038 2581 scope.go:117] "RemoveContainer" containerID="e2864429ecd19daa522b0716ecf1fb2469d1c898f3fde26c657a86b8ff243abf" Jul 09 14:29:58.822599 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.822583 2581 scope.go:117] "RemoveContainer" containerID="c400af65d79c8eec21a722fc40a9af1a2e4f741a66ae6b2f633d41b9ab016426" Jul 09 14:29:58.822872 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:29:58.822851 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c400af65d79c8eec21a722fc40a9af1a2e4f741a66ae6b2f633d41b9ab016426\": container with ID starting with c400af65d79c8eec21a722fc40a9af1a2e4f741a66ae6b2f633d41b9ab016426 not found: ID does not exist" containerID="c400af65d79c8eec21a722fc40a9af1a2e4f741a66ae6b2f633d41b9ab016426" Jul 09 14:29:58.822919 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.822881 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c400af65d79c8eec21a722fc40a9af1a2e4f741a66ae6b2f633d41b9ab016426"} err="failed to get container status \"c400af65d79c8eec21a722fc40a9af1a2e4f741a66ae6b2f633d41b9ab016426\": rpc error: code = NotFound desc = could not find container \"c400af65d79c8eec21a722fc40a9af1a2e4f741a66ae6b2f633d41b9ab016426\": container with ID starting with c400af65d79c8eec21a722fc40a9af1a2e4f741a66ae6b2f633d41b9ab016426 not found: ID does not exist" Jul 09 14:29:58.822919 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.822912 2581 scope.go:117] "RemoveContainer" containerID="e2864429ecd19daa522b0716ecf1fb2469d1c898f3fde26c657a86b8ff243abf" Jul 09 14:29:58.825254 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:29:58.824455 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2864429ecd19daa522b0716ecf1fb2469d1c898f3fde26c657a86b8ff243abf\": container with ID starting with e2864429ecd19daa522b0716ecf1fb2469d1c898f3fde26c657a86b8ff243abf not found: ID does not exist" containerID="e2864429ecd19daa522b0716ecf1fb2469d1c898f3fde26c657a86b8ff243abf" Jul 09 14:29:58.825254 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.824486 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2864429ecd19daa522b0716ecf1fb2469d1c898f3fde26c657a86b8ff243abf"} err="failed to get container status \"e2864429ecd19daa522b0716ecf1fb2469d1c898f3fde26c657a86b8ff243abf\": rpc error: code = NotFound desc = could not find container \"e2864429ecd19daa522b0716ecf1fb2469d1c898f3fde26c657a86b8ff243abf\": container with ID starting with e2864429ecd19daa522b0716ecf1fb2469d1c898f3fde26c657a86b8ff243abf not found: ID does not exist" Jul 09 14:29:58.828589 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.828565 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:29:58.829213 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.829195 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4"] Jul 09 14:29:58.836481 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:58.836435 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-61b35f5d-openshift-default-864d4c74ff-wf9g4"] Jul 09 14:29:59.564646 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:59.564614 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="376817ff-0c7a-41a5-8621-b4b63392f8b4" path="/var/lib/kubelet/pods/376817ff-0c7a-41a5-8621-b4b63392f8b4/volumes" Jul 09 14:29:59.626519 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:29:59.626488 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:04.501235 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.501200 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:04.602702 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.602667 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:04.692502 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.692470 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl"] Jul 09 14:30:04.692786 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.692771 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="376817ff-0c7a-41a5-8621-b4b63392f8b4" containerName="istio-proxy" Jul 09 14:30:04.692856 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.692787 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="376817ff-0c7a-41a5-8621-b4b63392f8b4" containerName="istio-proxy" Jul 09 14:30:04.692856 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.692801 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="376817ff-0c7a-41a5-8621-b4b63392f8b4" containerName="istio-proxy" Jul 09 14:30:04.692856 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.692806 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="376817ff-0c7a-41a5-8621-b4b63392f8b4" containerName="istio-proxy" Jul 09 14:30:04.693003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.692864 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="376817ff-0c7a-41a5-8621-b4b63392f8b4" containerName="istio-proxy" Jul 09 14:30:04.697226 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.697203 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.700175 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.700145 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-996a664f-openshift-default-dockercfg-s2xnr\"" Jul 09 14:30:04.704156 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.704109 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-workload-socket\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.704156 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.704144 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-envoy\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.704268 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.704172 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjwbv\" (UniqueName: \"kubernetes.io/projected/cc6959d3-632d-47e7-8b00-365cb567a0be-kube-api-access-kjwbv\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.704268 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.704214 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc6959d3-632d-47e7-8b00-365cb567a0be-istiod-ca-cert\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.704268 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.704261 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-credential-socket\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.704451 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.704371 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-token\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.704509 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.704450 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-workload-certs\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.704509 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.704472 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-podinfo\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.704509 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.704506 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-data\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.708518 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.708495 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl"] Jul 09 14:30:04.726910 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.726870 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:04.790427 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.790335 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:30:04.805467 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.805424 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-credential-socket\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.805665 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.805475 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-token\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.805665 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.805509 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-workload-certs\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.805665 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.805530 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-podinfo\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.805665 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.805561 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-data\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.805665 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.805617 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-workload-socket\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.805665 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.805638 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-envoy\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.805665 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.805660 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjwbv\" (UniqueName: \"kubernetes.io/projected/cc6959d3-632d-47e7-8b00-365cb567a0be-kube-api-access-kjwbv\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.806003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.805761 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc6959d3-632d-47e7-8b00-365cb567a0be-istiod-ca-cert\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.806003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.805899 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-credential-socket\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.806003 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.805970 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-workload-certs\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.806157 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.806102 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-data\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.806214 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.806160 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-workload-socket\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.806448 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.806428 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc6959d3-632d-47e7-8b00-365cb567a0be-istiod-ca-cert\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.807878 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.807856 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-envoy\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.807984 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.807969 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-podinfo\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.815887 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.815858 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-token\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:04.816052 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:04.816033 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjwbv\" (UniqueName: \"kubernetes.io/projected/cc6959d3-632d-47e7-8b00-365cb567a0be-kube-api-access-kjwbv\") pod \"e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:05.007842 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:05.007798 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:05.148092 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:05.148062 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl"] Jul 09 14:30:05.150359 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:30:05.150330 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc6959d3_632d_47e7_8b00_365cb567a0be.slice/crio-2d6ba854ad454cbdeaeade6eb19917555267aef2e8c6cfbcd565ce0b82edefa1 WatchSource:0}: Error finding container 2d6ba854ad454cbdeaeade6eb19917555267aef2e8c6cfbcd565ce0b82edefa1: Status 404 returned error can't find the container with id 2d6ba854ad454cbdeaeade6eb19917555267aef2e8c6cfbcd565ce0b82edefa1 Jul 09 14:30:05.152390 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:05.152359 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:30:05.152492 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:05.152465 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:30:05.152551 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:05.152514 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:30:05.839059 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:05.839024 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" event={"ID":"cc6959d3-632d-47e7-8b00-365cb567a0be","Type":"ContainerStarted","Data":"cfd902e14d1a02a4d6db9503c813b7d755d562b2ceb3e9e46915598ab5256352"} Jul 09 14:30:05.839508 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:05.839077 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" event={"ID":"cc6959d3-632d-47e7-8b00-365cb567a0be","Type":"ContainerStarted","Data":"2d6ba854ad454cbdeaeade6eb19917555267aef2e8c6cfbcd565ce0b82edefa1"} Jul 09 14:30:05.862637 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:05.862578 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" podStartSLOduration=1.862556951 podStartE2EDuration="1.862556951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:30:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:30:05.862185861 +0000 UTC m=+1635.062686248" watchObservedRunningTime="2026-07-09 14:30:05.862556951 +0000 UTC m=+1635.063057327" Jul 09 14:30:06.008166 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:06.008128 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:06.013540 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:06.013509 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:06.843329 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:06.843295 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:06.844429 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:06.844412 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:30:08.197832 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:30:08.197803 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:26.727975 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:32:26.727938 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:28.272130 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:32:28.272080 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:07.664590 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:07.664552 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:07.768533 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:07.768503 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:09.541657 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:09.541621 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl"] Jul 09 14:33:09.542083 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:09.541817 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" podUID="cc6959d3-632d-47e7-8b00-365cb567a0be" containerName="istio-proxy" containerID="cri-o://cfd902e14d1a02a4d6db9503c813b7d755d562b2ceb3e9e46915598ab5256352" gracePeriod=30 Jul 09 14:33:09.594942 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:09.594906 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:09.904942 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:09.904846 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2"] Jul 09 14:33:09.905266 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:09.905247 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="376817ff-0c7a-41a5-8621-b4b63392f8b4" containerName="istio-proxy" Jul 09 14:33:09.908221 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:09.908206 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:09.911238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:09.911212 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-82a8dbff-openshift-default-dockercfg-xnk2n\"" Jul 09 14:33:09.923511 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:09.923479 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2"] Jul 09 14:33:09.938948 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:09.938915 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:10.024623 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.024588 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-data\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.024795 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.024633 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpg9s\" (UniqueName: \"kubernetes.io/projected/d9a45ea3-bea7-42e1-b684-74212ac61bf1-kube-api-access-fpg9s\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.024795 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.024658 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istiod-ca-cert\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.024795 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.024719 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-credential-socket\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.024795 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.024737 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-token\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.024795 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.024768 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-envoy\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.024795 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.024796 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-podinfo\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.025013 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.024829 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-workload-certs\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.025013 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.024852 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-workload-socket\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.126125 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.126092 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-podinfo\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.126357 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.126146 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-workload-certs\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.126357 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.126176 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-workload-socket\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.126357 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.126209 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-data\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.126514 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.126429 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpg9s\" (UniqueName: \"kubernetes.io/projected/d9a45ea3-bea7-42e1-b684-74212ac61bf1-kube-api-access-fpg9s\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.126514 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.126482 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istiod-ca-cert\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.126616 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.126518 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-credential-socket\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.126616 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.126536 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-token\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.126616 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.126580 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-envoy\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.126748 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.126732 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-workload-socket\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.126893 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.126872 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-data\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.126972 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.126939 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-credential-socket\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.127112 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.127086 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-workload-certs\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.127264 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.127246 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istiod-ca-cert\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.128663 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.128642 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-podinfo\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.128892 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.128874 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-envoy\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.143833 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.143795 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-token\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.143833 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.143807 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpg9s\" (UniqueName: \"kubernetes.io/projected/d9a45ea3-bea7-42e1-b684-74212ac61bf1-kube-api-access-fpg9s\") pod \"e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.218625 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.218592 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:10.356605 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.356577 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2"] Jul 09 14:33:10.358860 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:33:10.358832 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9a45ea3_bea7_42e1_b684_74212ac61bf1.slice/crio-b39829cd0645de6620bc8539beb23de3c841cd763a114efa5a3e241faf2fc65c WatchSource:0}: Error finding container b39829cd0645de6620bc8539beb23de3c841cd763a114efa5a3e241faf2fc65c: Status 404 returned error can't find the container with id b39829cd0645de6620bc8539beb23de3c841cd763a114efa5a3e241faf2fc65c Jul 09 14:33:10.360799 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.360770 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:33:10.360854 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.360837 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:33:10.360888 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.360863 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:33:10.595611 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.595515 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" event={"ID":"d9a45ea3-bea7-42e1-b684-74212ac61bf1","Type":"ContainerStarted","Data":"32ab301117e173e4109c799e050339842ca483de6dbb97c0447cdd414cbe3d5b"} Jul 09 14:33:10.595611 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.595571 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" event={"ID":"d9a45ea3-bea7-42e1-b684-74212ac61bf1","Type":"ContainerStarted","Data":"b39829cd0645de6620bc8539beb23de3c841cd763a114efa5a3e241faf2fc65c"} Jul 09 14:33:10.619161 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:10.619106 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" podStartSLOduration=1.619088018 podStartE2EDuration="1.619088018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:33:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:10.617260586 +0000 UTC m=+1819.817760960" watchObservedRunningTime="2026-07-09 14:33:10.619088018 +0000 UTC m=+1819.819588392" Jul 09 14:33:11.219120 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:11.219081 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:11.224470 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:11.224444 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:11.600303 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:11.600208 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:11.601121 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:11.601099 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:33:14.792061 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.792032 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:33:14.866824 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.866789 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-podinfo\") pod \"cc6959d3-632d-47e7-8b00-365cb567a0be\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " Jul 09 14:33:14.866824 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.866833 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-token\") pod \"cc6959d3-632d-47e7-8b00-365cb567a0be\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " Jul 09 14:33:14.867066 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.866851 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc6959d3-632d-47e7-8b00-365cb567a0be-istiod-ca-cert\") pod \"cc6959d3-632d-47e7-8b00-365cb567a0be\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " Jul 09 14:33:14.867066 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.866880 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-credential-socket\") pod \"cc6959d3-632d-47e7-8b00-365cb567a0be\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " Jul 09 14:33:14.867066 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.866896 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-data\") pod \"cc6959d3-632d-47e7-8b00-365cb567a0be\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " Jul 09 14:33:14.867066 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.866927 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-workload-socket\") pod \"cc6959d3-632d-47e7-8b00-365cb567a0be\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " Jul 09 14:33:14.867066 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.866971 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-envoy\") pod \"cc6959d3-632d-47e7-8b00-365cb567a0be\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " Jul 09 14:33:14.867066 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.866997 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjwbv\" (UniqueName: \"kubernetes.io/projected/cc6959d3-632d-47e7-8b00-365cb567a0be-kube-api-access-kjwbv\") pod \"cc6959d3-632d-47e7-8b00-365cb567a0be\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " Jul 09 14:33:14.867066 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.867019 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-workload-certs\") pod \"cc6959d3-632d-47e7-8b00-365cb567a0be\" (UID: \"cc6959d3-632d-47e7-8b00-365cb567a0be\") " Jul 09 14:33:14.867440 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.867175 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cc6959d3-632d-47e7-8b00-365cb567a0be" (UID: "cc6959d3-632d-47e7-8b00-365cb567a0be"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:33:14.867440 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.867214 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-data" (OuterVolumeSpecName: "istio-data") pod "cc6959d3-632d-47e7-8b00-365cb567a0be" (UID: "cc6959d3-632d-47e7-8b00-365cb567a0be"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:33:14.867440 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.867383 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-credential-socket\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:33:14.867440 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.867391 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cc6959d3-632d-47e7-8b00-365cb567a0be" (UID: "cc6959d3-632d-47e7-8b00-365cb567a0be"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:33:14.867440 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.867404 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-data\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:33:14.867440 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.867407 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cc6959d3-632d-47e7-8b00-365cb567a0be" (UID: "cc6959d3-632d-47e7-8b00-365cb567a0be"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:33:14.867963 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.867926 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc6959d3-632d-47e7-8b00-365cb567a0be-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cc6959d3-632d-47e7-8b00-365cb567a0be" (UID: "cc6959d3-632d-47e7-8b00-365cb567a0be"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:33:14.869049 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.869021 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-token" (OuterVolumeSpecName: "istio-token") pod "cc6959d3-632d-47e7-8b00-365cb567a0be" (UID: "cc6959d3-632d-47e7-8b00-365cb567a0be"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:33:14.869049 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.869041 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cc6959d3-632d-47e7-8b00-365cb567a0be" (UID: "cc6959d3-632d-47e7-8b00-365cb567a0be"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 14:33:14.869574 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.869553 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc6959d3-632d-47e7-8b00-365cb567a0be-kube-api-access-kjwbv" (OuterVolumeSpecName: "kube-api-access-kjwbv") pod "cc6959d3-632d-47e7-8b00-365cb567a0be" (UID: "cc6959d3-632d-47e7-8b00-365cb567a0be"). InnerVolumeSpecName "kube-api-access-kjwbv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:33:14.869646 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.869600 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cc6959d3-632d-47e7-8b00-365cb567a0be" (UID: "cc6959d3-632d-47e7-8b00-365cb567a0be"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:33:14.968111 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.968073 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-podinfo\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:33:14.968111 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.968106 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-token\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:33:14.968111 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.968116 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cc6959d3-632d-47e7-8b00-365cb567a0be-istiod-ca-cert\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:33:14.968376 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.968124 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-workload-socket\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:33:14.968376 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.968133 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-istio-envoy\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:33:14.968376 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.968142 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjwbv\" (UniqueName: \"kubernetes.io/projected/cc6959d3-632d-47e7-8b00-365cb567a0be-kube-api-access-kjwbv\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:33:14.968376 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:14.968151 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cc6959d3-632d-47e7-8b00-365cb567a0be-workload-certs\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:33:15.619191 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:15.619151 2581 generic.go:356] "Generic (PLEG): container finished" podID="cc6959d3-632d-47e7-8b00-365cb567a0be" containerID="cfd902e14d1a02a4d6db9503c813b7d755d562b2ceb3e9e46915598ab5256352" exitCode=0 Jul 09 14:33:15.619376 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:15.619220 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" Jul 09 14:33:15.619376 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:15.619216 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" event={"ID":"cc6959d3-632d-47e7-8b00-365cb567a0be","Type":"ContainerDied","Data":"cfd902e14d1a02a4d6db9503c813b7d755d562b2ceb3e9e46915598ab5256352"} Jul 09 14:33:15.619376 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:15.619362 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl" event={"ID":"cc6959d3-632d-47e7-8b00-365cb567a0be","Type":"ContainerDied","Data":"2d6ba854ad454cbdeaeade6eb19917555267aef2e8c6cfbcd565ce0b82edefa1"} Jul 09 14:33:15.619512 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:15.619391 2581 scope.go:117] "RemoveContainer" containerID="cfd902e14d1a02a4d6db9503c813b7d755d562b2ceb3e9e46915598ab5256352" Jul 09 14:33:15.628515 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:15.628490 2581 scope.go:117] "RemoveContainer" containerID="cfd902e14d1a02a4d6db9503c813b7d755d562b2ceb3e9e46915598ab5256352" Jul 09 14:33:15.628804 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:33:15.628780 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfd902e14d1a02a4d6db9503c813b7d755d562b2ceb3e9e46915598ab5256352\": container with ID starting with cfd902e14d1a02a4d6db9503c813b7d755d562b2ceb3e9e46915598ab5256352 not found: ID does not exist" containerID="cfd902e14d1a02a4d6db9503c813b7d755d562b2ceb3e9e46915598ab5256352" Jul 09 14:33:15.628876 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:15.628818 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfd902e14d1a02a4d6db9503c813b7d755d562b2ceb3e9e46915598ab5256352"} err="failed to get container status \"cfd902e14d1a02a4d6db9503c813b7d755d562b2ceb3e9e46915598ab5256352\": rpc error: code = NotFound desc = could not find container \"cfd902e14d1a02a4d6db9503c813b7d755d562b2ceb3e9e46915598ab5256352\": container with ID starting with cfd902e14d1a02a4d6db9503c813b7d755d562b2ceb3e9e46915598ab5256352 not found: ID does not exist" Jul 09 14:33:15.636863 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:15.636834 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl"] Jul 09 14:33:15.640437 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:15.640411 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-996a664f-openshift-default-7c6bcb8c65-vbtdl"] Jul 09 14:33:17.564928 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:17.564886 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc6959d3-632d-47e7-8b00-365cb567a0be" path="/var/lib/kubelet/pods/cc6959d3-632d-47e7-8b00-365cb567a0be/volumes" Jul 09 14:33:22.384087 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:22.384052 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:22.484043 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:22.484009 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:33.381146 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:33.381117 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:33.450245 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:33.450202 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:36.503530 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:33:36.503498 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:13.243401 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:13.243359 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2"] Jul 09 14:35:13.243986 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:13.243612 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" podUID="d9a45ea3-bea7-42e1-b684-74212ac61bf1" containerName="istio-proxy" containerID="cri-o://32ab301117e173e4109c799e050339842ca483de6dbb97c0447cdd414cbe3d5b" gracePeriod=30 Jul 09 14:35:13.315326 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:13.315272 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:13.872363 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:13.872333 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:14.063048 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:14.063001 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:14.308625 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:14.308592 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:15.547409 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:15.547371 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:18.499224 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.499191 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:35:18.585632 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.585601 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istiod-ca-cert\") pod \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " Jul 09 14:35:18.585788 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.585636 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-token\") pod \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " Jul 09 14:35:18.585788 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.585675 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-workload-certs\") pod \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " Jul 09 14:35:18.585788 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.585706 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-envoy\") pod \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " Jul 09 14:35:18.585788 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.585740 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-credential-socket\") pod \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " Jul 09 14:35:18.585788 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.585763 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpg9s\" (UniqueName: \"kubernetes.io/projected/d9a45ea3-bea7-42e1-b684-74212ac61bf1-kube-api-access-fpg9s\") pod \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " Jul 09 14:35:18.586032 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.585792 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-podinfo\") pod \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " Jul 09 14:35:18.586032 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.585814 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-data\") pod \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " Jul 09 14:35:18.586032 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.585855 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-workload-socket\") pod \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\" (UID: \"d9a45ea3-bea7-42e1-b684-74212ac61bf1\") " Jul 09 14:35:18.586193 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.586048 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d9a45ea3-bea7-42e1-b684-74212ac61bf1" (UID: "d9a45ea3-bea7-42e1-b684-74212ac61bf1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:35:18.586193 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.586099 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d9a45ea3-bea7-42e1-b684-74212ac61bf1" (UID: "d9a45ea3-bea7-42e1-b684-74212ac61bf1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:35:18.586294 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.586244 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-data" (OuterVolumeSpecName: "istio-data") pod "d9a45ea3-bea7-42e1-b684-74212ac61bf1" (UID: "d9a45ea3-bea7-42e1-b684-74212ac61bf1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:35:18.586294 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.586274 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d9a45ea3-bea7-42e1-b684-74212ac61bf1" (UID: "d9a45ea3-bea7-42e1-b684-74212ac61bf1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:35:18.586430 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.586294 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d9a45ea3-bea7-42e1-b684-74212ac61bf1" (UID: "d9a45ea3-bea7-42e1-b684-74212ac61bf1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:35:18.587874 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.587847 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-token" (OuterVolumeSpecName: "istio-token") pod "d9a45ea3-bea7-42e1-b684-74212ac61bf1" (UID: "d9a45ea3-bea7-42e1-b684-74212ac61bf1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:35:18.587996 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.587978 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d9a45ea3-bea7-42e1-b684-74212ac61bf1" (UID: "d9a45ea3-bea7-42e1-b684-74212ac61bf1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:35:18.588124 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.588109 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9a45ea3-bea7-42e1-b684-74212ac61bf1-kube-api-access-fpg9s" (OuterVolumeSpecName: "kube-api-access-fpg9s") pod "d9a45ea3-bea7-42e1-b684-74212ac61bf1" (UID: "d9a45ea3-bea7-42e1-b684-74212ac61bf1"). InnerVolumeSpecName "kube-api-access-fpg9s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:35:18.588264 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.588237 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d9a45ea3-bea7-42e1-b684-74212ac61bf1" (UID: "d9a45ea3-bea7-42e1-b684-74212ac61bf1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 14:35:18.687129 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.687092 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istiod-ca-cert\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:35:18.687129 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.687121 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-token\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:35:18.687129 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.687130 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-workload-certs\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:35:18.687129 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.687137 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-envoy\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:35:18.687430 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.687146 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-credential-socket\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:35:18.687430 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.687156 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpg9s\" (UniqueName: \"kubernetes.io/projected/d9a45ea3-bea7-42e1-b684-74212ac61bf1-kube-api-access-fpg9s\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:35:18.687430 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.687164 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-podinfo\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:35:18.687430 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.687172 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-istio-data\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:35:18.687430 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:18.687180 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9a45ea3-bea7-42e1-b684-74212ac61bf1-workload-socket\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:35:19.123020 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:19.122983 2581 generic.go:356] "Generic (PLEG): container finished" podID="d9a45ea3-bea7-42e1-b684-74212ac61bf1" containerID="32ab301117e173e4109c799e050339842ca483de6dbb97c0447cdd414cbe3d5b" exitCode=0 Jul 09 14:35:19.123194 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:19.123038 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" Jul 09 14:35:19.123194 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:19.123057 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" event={"ID":"d9a45ea3-bea7-42e1-b684-74212ac61bf1","Type":"ContainerDied","Data":"32ab301117e173e4109c799e050339842ca483de6dbb97c0447cdd414cbe3d5b"} Jul 09 14:35:19.123194 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:19.123111 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2" event={"ID":"d9a45ea3-bea7-42e1-b684-74212ac61bf1","Type":"ContainerDied","Data":"b39829cd0645de6620bc8539beb23de3c841cd763a114efa5a3e241faf2fc65c"} Jul 09 14:35:19.123194 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:19.123132 2581 scope.go:117] "RemoveContainer" containerID="32ab301117e173e4109c799e050339842ca483de6dbb97c0447cdd414cbe3d5b" Jul 09 14:35:19.131873 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:19.131854 2581 scope.go:117] "RemoveContainer" containerID="32ab301117e173e4109c799e050339842ca483de6dbb97c0447cdd414cbe3d5b" Jul 09 14:35:19.132158 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:35:19.132139 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32ab301117e173e4109c799e050339842ca483de6dbb97c0447cdd414cbe3d5b\": container with ID starting with 32ab301117e173e4109c799e050339842ca483de6dbb97c0447cdd414cbe3d5b not found: ID does not exist" containerID="32ab301117e173e4109c799e050339842ca483de6dbb97c0447cdd414cbe3d5b" Jul 09 14:35:19.132235 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:19.132170 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ab301117e173e4109c799e050339842ca483de6dbb97c0447cdd414cbe3d5b"} err="failed to get container status \"32ab301117e173e4109c799e050339842ca483de6dbb97c0447cdd414cbe3d5b\": rpc error: code = NotFound desc = could not find container \"32ab301117e173e4109c799e050339842ca483de6dbb97c0447cdd414cbe3d5b\": container with ID starting with 32ab301117e173e4109c799e050339842ca483de6dbb97c0447cdd414cbe3d5b not found: ID does not exist" Jul 09 14:35:19.144898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:19.144865 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2"] Jul 09 14:35:19.149517 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:19.149492 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-82a8dbff-openshift-default-5df87fc799-wc5s2"] Jul 09 14:35:19.564357 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:19.564301 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9a45ea3-bea7-42e1-b684-74212ac61bf1" path="/var/lib/kubelet/pods/d9a45ea3-bea7-42e1-b684-74212ac61bf1/volumes" Jul 09 14:35:21.557151 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:21.557118 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:21.613020 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:21.612957 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:21.701581 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:21.701538 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:21.794799 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:21.794761 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:21.901418 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:21.901281 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:22.354349 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:22.354295 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:45.301993 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:45.301960 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:48.287299 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:48.287247 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:53.970468 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:53.970418 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:54.077030 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:54.076994 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:54.587908 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:35:54.587874 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:10.784922 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:10.784886 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:15.781473 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:15.781424 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:15.840537 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:15.840501 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:15.908000 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:15.907962 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:16.007082 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:16.007044 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:26.547538 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:26.547503 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:27.391934 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:27.391897 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:33.079622 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:33.079587 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:33.185745 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:33.185711 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:33.280424 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:33.280388 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:33.382739 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:33.382648 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:34.538295 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:34.538254 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:34.644791 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:34.644754 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:35.513354 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:35.513305 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:36:36.142852 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:36.142818 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:41.951161 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:41.951122 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:42.050698 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:42.050668 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:42.706459 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:42.706419 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:43.223555 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:43.223509 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:36:48.512986 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:48.512939 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:48.613722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:48.613694 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:48.817618 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:48.817520 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:49.113201 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.113115 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl"] Jul 09 14:36:49.113467 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.113453 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc6959d3-632d-47e7-8b00-365cb567a0be" containerName="istio-proxy" Jul 09 14:36:49.113516 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.113469 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc6959d3-632d-47e7-8b00-365cb567a0be" containerName="istio-proxy" Jul 09 14:36:49.113516 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.113489 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9a45ea3-bea7-42e1-b684-74212ac61bf1" containerName="istio-proxy" Jul 09 14:36:49.113516 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.113496 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9a45ea3-bea7-42e1-b684-74212ac61bf1" containerName="istio-proxy" Jul 09 14:36:49.113605 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.113543 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9a45ea3-bea7-42e1-b684-74212ac61bf1" containerName="istio-proxy" Jul 09 14:36:49.113605 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.113551 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc6959d3-632d-47e7-8b00-365cb567a0be" containerName="istio-proxy" Jul 09 14:36:49.116377 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.116359 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.119267 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.119248 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-12feff55-openshift-default-dockercfg-bxkdm\"" Jul 09 14:36:49.145968 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.145932 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl"] Jul 09 14:36:49.146232 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.146212 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-credential-socket\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.146294 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.146242 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istiod-ca-cert\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.146294 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.146286 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-podinfo\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.146416 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.146322 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwplg\" (UniqueName: \"kubernetes.io/projected/3bf29783-ca36-4d93-bd62-099d3c85b1b1-kube-api-access-vwplg\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.146416 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.146350 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-workload-socket\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.146523 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.146431 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-workload-certs\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.146523 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.146473 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-envoy\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.146621 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.146558 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-token\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.146621 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.146588 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-data\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.148204 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.148160 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:49.247612 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.247566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-podinfo\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.247612 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.247613 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwplg\" (UniqueName: \"kubernetes.io/projected/3bf29783-ca36-4d93-bd62-099d3c85b1b1-kube-api-access-vwplg\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.247829 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.247686 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-workload-socket\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.247829 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.247732 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-workload-certs\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.247829 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.247756 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-envoy\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.247829 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.247775 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-token\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.247829 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.247794 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-data\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.248107 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.247845 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-credential-socket\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.248107 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.247869 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istiod-ca-cert\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.248222 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.248128 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-workload-socket\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.248222 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.248212 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-data\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.248355 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.248264 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-workload-certs\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.248454 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.248434 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-credential-socket\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.248690 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.248670 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istiod-ca-cert\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.250017 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.250001 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-envoy\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.250305 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.250289 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-podinfo\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.259007 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.258979 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-token\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.259304 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.259287 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwplg\" (UniqueName: \"kubernetes.io/projected/3bf29783-ca36-4d93-bd62-099d3c85b1b1-kube-api-access-vwplg\") pod \"e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.426925 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.426820 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:49.570289 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.570255 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl"] Jul 09 14:36:49.573809 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:36:49.573769 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf29783_ca36_4d93_bd62_099d3c85b1b1.slice/crio-6d0d0ef752be56cb094a53dbbbe12bffaf594ffcc86b8de4eefb99b14be6f33b WatchSource:0}: Error finding container 6d0d0ef752be56cb094a53dbbbe12bffaf594ffcc86b8de4eefb99b14be6f33b: Status 404 returned error can't find the container with id 6d0d0ef752be56cb094a53dbbbe12bffaf594ffcc86b8de4eefb99b14be6f33b Jul 09 14:36:49.575792 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.575764 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:36:49.575862 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.575829 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:36:49.575862 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.575857 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:36:49.858057 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:49.858025 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:50.485014 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:50.484978 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" event={"ID":"3bf29783-ca36-4d93-bd62-099d3c85b1b1","Type":"ContainerStarted","Data":"709d878fbf970ddf6ba10317a99b11632819cce93b3d6d877bdaa99baa28c320"} Jul 09 14:36:50.485177 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:50.485036 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" event={"ID":"3bf29783-ca36-4d93-bd62-099d3c85b1b1","Type":"ContainerStarted","Data":"6d0d0ef752be56cb094a53dbbbe12bffaf594ffcc86b8de4eefb99b14be6f33b"} Jul 09 14:36:50.514367 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:50.514298 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" podStartSLOduration=1.5142831669999999 podStartE2EDuration="1.514283167s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:36:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:36:50.513077195 +0000 UTC m=+2039.713577570" watchObservedRunningTime="2026-07-09 14:36:50.514283167 +0000 UTC m=+2039.714783541" Jul 09 14:36:51.427860 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:51.427827 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:51.432839 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:51.432816 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:51.489366 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:51.489337 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:51.490462 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:51.490446 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:36:51.914807 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:36:51.914769 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:37:16.164527 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:37:16.164434 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:38:19.151402 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:38:19.151367 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:38:50.286836 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:38:50.286756 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:57.538381 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:39:57.538347 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl"] Jul 09 14:39:57.540639 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:39:57.538563 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" podUID="3bf29783-ca36-4d93-bd62-099d3c85b1b1" containerName="istio-proxy" containerID="cri-o://709d878fbf970ddf6ba10317a99b11632819cce93b3d6d877bdaa99baa28c320" gracePeriod=30 Jul 09 14:39:57.562745 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:39:57.562710 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:57.809814 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:39:57.809707 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:57.993490 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:39:57.993443 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:58.081734 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:39:58.081640 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:58.241691 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:39:58.241653 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:02.785072 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.785046 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:40:02.924376 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.924253 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-workload-certs\") pod \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " Jul 09 14:40:02.924376 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.924289 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-envoy\") pod \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " Jul 09 14:40:02.924376 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.924336 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-podinfo\") pod \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " Jul 09 14:40:02.924376 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.924361 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-token\") pod \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " Jul 09 14:40:02.924706 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.924408 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwplg\" (UniqueName: \"kubernetes.io/projected/3bf29783-ca36-4d93-bd62-099d3c85b1b1-kube-api-access-vwplg\") pod \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " Jul 09 14:40:02.924706 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.924431 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-data\") pod \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " Jul 09 14:40:02.924706 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.924476 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istiod-ca-cert\") pod \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " Jul 09 14:40:02.924706 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.924525 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-workload-socket\") pod \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " Jul 09 14:40:02.924706 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.924623 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3bf29783-ca36-4d93-bd62-099d3c85b1b1" (UID: "3bf29783-ca36-4d93-bd62-099d3c85b1b1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:40:02.924955 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.924783 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-data" (OuterVolumeSpecName: "istio-data") pod "3bf29783-ca36-4d93-bd62-099d3c85b1b1" (UID: "3bf29783-ca36-4d93-bd62-099d3c85b1b1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:40:02.924955 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.924920 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3bf29783-ca36-4d93-bd62-099d3c85b1b1" (UID: "3bf29783-ca36-4d93-bd62-099d3c85b1b1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:40:02.925042 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.924954 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3bf29783-ca36-4d93-bd62-099d3c85b1b1" (UID: "3bf29783-ca36-4d93-bd62-099d3c85b1b1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:40:02.925042 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.924992 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-credential-socket\") pod \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\" (UID: \"3bf29783-ca36-4d93-bd62-099d3c85b1b1\") " Jul 09 14:40:02.925122 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.925062 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3bf29783-ca36-4d93-bd62-099d3c85b1b1" (UID: "3bf29783-ca36-4d93-bd62-099d3c85b1b1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:40:02.925407 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.925301 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-data\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:40:02.925407 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.925341 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istiod-ca-cert\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:40:02.925407 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.925356 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-workload-socket\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:40:02.925407 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.925369 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-credential-socket\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:40:02.925407 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.925382 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-workload-certs\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:40:02.926587 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.926555 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bf29783-ca36-4d93-bd62-099d3c85b1b1-kube-api-access-vwplg" (OuterVolumeSpecName: "kube-api-access-vwplg") pod "3bf29783-ca36-4d93-bd62-099d3c85b1b1" (UID: "3bf29783-ca36-4d93-bd62-099d3c85b1b1"). InnerVolumeSpecName "kube-api-access-vwplg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:40:02.926722 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.926701 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-token" (OuterVolumeSpecName: "istio-token") pod "3bf29783-ca36-4d93-bd62-099d3c85b1b1" (UID: "3bf29783-ca36-4d93-bd62-099d3c85b1b1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:40:02.926862 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.926836 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3bf29783-ca36-4d93-bd62-099d3c85b1b1" (UID: "3bf29783-ca36-4d93-bd62-099d3c85b1b1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:40:02.926939 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:02.926906 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3bf29783-ca36-4d93-bd62-099d3c85b1b1" (UID: "3bf29783-ca36-4d93-bd62-099d3c85b1b1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 14:40:03.025810 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:03.025770 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-envoy\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:40:03.025810 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:03.025804 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-podinfo\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:40:03.025810 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:03.025813 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3bf29783-ca36-4d93-bd62-099d3c85b1b1-istio-token\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:40:03.025810 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:03.025822 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwplg\" (UniqueName: \"kubernetes.io/projected/3bf29783-ca36-4d93-bd62-099d3c85b1b1-kube-api-access-vwplg\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:40:03.264532 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:03.264498 2581 generic.go:356] "Generic (PLEG): container finished" podID="3bf29783-ca36-4d93-bd62-099d3c85b1b1" containerID="709d878fbf970ddf6ba10317a99b11632819cce93b3d6d877bdaa99baa28c320" exitCode=0 Jul 09 14:40:03.264693 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:03.264545 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" Jul 09 14:40:03.264693 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:03.264551 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" event={"ID":"3bf29783-ca36-4d93-bd62-099d3c85b1b1","Type":"ContainerDied","Data":"709d878fbf970ddf6ba10317a99b11632819cce93b3d6d877bdaa99baa28c320"} Jul 09 14:40:03.264693 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:03.264597 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl" event={"ID":"3bf29783-ca36-4d93-bd62-099d3c85b1b1","Type":"ContainerDied","Data":"6d0d0ef752be56cb094a53dbbbe12bffaf594ffcc86b8de4eefb99b14be6f33b"} Jul 09 14:40:03.264693 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:03.264619 2581 scope.go:117] "RemoveContainer" containerID="709d878fbf970ddf6ba10317a99b11632819cce93b3d6d877bdaa99baa28c320" Jul 09 14:40:03.273606 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:03.273585 2581 scope.go:117] "RemoveContainer" containerID="709d878fbf970ddf6ba10317a99b11632819cce93b3d6d877bdaa99baa28c320" Jul 09 14:40:03.273881 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:40:03.273855 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"709d878fbf970ddf6ba10317a99b11632819cce93b3d6d877bdaa99baa28c320\": container with ID starting with 709d878fbf970ddf6ba10317a99b11632819cce93b3d6d877bdaa99baa28c320 not found: ID does not exist" containerID="709d878fbf970ddf6ba10317a99b11632819cce93b3d6d877bdaa99baa28c320" Jul 09 14:40:03.273975 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:03.273885 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"709d878fbf970ddf6ba10317a99b11632819cce93b3d6d877bdaa99baa28c320"} err="failed to get container status \"709d878fbf970ddf6ba10317a99b11632819cce93b3d6d877bdaa99baa28c320\": rpc error: code = NotFound desc = could not find container \"709d878fbf970ddf6ba10317a99b11632819cce93b3d6d877bdaa99baa28c320\": container with ID starting with 709d878fbf970ddf6ba10317a99b11632819cce93b3d6d877bdaa99baa28c320 not found: ID does not exist" Jul 09 14:40:03.285599 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:03.285567 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl"] Jul 09 14:40:03.289254 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:03.289230 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-12feff55-openshift-default-6c8cb64f95-4qrzl"] Jul 09 14:40:03.564738 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:03.564661 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bf29783-ca36-4d93-bd62-099d3c85b1b1" path="/var/lib/kubelet/pods/3bf29783-ca36-4d93-bd62-099d3c85b1b1/volumes" Jul 09 14:40:03.990996 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:03.990958 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:04.313464 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:04.313371 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:04.414579 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:04.414544 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:10.068937 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:10.068897 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:10.166536 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:10.166506 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:17.586772 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.586691 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8"] Jul 09 14:40:17.587169 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.586976 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bf29783-ca36-4d93-bd62-099d3c85b1b1" containerName="istio-proxy" Jul 09 14:40:17.587169 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.586989 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bf29783-ca36-4d93-bd62-099d3c85b1b1" containerName="istio-proxy" Jul 09 14:40:17.587169 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.587056 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bf29783-ca36-4d93-bd62-099d3c85b1b1" containerName="istio-proxy" Jul 09 14:40:17.591248 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.591224 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.594139 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.594120 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-1998ef19-openshift-default-dockercfg-lt2pp\"" Jul 09 14:40:17.604290 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.604264 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8"] Jul 09 14:40:17.644113 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.644076 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-workload-certs\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.644290 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.644136 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3db8564d-e056-45fc-84ec-4a519db15feb-istio-podinfo\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.644290 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.644201 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3db8564d-e056-45fc-84ec-4a519db15feb-istiod-ca-cert\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.644290 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.644237 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-istio-envoy\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.644290 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.644267 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-credential-socket\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.644440 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.644328 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-istio-data\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.644440 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.644364 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3db8564d-e056-45fc-84ec-4a519db15feb-istio-token\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.644440 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.644385 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47rzr\" (UniqueName: \"kubernetes.io/projected/3db8564d-e056-45fc-84ec-4a519db15feb-kube-api-access-47rzr\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.644440 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.644404 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-workload-socket\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.717163 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.717129 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:17.745555 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.745514 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-credential-socket\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.745757 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.745572 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-istio-data\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.745757 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.745604 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3db8564d-e056-45fc-84ec-4a519db15feb-istio-token\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.745757 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.745634 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47rzr\" (UniqueName: \"kubernetes.io/projected/3db8564d-e056-45fc-84ec-4a519db15feb-kube-api-access-47rzr\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.745757 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.745658 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-workload-socket\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.745757 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.745701 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-workload-certs\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.746016 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.745770 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3db8564d-e056-45fc-84ec-4a519db15feb-istio-podinfo\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.746016 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.745797 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3db8564d-e056-45fc-84ec-4a519db15feb-istiod-ca-cert\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.746016 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.745823 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-istio-envoy\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.746016 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.745976 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-credential-socket\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.746201 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.746032 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-istio-data\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.746257 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.746207 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-workload-socket\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.746331 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.746251 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-workload-certs\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.746652 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.746630 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3db8564d-e056-45fc-84ec-4a519db15feb-istiod-ca-cert\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.747943 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.747924 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-istio-envoy\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.748280 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.748261 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3db8564d-e056-45fc-84ec-4a519db15feb-istio-podinfo\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.757684 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.757654 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47rzr\" (UniqueName: \"kubernetes.io/projected/3db8564d-e056-45fc-84ec-4a519db15feb-kube-api-access-47rzr\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.760636 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.760613 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3db8564d-e056-45fc-84ec-4a519db15feb-istio-token\") pod \"e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:17.901126 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:17.901036 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:18.021892 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:18.021859 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:18.037627 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:18.037587 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8"] Jul 09 14:40:18.040163 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:40:18.040137 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db8564d_e056_45fc_84ec_4a519db15feb.slice/crio-5641b3addf944823358b91a727d41a59f886da6cfbd4e32105c2ed7876e7bfcc WatchSource:0}: Error finding container 5641b3addf944823358b91a727d41a59f886da6cfbd4e32105c2ed7876e7bfcc: Status 404 returned error can't find the container with id 5641b3addf944823358b91a727d41a59f886da6cfbd4e32105c2ed7876e7bfcc Jul 09 14:40:18.041986 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:18.041955 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:40:18.042085 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:18.042029 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:40:18.042085 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:18.042072 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:40:18.123201 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:18.123161 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:18.325833 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:18.325795 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" event={"ID":"3db8564d-e056-45fc-84ec-4a519db15feb","Type":"ContainerStarted","Data":"119b134b710b59546652103775afdeb4b7d3bef9a8074d6d31e681127c941161"} Jul 09 14:40:18.326006 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:18.325854 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" event={"ID":"3db8564d-e056-45fc-84ec-4a519db15feb","Type":"ContainerStarted","Data":"5641b3addf944823358b91a727d41a59f886da6cfbd4e32105c2ed7876e7bfcc"} Jul 09 14:40:18.349303 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:18.349254 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" podStartSLOduration=1.349236916 podStartE2EDuration="1.349236916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:40:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:18.347507008 +0000 UTC m=+2247.548007602" watchObservedRunningTime="2026-07-09 14:40:18.349236916 +0000 UTC m=+2247.549737289" Jul 09 14:40:18.901720 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:18.901683 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:19.906992 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:19.906958 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:20.334734 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:20.334704 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:40:20.335719 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:40:20.335703 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:42:06.307901 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:42:06.307868 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:42:26.310232 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:42:26.310202 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:42:26.656500 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:42:26.656417 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:42:37.608114 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:42:37.608080 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:43:24.714817 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:24.714731 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8"] Jul 09 14:43:24.715376 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:24.714966 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" podUID="3db8564d-e056-45fc-84ec-4a519db15feb" containerName="istio-proxy" containerID="cri-o://119b134b710b59546652103775afdeb4b7d3bef9a8074d6d31e681127c941161" gracePeriod=30 Jul 09 14:43:24.739238 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:24.739207 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:43:25.984074 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:25.984041 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:43:26.085701 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:26.085668 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:43:26.186212 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:26.186172 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:43:26.291952 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:26.291860 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:43:26.994281 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:26.994253 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:43:27.088267 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:27.088233 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:43:27.188439 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:27.188409 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:43:28.427815 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:28.427784 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:43:28.545393 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:28.545364 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:43:29.968209 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:29.968185 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:43:30.041058 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.040903 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-istio-envoy\") pod \"3db8564d-e056-45fc-84ec-4a519db15feb\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " Jul 09 14:43:30.041058 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.041037 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-credential-socket\") pod \"3db8564d-e056-45fc-84ec-4a519db15feb\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " Jul 09 14:43:30.041285 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.041077 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-istio-data\") pod \"3db8564d-e056-45fc-84ec-4a519db15feb\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " Jul 09 14:43:30.041285 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.041100 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-workload-socket\") pod \"3db8564d-e056-45fc-84ec-4a519db15feb\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " Jul 09 14:43:30.041285 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.041143 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3db8564d-e056-45fc-84ec-4a519db15feb-istio-token\") pod \"3db8564d-e056-45fc-84ec-4a519db15feb\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " Jul 09 14:43:30.041285 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.041169 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3db8564d-e056-45fc-84ec-4a519db15feb-istio-podinfo\") pod \"3db8564d-e056-45fc-84ec-4a519db15feb\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " Jul 09 14:43:30.041285 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.041203 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-workload-certs\") pod \"3db8564d-e056-45fc-84ec-4a519db15feb\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " Jul 09 14:43:30.041285 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.041259 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47rzr\" (UniqueName: \"kubernetes.io/projected/3db8564d-e056-45fc-84ec-4a519db15feb-kube-api-access-47rzr\") pod \"3db8564d-e056-45fc-84ec-4a519db15feb\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " Jul 09 14:43:30.041625 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.041334 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3db8564d-e056-45fc-84ec-4a519db15feb-istiod-ca-cert\") pod \"3db8564d-e056-45fc-84ec-4a519db15feb\" (UID: \"3db8564d-e056-45fc-84ec-4a519db15feb\") " Jul 09 14:43:30.041625 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.041353 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-istio-data" (OuterVolumeSpecName: "istio-data") pod "3db8564d-e056-45fc-84ec-4a519db15feb" (UID: "3db8564d-e056-45fc-84ec-4a519db15feb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:43:30.041625 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.041398 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3db8564d-e056-45fc-84ec-4a519db15feb" (UID: "3db8564d-e056-45fc-84ec-4a519db15feb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:43:30.041625 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.041471 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3db8564d-e056-45fc-84ec-4a519db15feb" (UID: "3db8564d-e056-45fc-84ec-4a519db15feb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:43:30.041625 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.041543 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3db8564d-e056-45fc-84ec-4a519db15feb" (UID: "3db8564d-e056-45fc-84ec-4a519db15feb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:43:30.041844 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.041657 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-credential-socket\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:43:30.041844 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.041676 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-istio-data\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:43:30.041844 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.041689 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-workload-socket\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:43:30.041844 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.041703 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-workload-certs\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:43:30.041844 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.041743 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3db8564d-e056-45fc-84ec-4a519db15feb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3db8564d-e056-45fc-84ec-4a519db15feb" (UID: "3db8564d-e056-45fc-84ec-4a519db15feb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:43:30.043199 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.043172 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3db8564d-e056-45fc-84ec-4a519db15feb" (UID: "3db8564d-e056-45fc-84ec-4a519db15feb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:43:30.043531 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.043510 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3db8564d-e056-45fc-84ec-4a519db15feb-kube-api-access-47rzr" (OuterVolumeSpecName: "kube-api-access-47rzr") pod "3db8564d-e056-45fc-84ec-4a519db15feb" (UID: "3db8564d-e056-45fc-84ec-4a519db15feb"). InnerVolumeSpecName "kube-api-access-47rzr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:43:30.043742 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.043710 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3db8564d-e056-45fc-84ec-4a519db15feb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3db8564d-e056-45fc-84ec-4a519db15feb" (UID: "3db8564d-e056-45fc-84ec-4a519db15feb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 14:43:30.043742 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.043739 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3db8564d-e056-45fc-84ec-4a519db15feb-istio-token" (OuterVolumeSpecName: "istio-token") pod "3db8564d-e056-45fc-84ec-4a519db15feb" (UID: "3db8564d-e056-45fc-84ec-4a519db15feb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:43:30.093774 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.093739 2581 generic.go:356] "Generic (PLEG): container finished" podID="3db8564d-e056-45fc-84ec-4a519db15feb" containerID="119b134b710b59546652103775afdeb4b7d3bef9a8074d6d31e681127c941161" exitCode=0 Jul 09 14:43:30.093964 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.093786 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" Jul 09 14:43:30.093964 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.093831 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" event={"ID":"3db8564d-e056-45fc-84ec-4a519db15feb","Type":"ContainerDied","Data":"119b134b710b59546652103775afdeb4b7d3bef9a8074d6d31e681127c941161"} Jul 09 14:43:30.093964 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.093893 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8" event={"ID":"3db8564d-e056-45fc-84ec-4a519db15feb","Type":"ContainerDied","Data":"5641b3addf944823358b91a727d41a59f886da6cfbd4e32105c2ed7876e7bfcc"} Jul 09 14:43:30.094797 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.093924 2581 scope.go:117] "RemoveContainer" containerID="119b134b710b59546652103775afdeb4b7d3bef9a8074d6d31e681127c941161" Jul 09 14:43:30.103881 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.103861 2581 scope.go:117] "RemoveContainer" containerID="119b134b710b59546652103775afdeb4b7d3bef9a8074d6d31e681127c941161" Jul 09 14:43:30.104195 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:43:30.104174 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"119b134b710b59546652103775afdeb4b7d3bef9a8074d6d31e681127c941161\": container with ID starting with 119b134b710b59546652103775afdeb4b7d3bef9a8074d6d31e681127c941161 not found: ID does not exist" containerID="119b134b710b59546652103775afdeb4b7d3bef9a8074d6d31e681127c941161" Jul 09 14:43:30.104243 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.104204 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"119b134b710b59546652103775afdeb4b7d3bef9a8074d6d31e681127c941161"} err="failed to get container status \"119b134b710b59546652103775afdeb4b7d3bef9a8074d6d31e681127c941161\": rpc error: code = NotFound desc = could not find container \"119b134b710b59546652103775afdeb4b7d3bef9a8074d6d31e681127c941161\": container with ID starting with 119b134b710b59546652103775afdeb4b7d3bef9a8074d6d31e681127c941161 not found: ID does not exist" Jul 09 14:43:30.115776 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.115745 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8"] Jul 09 14:43:30.121779 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.121750 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-1998ef19-openshift-default-8558fcd8dc-t55g8"] Jul 09 14:43:30.142580 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.142544 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47rzr\" (UniqueName: \"kubernetes.io/projected/3db8564d-e056-45fc-84ec-4a519db15feb-kube-api-access-47rzr\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:43:30.142580 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.142577 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3db8564d-e056-45fc-84ec-4a519db15feb-istiod-ca-cert\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:43:30.142785 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.142593 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3db8564d-e056-45fc-84ec-4a519db15feb-istio-envoy\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:43:30.142785 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.142604 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3db8564d-e056-45fc-84ec-4a519db15feb-istio-token\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:43:30.142785 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:30.142612 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3db8564d-e056-45fc-84ec-4a519db15feb-istio-podinfo\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:43:31.564578 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:31.564544 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3db8564d-e056-45fc-84ec-4a519db15feb" path="/var/lib/kubelet/pods/3db8564d-e056-45fc-84ec-4a519db15feb/volumes" Jul 09 14:43:34.303662 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:34.303631 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:43:34.375578 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:34.375523 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:43:34.952970 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:34.952844 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:43:40.665789 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:40.665753 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:43:40.733660 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:40.733629 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:43:40.814079 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:40.814048 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:43:40.905869 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:40.905839 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:43:42.320074 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:42.320039 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wxw9l"] Jul 09 14:43:51.393718 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:51.393684 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:43:51.743133 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:43:51.743101 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:10.299748 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:10.299712 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:12.784873 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:12.784824 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:18.430521 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:18.430481 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:18.530758 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:18.530725 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:18.789911 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:18.789877 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:19.072044 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.071965 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m"] Jul 09 14:44:19.072288 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.072274 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3db8564d-e056-45fc-84ec-4a519db15feb" containerName="istio-proxy" Jul 09 14:44:19.072361 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.072291 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3db8564d-e056-45fc-84ec-4a519db15feb" containerName="istio-proxy" Jul 09 14:44:19.072417 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.072368 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3db8564d-e056-45fc-84ec-4a519db15feb" containerName="istio-proxy" Jul 09 14:44:19.075190 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.075173 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.077876 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.077853 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a7e342-openshift-default-dockercfg-88rmf\"" Jul 09 14:44:19.091192 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.091165 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m"] Jul 09 14:44:19.094140 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.094064 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:19.132827 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.132789 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-workload-socket\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.132827 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.132829 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-envoy\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.133128 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.132926 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-credential-socket\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.133128 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.132952 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-workload-certs\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.133128 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.132987 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istiod-ca-cert\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.133128 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.133019 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-token\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.133128 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.133064 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-data\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.133128 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.133094 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72nmz\" (UniqueName: \"kubernetes.io/projected/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-kube-api-access-72nmz\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.133384 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.133134 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-podinfo\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.234534 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.234498 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-workload-socket\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.234534 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.234535 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-envoy\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.234784 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.234603 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-credential-socket\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.234784 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.234627 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-workload-certs\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.234784 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.234757 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istiod-ca-cert\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.234942 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.234792 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-token\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.234942 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.234894 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-workload-socket\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.235045 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.234925 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-data\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.235045 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.234977 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72nmz\" (UniqueName: \"kubernetes.io/projected/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-kube-api-access-72nmz\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.235045 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.235012 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-workload-certs\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.235045 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.235019 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-podinfo\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.235199 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.235069 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-credential-socket\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.235292 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.235271 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-data\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.235511 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.235490 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istiod-ca-cert\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.236898 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.236868 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-envoy\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.237473 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.237456 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-podinfo\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.243547 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.243521 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-token\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.243659 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.243546 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72nmz\" (UniqueName: \"kubernetes.io/projected/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-kube-api-access-72nmz\") pod \"e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.386037 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.385937 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:19.511724 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.511695 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:44:19.523081 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.523059 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m"] Jul 09 14:44:19.525266 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:44:19.525238 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5224ecd_437f_4221_a5f2_cd5a26a0e73b.slice/crio-8d18cd4648e4c26622e8e97d6a79d30fc2a25e06398b2d81ddb852fed91f4222 WatchSource:0}: Error finding container 8d18cd4648e4c26622e8e97d6a79d30fc2a25e06398b2d81ddb852fed91f4222: Status 404 returned error can't find the container with id 8d18cd4648e4c26622e8e97d6a79d30fc2a25e06398b2d81ddb852fed91f4222 Jul 09 14:44:19.527441 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.527403 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:44:19.527520 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.527484 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:44:19.527560 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:19.527524 2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 09 14:44:20.300180 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:20.300145 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" event={"ID":"b5224ecd-437f-4221-a5f2-cd5a26a0e73b","Type":"ContainerStarted","Data":"6ceff533c3b9103f4bcd3b2ce1fb0d9b65feda9ee5e9602053608ccd6b984618"} Jul 09 14:44:20.300377 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:20.300227 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" event={"ID":"b5224ecd-437f-4221-a5f2-cd5a26a0e73b","Type":"ContainerStarted","Data":"8d18cd4648e4c26622e8e97d6a79d30fc2a25e06398b2d81ddb852fed91f4222"} Jul 09 14:44:20.322407 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:20.322321 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" podStartSLOduration=1.322291737 podStartE2EDuration="1.322291737s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:44:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:44:20.321337677 +0000 UTC m=+2489.521838054" watchObservedRunningTime="2026-07-09 14:44:20.322291737 +0000 UTC m=+2489.522792109" Jul 09 14:44:20.387078 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:20.387041 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:20.391605 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:20.391579 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:21.304699 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:21.304662 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:44:21.305589 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:44:21.305571 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:47:26.675028 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:26.674988 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m"] Jul 09 14:47:26.675549 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:26.675250 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" podUID="b5224ecd-437f-4221-a5f2-cd5a26a0e73b" containerName="istio-proxy" containerID="cri-o://6ceff533c3b9103f4bcd3b2ce1fb0d9b65feda9ee5e9602053608ccd6b984618" gracePeriod=30 Jul 09 14:47:26.734759 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:26.734721 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:47:26.945093 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:26.945003 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:47:31.920762 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:31.920739 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:47:32.048457 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.048425 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-data\") pod \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " Jul 09 14:47:32.048664 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.048481 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-credential-socket\") pod \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " Jul 09 14:47:32.048664 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.048512 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istiod-ca-cert\") pod \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " Jul 09 14:47:32.048664 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.048539 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-podinfo\") pod \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " Jul 09 14:47:32.048664 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.048563 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72nmz\" (UniqueName: \"kubernetes.io/projected/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-kube-api-access-72nmz\") pod \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " Jul 09 14:47:32.048664 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.048602 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-workload-socket\") pod \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " Jul 09 14:47:32.048664 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.048624 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-envoy\") pod \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " Jul 09 14:47:32.048962 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.048680 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-token\") pod \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " Jul 09 14:47:32.048962 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.048703 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-workload-certs\") pod \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\" (UID: \"b5224ecd-437f-4221-a5f2-cd5a26a0e73b\") " Jul 09 14:47:32.048962 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.048771 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-data" (OuterVolumeSpecName: "istio-data") pod "b5224ecd-437f-4221-a5f2-cd5a26a0e73b" (UID: "b5224ecd-437f-4221-a5f2-cd5a26a0e73b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:47:32.049113 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.048958 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b5224ecd-437f-4221-a5f2-cd5a26a0e73b" (UID: "b5224ecd-437f-4221-a5f2-cd5a26a0e73b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:47:32.049113 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.048780 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b5224ecd-437f-4221-a5f2-cd5a26a0e73b" (UID: "b5224ecd-437f-4221-a5f2-cd5a26a0e73b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:47:32.049113 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.049007 2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-data\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:47:32.049113 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.049009 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b5224ecd-437f-4221-a5f2-cd5a26a0e73b" (UID: "b5224ecd-437f-4221-a5f2-cd5a26a0e73b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:47:32.049282 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.049108 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b5224ecd-437f-4221-a5f2-cd5a26a0e73b" (UID: "b5224ecd-437f-4221-a5f2-cd5a26a0e73b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:47:32.051073 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.051048 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b5224ecd-437f-4221-a5f2-cd5a26a0e73b" (UID: "b5224ecd-437f-4221-a5f2-cd5a26a0e73b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:47:32.051492 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.051466 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-token" (OuterVolumeSpecName: "istio-token") pod "b5224ecd-437f-4221-a5f2-cd5a26a0e73b" (UID: "b5224ecd-437f-4221-a5f2-cd5a26a0e73b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:47:32.051591 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.051487 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-kube-api-access-72nmz" (OuterVolumeSpecName: "kube-api-access-72nmz") pod "b5224ecd-437f-4221-a5f2-cd5a26a0e73b" (UID: "b5224ecd-437f-4221-a5f2-cd5a26a0e73b"). InnerVolumeSpecName "kube-api-access-72nmz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:47:32.051701 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.051674 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b5224ecd-437f-4221-a5f2-cd5a26a0e73b" (UID: "b5224ecd-437f-4221-a5f2-cd5a26a0e73b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 14:47:32.052627 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.052601 2581 generic.go:356] "Generic (PLEG): container finished" podID="b5224ecd-437f-4221-a5f2-cd5a26a0e73b" containerID="6ceff533c3b9103f4bcd3b2ce1fb0d9b65feda9ee5e9602053608ccd6b984618" exitCode=0 Jul 09 14:47:32.052710 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.052658 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" Jul 09 14:47:32.052710 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.052674 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" event={"ID":"b5224ecd-437f-4221-a5f2-cd5a26a0e73b","Type":"ContainerDied","Data":"6ceff533c3b9103f4bcd3b2ce1fb0d9b65feda9ee5e9602053608ccd6b984618"} Jul 09 14:47:32.052782 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.052762 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m" event={"ID":"b5224ecd-437f-4221-a5f2-cd5a26a0e73b","Type":"ContainerDied","Data":"8d18cd4648e4c26622e8e97d6a79d30fc2a25e06398b2d81ddb852fed91f4222"} Jul 09 14:47:32.052817 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.052792 2581 scope.go:117] "RemoveContainer" containerID="6ceff533c3b9103f4bcd3b2ce1fb0d9b65feda9ee5e9602053608ccd6b984618" Jul 09 14:47:32.066953 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.066934 2581 scope.go:117] "RemoveContainer" containerID="6ceff533c3b9103f4bcd3b2ce1fb0d9b65feda9ee5e9602053608ccd6b984618" Jul 09 14:47:32.067237 ip-10-0-134-107 kubenswrapper[2581]: E0709 14:47:32.067219 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ceff533c3b9103f4bcd3b2ce1fb0d9b65feda9ee5e9602053608ccd6b984618\": container with ID starting with 6ceff533c3b9103f4bcd3b2ce1fb0d9b65feda9ee5e9602053608ccd6b984618 not found: ID does not exist" containerID="6ceff533c3b9103f4bcd3b2ce1fb0d9b65feda9ee5e9602053608ccd6b984618" Jul 09 14:47:32.067274 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.067249 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ceff533c3b9103f4bcd3b2ce1fb0d9b65feda9ee5e9602053608ccd6b984618"} err="failed to get container status \"6ceff533c3b9103f4bcd3b2ce1fb0d9b65feda9ee5e9602053608ccd6b984618\": rpc error: code = NotFound desc = could not find container \"6ceff533c3b9103f4bcd3b2ce1fb0d9b65feda9ee5e9602053608ccd6b984618\": container with ID starting with 6ceff533c3b9103f4bcd3b2ce1fb0d9b65feda9ee5e9602053608ccd6b984618 not found: ID does not exist" Jul 09 14:47:32.079695 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.079666 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m"] Jul 09 14:47:32.085209 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.085187 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a7e342-openshift-default-57f78f5ddf-jp59m"] Jul 09 14:47:32.149596 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.149556 2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-credential-socket\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:47:32.149596 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.149590 2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istiod-ca-cert\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:47:32.149596 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.149606 2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-podinfo\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:47:32.149848 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.149618 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72nmz\" (UniqueName: \"kubernetes.io/projected/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-kube-api-access-72nmz\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:47:32.149848 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.149630 2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-workload-socket\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:47:32.149848 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.149641 2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-envoy\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:47:32.149848 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.149652 2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-istio-token\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:47:32.149848 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:32.149664 2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5224ecd-437f-4221-a5f2-cd5a26a0e73b-workload-certs\") on node \"ip-10-0-134-107.ec2.internal\" DevicePath \"\"" Jul 09 14:47:33.479582 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:33.479552 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65dbd89dd4-4bgrt_fafedb38-92d4-46c7-b18b-0fc061a3c529/manager/0.log" Jul 09 14:47:33.564292 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:33.564258 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5224ecd-437f-4221-a5f2-cd5a26a0e73b" path="/var/lib/kubelet/pods/b5224ecd-437f-4221-a5f2-cd5a26a0e73b/volumes" Jul 09 14:47:33.973606 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:33.973580 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f67568454-d6nzq_1af7c5dd-633a-40cf-b479-6a96810ee3d9/copy-manifests/0.log" Jul 09 14:47:33.980855 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:33.980834 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f67568454-d6nzq_1af7c5dd-633a-40cf-b479-6a96810ee3d9/manager/0.log" Jul 09 14:47:34.613233 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:34.613195 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29726775-m5m6t_53d2e811-506e-449f-b934-bc1b4eb80791/cleanup/0.log" Jul 09 14:47:37.072109 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:37.072082 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wxw9l_4e99df6f-f7a3-4719-9d5f-c9218a191dce/limitador/0.log" Jul 09 14:47:37.555763 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:37.555734 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4kzmmh_2d69dfb3-cbce-4854-a972-d35b9080a52d/istio-proxy/0.log" Jul 09 14:47:37.680541 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:37.680503 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ngwnd_b886bb7f-2e6e-4182-a2d5-c7b6efc076e9/discovery/0.log" Jul 09 14:47:39.175943 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:39.175909 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-w9l4x_ee4d4379-a6f6-4747-8913-98aa9a9a44f3/main/0.log" Jul 09 14:47:43.766067 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:43.765986 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:47:43.836702 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:43.836672 2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" limit=1024 Jul 09 14:47:46.762470 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:46.762443 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-clsk2_37f5d43f-9abe-4758-bba1-59ae699d42ec/global-pull-secret-syncer/0.log" Jul 09 14:47:46.849245 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:46.849211 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mxk8s_fbef93c8-131c-466f-a704-9afdd480b500/konnectivity-agent/0.log" Jul 09 14:47:46.929956 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:46.929931 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-107.ec2.internal_6817e2e237c40714ab072889b9b23a38/haproxy/0.log" Jul 09 14:47:52.499291 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:52.499259 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wxw9l_4e99df6f-f7a3-4719-9d5f-c9218a191dce/limitador/0.log" Jul 09 14:47:54.714436 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:54.714404 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2kswm_2f6cea8e-94c6-4d10-9cc7-e9555a0253e1/node-exporter/0.log" Jul 09 14:47:54.733234 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:54.733198 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2kswm_2f6cea8e-94c6-4d10-9cc7-e9555a0253e1/kube-rbac-proxy/0.log" Jul 09 14:47:54.755483 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:54.755456 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2kswm_2f6cea8e-94c6-4d10-9cc7-e9555a0253e1/init-textfile/0.log" Jul 09 14:47:56.645421 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.645385 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt"] Jul 09 14:47:56.645810 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.645716 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5224ecd-437f-4221-a5f2-cd5a26a0e73b" containerName="istio-proxy" Jul 09 14:47:56.645810 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.645729 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5224ecd-437f-4221-a5f2-cd5a26a0e73b" containerName="istio-proxy" Jul 09 14:47:56.645810 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.645778 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5224ecd-437f-4221-a5f2-cd5a26a0e73b" containerName="istio-proxy" Jul 09 14:47:56.650181 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.650160 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" Jul 09 14:47:56.653038 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.653016 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gqx2q\"/\"kube-root-ca.crt\"" Jul 09 14:47:56.654298 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.654277 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gqx2q\"/\"default-dockercfg-4vx79\"" Jul 09 14:47:56.654410 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.654280 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gqx2q\"/\"openshift-service-ca.crt\"" Jul 09 14:47:56.659879 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.659857 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt"] Jul 09 14:47:56.742866 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.742826 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb-proc\") pod \"perf-node-gather-daemonset-vhxwt\" (UID: \"b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" Jul 09 14:47:56.743066 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.742875 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb-lib-modules\") pod \"perf-node-gather-daemonset-vhxwt\" (UID: \"b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" Jul 09 14:47:56.743066 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.742938 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb-sys\") pod \"perf-node-gather-daemonset-vhxwt\" (UID: \"b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" Jul 09 14:47:56.743066 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.742967 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb-podres\") pod \"perf-node-gather-daemonset-vhxwt\" (UID: \"b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" Jul 09 14:47:56.743066 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.743034 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drmgx\" (UniqueName: \"kubernetes.io/projected/b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb-kube-api-access-drmgx\") pod \"perf-node-gather-daemonset-vhxwt\" (UID: \"b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" Jul 09 14:47:56.844334 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.844268 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb-sys\") pod \"perf-node-gather-daemonset-vhxwt\" (UID: \"b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" Jul 09 14:47:56.844334 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.844341 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb-podres\") pod \"perf-node-gather-daemonset-vhxwt\" (UID: \"b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" Jul 09 14:47:56.844538 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.844422 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb-sys\") pod \"perf-node-gather-daemonset-vhxwt\" (UID: \"b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" Jul 09 14:47:56.844538 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.844428 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drmgx\" (UniqueName: \"kubernetes.io/projected/b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb-kube-api-access-drmgx\") pod \"perf-node-gather-daemonset-vhxwt\" (UID: \"b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" Jul 09 14:47:56.844538 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.844509 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb-proc\") pod \"perf-node-gather-daemonset-vhxwt\" (UID: \"b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" Jul 09 14:47:56.844538 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.844457 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb-podres\") pod \"perf-node-gather-daemonset-vhxwt\" (UID: \"b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" Jul 09 14:47:56.844666 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.844538 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb-lib-modules\") pod \"perf-node-gather-daemonset-vhxwt\" (UID: \"b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" Jul 09 14:47:56.844666 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.844584 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb-proc\") pod \"perf-node-gather-daemonset-vhxwt\" (UID: \"b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" Jul 09 14:47:56.844737 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.844668 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb-lib-modules\") pod \"perf-node-gather-daemonset-vhxwt\" (UID: \"b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" Jul 09 14:47:56.852677 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.852652 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drmgx\" (UniqueName: \"kubernetes.io/projected/b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb-kube-api-access-drmgx\") pod \"perf-node-gather-daemonset-vhxwt\" (UID: \"b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" Jul 09 14:47:56.960973 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:56.960878 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" Jul 09 14:47:57.090506 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:57.090479 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt"] Jul 09 14:47:57.092769 ip-10-0-134-107 kubenswrapper[2581]: W0709 14:47:57.092735 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb797b6ae_21b8_4f37_98ca_8a3b74a8b4cb.slice/crio-b52b96a16dc93fcf6119579573f0717e9439bc837c42f6e8dae6547d25598366 WatchSource:0}: Error finding container b52b96a16dc93fcf6119579573f0717e9439bc837c42f6e8dae6547d25598366: Status 404 returned error can't find the container with id b52b96a16dc93fcf6119579573f0717e9439bc837c42f6e8dae6547d25598366 Jul 09 14:47:57.151542 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:57.151506 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" event={"ID":"b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb","Type":"ContainerStarted","Data":"b52b96a16dc93fcf6119579573f0717e9439bc837c42f6e8dae6547d25598366"} Jul 09 14:47:58.156817 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:58.156781 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" event={"ID":"b797b6ae-21b8-4f37-98ca-8a3b74a8b4cb","Type":"ContainerStarted","Data":"4d558db613c6ee063606ad013baef1b20aae1b9dec5435ba756390546e07b99a"} Jul 09 14:47:58.157277 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:58.156936 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" Jul 09 14:47:58.175743 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:58.175689 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" podStartSLOduration=2.175671625 podStartE2EDuration="2.175671625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:47:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:47:58.173501405 +0000 UTC m=+2707.374001775" watchObservedRunningTime="2026-07-09 14:47:58.175671625 +0000 UTC m=+2707.376171999" Jul 09 14:47:59.759117 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:59.759091 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zcddz_e4104855-f579-461e-98de-900889c4b962/dns/0.log" Jul 09 14:47:59.782290 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:59.782266 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zcddz_e4104855-f579-461e-98de-900889c4b962/kube-rbac-proxy/0.log" Jul 09 14:47:59.831348 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:47:59.831301 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p8q9w_6cc0b610-de8c-45a6-862f-8c859f4c7777/dns-node-resolver/0.log" Jul 09 14:48:00.506873 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:00.506848 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qdfgv_dd9909a6-9743-4756-83ac-19b7bbdb0a72/node-ca/0.log" Jul 09 14:48:01.566528 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:01.566500 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4kzmmh_2d69dfb3-cbce-4854-a972-d35b9080a52d/istio-proxy/0.log" Jul 09 14:48:01.648245 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:01.648210 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ngwnd_b886bb7f-2e6e-4182-a2d5-c7b6efc076e9/discovery/0.log" Jul 09 14:48:02.598159 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:02.598133 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hbdrf_c93815c9-e9c5-4115-98f2-1ff14b09553a/serve-healthcheck-canary/0.log" Jul 09 14:48:03.113686 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:03.113658 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bx4d4_5104694c-794d-4177-8593-82b31d38f9fd/kube-rbac-proxy/0.log" Jul 09 14:48:03.141139 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:03.141110 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bx4d4_5104694c-794d-4177-8593-82b31d38f9fd/exporter/0.log" Jul 09 14:48:03.161901 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:03.161876 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bx4d4_5104694c-794d-4177-8593-82b31d38f9fd/extractor/0.log" Jul 09 14:48:04.170549 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:04.170516 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-vhxwt" Jul 09 14:48:05.641673 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:05.641640 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-65dbd89dd4-4bgrt_fafedb38-92d4-46c7-b18b-0fc061a3c529/manager/0.log" Jul 09 14:48:05.798250 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:05.798167 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f67568454-d6nzq_1af7c5dd-633a-40cf-b479-6a96810ee3d9/manager/0.log" Jul 09 14:48:05.820867 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:05.820843 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f67568454-d6nzq_1af7c5dd-633a-40cf-b479-6a96810ee3d9/copy-manifests/0.log" Jul 09 14:48:07.204260 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:07.204226 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4kzmmh_2d69dfb3-cbce-4854-a972-d35b9080a52d/istio-proxy/0.log" Jul 09 14:48:07.208591 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:07.208560 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-677b74f79f-fwm7f_bd0e5246-8aef-4a90-ad1a-4744b0d1cb6a/manager/0.log" Jul 09 14:48:07.257829 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:07.257799 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ngwnd_b886bb7f-2e6e-4182-a2d5-c7b6efc076e9/discovery/0.log" Jul 09 14:48:08.579838 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:08.579810 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4kzmmh_2d69dfb3-cbce-4854-a972-d35b9080a52d/istio-proxy/0.log" Jul 09 14:48:08.632008 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:08.631973 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ngwnd_b886bb7f-2e6e-4182-a2d5-c7b6efc076e9/discovery/0.log" Jul 09 14:48:12.076915 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:12.076889 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-5wkg5_173baa95-f293-41a1-8cde-b7bda4be5f3a/migrator/0.log" Jul 09 14:48:12.095506 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:12.095474 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-5wkg5_173baa95-f293-41a1-8cde-b7bda4be5f3a/graceful-termination/0.log" Jul 09 14:48:13.601200 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:13.601172 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bknr_38a844f5-ef21-4817-b365-3b852d56ca7c/kube-multus-additional-cni-plugins/0.log" Jul 09 14:48:13.620444 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:13.620409 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bknr_38a844f5-ef21-4817-b365-3b852d56ca7c/egress-router-binary-copy/0.log" Jul 09 14:48:13.642197 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:13.642171 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bknr_38a844f5-ef21-4817-b365-3b852d56ca7c/cni-plugins/0.log" Jul 09 14:48:13.661863 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:13.661843 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bknr_38a844f5-ef21-4817-b365-3b852d56ca7c/bond-cni-plugin/0.log" Jul 09 14:48:13.682481 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:13.682457 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bknr_38a844f5-ef21-4817-b365-3b852d56ca7c/routeoverride-cni/0.log" Jul 09 14:48:13.704490 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:13.704463 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bknr_38a844f5-ef21-4817-b365-3b852d56ca7c/whereabouts-cni-bincopy/0.log" Jul 09 14:48:13.724217 ip-10-0-134-107 kubenswrapper[2581]: I0709 14:48:13.724197 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7bknr_38a844f5-ef21-4817-b365-3b852d56ca7c/whereabouts-cni/0.log"